WO2017213165A1 - Display device and electronic apparatus - Google Patents
Display device and electronic apparatus Download PDFInfo
- Publication number
- WO2017213165A1 WO2017213165A1 PCT/JP2017/021066 JP2017021066W WO2017213165A1 WO 2017213165 A1 WO2017213165 A1 WO 2017213165A1 JP 2017021066 W JP2017021066 W JP 2017021066W WO 2017213165 A1 WO2017213165 A1 WO 2017213165A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- display
- image
- luminance
- brightness
- outside world
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/02—Viewing or reading apparatus
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/10—Intensity circuits
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/64—Constructional details of receivers, e.g. cabinets or dust covers
Definitions
- the present invention relates to a display device and an electronic apparatus provided with a transmissive display.
- HMD Head mounted display
- HUD in-vehicle head-up display
- Patent Document 1 discloses a virtual image display device that has an external light sensor that detects the intensity of external light and changes the transmittance of the optical element based on the output of the external light sensor. According to the technique of Patent Document 1, it is possible to observe an image adjusted according to a change in the brightness of the outside world.
- Patent Document 1 adjusts the transmittance of the light control plate based on the detection signal from the external light sensor to appropriately shield external light, thereby reducing the contrast of the virtual image formed by the image forming apparatus. This is to prevent difficulty in seeing. Therefore, when the brightness and contrast of the outside world are reduced, the technique of Patent Document 1 cannot cope with it.
- Patent Document 2 the brighter the external illuminance detected by the illuminance detection means, the wider the luminance interval between the luminance levels, and the darker the external illuminance is, the narrower the luminance interval between the luminance levels.
- a technique is disclosed in which the luminance of the backlight is determined for each luminance level so that the ratio of the luminance of the light source to the external illuminance is always constant at the same luminance level.
- the luminance of the backlight can be determined so that the luminance interval between luminance levels becomes narrower as the illuminance of the outside world becomes darker.
- the technique of Patent Document 2 cannot cope with the problem and remains a problem.
- the present invention has been made in view of the above circumstances, and includes a transmissive display that can clearly identify and visually recognize the outside world and a display image even when the brightness and contrast of the outside world are reduced. It is an object to provide a display device and an electronic device.
- a display device reflecting one aspect of the present invention.
- a transmissive display capable of displaying an image and allowing an observer to visually recognize the outside world together with the displayed image;
- a display control device for displaying an image on the transmissive display;
- a brightness sensor that detects the brightness of the outside world that the viewer visually recognizes through the transmissive display, When the maximum brightness of the external environment detected by the brightness sensor is A (cd / m 2 ) and the minimum brightness of the external environment is B (cd / m 2 ), A ⁇ 500 (1) B / A ⁇ ⁇ (2) (However, ⁇ is an arbitrary value) When the brightness of the image displayed on the transmissive display is C (cd / m 2 ), ⁇ ⁇ (B + C) / (A + C) ⁇ 0.9 (3) The brightness of the image displayed on the transmissive display is adjusted so as to satisfy the above condition.
- a display device and an electronic apparatus including a transmissive display that can clearly identify and visually recognize the outside world and a display image even when the brightness and contrast of the outside world are reduced. it can.
- HMD head mounted display
- FIG. 11 is a diagram showing a luminance distribution in a range (regions 37 to 45) through which an X-X line in FIG. 10 passes, where the vertical axis represents the external brightness and the horizontal axis represents the external position. It is a figure which takes the brightness
- 4 is a flowchart illustrating control performed by a control processing unit 121.
- FIG. 1 is a perspective view of a head mounted display 100 that is an electronic apparatus according to the present embodiment.
- FIG. 2 is a front view of the HMD 100 according to the present embodiment.
- FIG. 3 is a view of the HMD 100 according to the present embodiment as viewed from above.
- the right side and the left side of the HMD 100 refer to the right side and the left side for the user (observer) wearing the HMD 100.
- the HMD 100 of this embodiment has a frame 101 as a support member.
- a frame 101 that is U-shaped when viewed from above has a front part 101a to which two spectacle lenses 102 are attached, and side parts 101b and 101c extending rearward from both ends of the front part 101a.
- the two spectacle lenses 102 attached to the frame 101 may or may not have refractive power.
- a cylindrical main body 103 as a support member is fixed to the front portion 101a of the frame 101 on the upper side of the spectacle lens 102 on the right side (which may be on the left side depending on the user's dominant eye).
- the main body 103 is provided with a display unit 104.
- a display image / display luminance control unit 121a (see FIG. 6 described later) that controls display of the display unit 104 based on an instruction from the control processing unit 121 described later is disposed. If necessary, a display unit may be arranged in front of both eyes.
- FIG. 4 is a schematic cross-sectional view showing the configuration of the display unit 104.
- the display unit 104 as a display device includes an image forming unit 104A and an image display unit 104B.
- the image forming unit 104A is incorporated in the main body unit 103, and includes a light source 104a, a unidirectional diffuser 104b, a condenser lens 104c, and a display element 104d.
- the image display unit 104B which is a so-called see-through type display member (transmission type display), is arranged so as to extend downward from the main body unit 103 and in parallel with one eyeglass lens 102 (see FIG. 1). Further, it is generally plate-shaped and has an eyepiece prism 104f, a deflection prism 104g, and a hologram optical element 104h.
- the light source 104a has a function of illuminating the display element 104d.
- the light source 104a emits light having a predetermined wavelength width, whereby the image light obtained by illuminating the display element 104d can have a predetermined wavelength width, and the hologram optical element 104h transmits the image light.
- the peak wavelength for each color of the light source 104a is set in the vicinity of the peak wavelength of the diffraction efficiency of the hologram optical element 104h, so that the light use efficiency is improved.
- the light source 104a is composed of LEDs that emit RGB light, the cost of the light source 104a can be reduced, and a color image is displayed on the display element 104d when the display element 104d is illuminated. The color image can be visually recognized by the user.
- each of the RGB LED elements has a narrow emission wavelength width, the use of a plurality of such LED elements enables high color reproducibility and bright image display.
- the display element 104d displays an image by modulating the light emitted from the light source 104a in accordance with image data, and is configured by a transmissive liquid crystal display element having pixels that serve as light transmitting regions in a matrix. Has been. Note that the display element 104d may be of a reflective type.
- the eyepiece prism 104f totally reflects the image light from the display element 104d incident through the base end face PL1 by the opposed parallel inner side face PL2 and outer side face PL3, and passes through the hologram optical element 104h to the user's pupil.
- external light is transmitted and guided to the user's pupil, and is composed of, for example, an acrylic resin together with the deflecting prism 104g.
- the eyepiece prism 104f and the deflection prism 104g are joined by an adhesive with the hologram optical element 104h sandwiched between inclined surfaces PL4 and PL5 inclined with respect to the inner surface PL2 and the outer surface PL3.
- the deflection prism 104g is joined to the eyepiece prism 104f, and becomes a substantially parallel flat plate integrated with the eyepiece prism 104f. By joining the deflecting prism 104g to the eyepiece prism 104f, it is possible to prevent distortion in the external image observed by the user through the display unit 104.
- the hologram optical element 104h diffracts and reflects the image light (light having a wavelength corresponding to the three primary colors) emitted from the display element 104d to guide it to the pupil B ′, and enlarges the image displayed on the display element 104d by the user. It is a volume phase type reflection hologram guided as a virtual image to the pupil.
- the hologram optical element 104h has, for example, three wavelength ranges of 465 ⁇ 5 nm (B light), 521 ⁇ 5 nm (G light), and 634 ⁇ 5 nm (R light) with a peak wavelength of diffraction efficiency and a wavelength width of half the diffraction efficiency. The light is diffracted (reflected).
- the peak wavelength of diffraction efficiency is the wavelength at which the diffraction efficiency reaches a peak
- the wavelength width at half maximum of the diffraction efficiency is the wavelength width at which the diffraction efficiency is at half maximum of the diffraction efficiency peak. is there.
- the reflection-type hologram optical element 104h has high wavelength selectivity, and only diffracts and reflects light having a wavelength in the above-mentioned wavelength range (near the exposure wavelength).
- the hologram optical element 104h is transmitted, and a high external light transmittance can be realized.
- the light emitted from the light source 104a is diffused by the unidirectional diffusion plate 104b, condensed by the condenser lens 104c, and enters the display element 104d.
- the light incident on the display element 104d is modulated for each pixel based on the image data input from the display image / display luminance control unit 121a as a display control device, and is emitted as image light. As a result, a color image is displayed on the display element 104d.
- Image light from the display element 104d enters the eyepiece prism 104f from its base end face PL1, is totally reflected a plurality of times by the inner side face PL2 and the outer side face PL3, and enters the hologram optical element 104h.
- the light incident on the hologram optical element 104h is reflected there, passes through the inner side surface PL2, and reaches the pupil B '.
- the user can observe an enlarged virtual image of the image displayed on the display element 104d and can visually recognize it as a screen formed on the image display unit 104B.
- the hologram optical element 104h constitutes a screen, or it can be considered that a screen is formed on the inner surface PL2.
- “screen” may refer to an image to be displayed.
- the eyepiece prism 104f, the deflecting prism 104g, and the hologram optical element 104h transmit almost all of the external light, the user can observe an external field image (real image) through them. Therefore, the virtual image of the image displayed on the display element 104d is observed so as to overlap with a part of the external image. In this manner, the user of the HMD 100 can simultaneously observe the image provided from the display element 104d and the external image via the hologram optical element 104h. Note that when the display unit 104 is in the non-display state, the image display unit 104B is transparent, and only the external image can be observed.
- a display unit is configured by combining a light source, a liquid crystal display element, and an optical system.
- a self-luminous display element for example, an organic EL display
- Element for example, an organic EL display
- a transmissive organic EL display panel having transparency in a non-light emitting state may be used.
- the right sub-body portion 107 is attached to the right side portion 101b of the frame 101
- the left sub-body portion 108 is attached to the left side portion 101c of the frame 101.
- the right sub-main body portion 107 and the left sub-main body portion 108 have an elongated plate shape, and have elongated protrusions 107a and 108a on the inner side, respectively.
- the right sub-body portion 107 is attached to the frame 101 in a positioned state
- the elongated protrusion 108 a is attached to the side of the frame 101.
- the left sub-main body portion 108 is attached to the frame 101 in a positioned state.
- a temperature sensor 114 and a geomagnetic sensor 109 for detecting geomagnetism see FIG. 6 to be described later
- a gyro and acceleration sensor 110A for generating an output corresponding to the posture (see FIG. 6 to be described later).
- a speaker / earphone 111 ⁇ / b> C and a microphone 111 ⁇ / b> B are provided in the left sub-main body 108.
- the main body 103 is provided with an illuminance sensor 112 (see FIG. 6 described later).
- the main main body 103 and the right sub main body 107 are connected so as to be able to transmit signals through a wiring HS, and the main main body 103 and the left sub main body 108 are connected so as to be able to transmit signals through a wiring (not shown). Yes.
- the right sub-main body 107 is connected to the control unit CTU via a cord CD extending from the rear end.
- a 6-axis sensor in which an angular velocity sensor and an acceleration sensor are integrated may be used.
- the HMD can be operated by sound based on an output signal generated from the microphone 111B according to the input sound.
- the main main body 103 and the left sub main body 108 may be configured to be wirelessly connected.
- the camera 106 provided in the main body 103 serves also as a luminance distribution detection sensor.
- the camera 106 as the luminance distribution detection sensor preferably has its optical axis facing the line of sight of the user US, and is preferably provided near the eyes of the user US.
- a luminance distribution detection sensor separate from the camera may be provided.
- FIG. 5 is a block diagram of main circuits of the HMD 100.
- the control unit CTU generates a control signal for the display unit 104 and other functional devices, a control processing unit 121, an operation unit 122, a GPS receiving unit 123 that receives radio waves from GPS satellites, and external and data.
- a communication unit 124 that exchanges information, a storage unit 129 that stores a program, image data, and the like, and a power supply circuit 130 that converts a voltage applied from the battery 127 into an appropriate voltage for each unit.
- the control processing unit 121 having the display image / display luminance control unit 121a and the luminance distribution data detection processing unit 121b can use an application processor used in a smartphone or the like, but the type of the control processing unit 121 is not limited. . For example, if an application processor includes hardware necessary for image processing such as GPU or Codec as a standard, it can be said that the processor is suitable for a small HMD.
- the control processing unit 121 receives the signal. For example, when the user US moves his / her hand or finger in front of his / her eyes, the proximity sensor 105 outputs a signal accordingly. Therefore, so-called gesture detection can be performed using the output signal.
- the control processing unit 121 receives power from the power supply circuit 130, operates in accordance with a program stored in the storage unit 129, and inputs image data from the camera 106 in accordance with an operation input such as power-on from the operation unit 122.
- the data can be stored in the storage unit 129 and communicated with the outside via the communication unit 124 as necessary.
- the control processing unit 121 executes control according to the output from the proximity sensor 105, the user can perform screen control of the HMD 100 or execute an application by a gesture operation using a hand or a finger. it can. Examples of screen control include page turning, scrolling, selection, and determination.
- FIG. 6 is a front view when the user US wears the HMD 100 of the present embodiment.
- the range indicated by the alternate long and short dash line is the display area DP for displaying an image
- the range indicated by the dotted line is the detection area DT that can be detected by the camera 106.
- the display area DP and the detection area DT overlap.
- control processing unit 121 divides the display area DP into seven rows and nine columns at equal intervals, and assigns numbers in ascending order from the upper left to the right.
- FIG. 7 schematically shows such a display area DP, but the ruled lines and area numbers of the display area DP are shown for easy understanding and are actually visually recognized by the user US. is not.
- the brightness distribution data detection processing unit 121b can acquire the brightness of the outside world corresponding to the divided areas.
- FIG. 8A is a diagram illustrating an external scene viewed by the user US via the display area DP
- FIG. 8B is an example of an image IMG displayed on the display area DP by the image forming unit 104A.
- FIG. FIG. 9 is a diagram illustrating a state in which FIGS. 8A and 8B are overlapped, that is, the image IMG displayed by the image forming unit 104A is visually recognized by the right eye EY of the user US together with the scenery of the outside world. Indicates the state.
- control processing unit 121 performs the following processing.
- the luminance distribution data detection processing unit 121b of the control processing unit 121 receives the image signal from the camera 106 and detects the luminance distribution data.
- the luminance value can be obtained corresponding to each area.
- an adjustment area for adjusting the luminance is defined, the luminance value can be obtained within that area. It ’s fine.
- the luminance distribution data detection processing unit 121b only needs to obtain the maximum luminance value and the minimum luminance value by processing the image signal from the camera 106.
- the camera 106 and the luminance distribution data detection processing unit 121b constitute a luminance sensor.
- FIG. 10 is a diagram in which the image IMG displayed by the image forming unit 104A and the scenery of the outside world are superimposed on the divided area of the display area DP.
- FIG. 11 is a diagram showing the brightness of the outside world on the vertical axis and the position of the outside world on the horizontal axis in the range (division areas 37 to 45) through which the XX line of FIG. 10 passes.
- the divided areas 37 to 45 are selected as the adjustment areas for adjusting the luminance, and the maximum luminance value and the minimum luminance value are set for each divided area based on the pixel value of the image sensor of the camera 106. Looking for.
- the minimum luminance distribution and the maximum luminance distribution of the outside world in the range of the divided regions 37 to 45 are shown by graphs.
- the display image / display brightness control unit 121a ⁇ ⁇ (B + C) / (A + C) ⁇ 0.9 (3)
- the luminance of the image displayed in the divided areas 37 to 45 is set to C (cd / m 2 ) so as to satisfy the condition, and an adjustment signal is transmitted to the image forming unit 104A.
- the image forming unit 104A emits image light whose display luminance is adjusted, for example, by changing the light emission intensity of the backlight LED.
- the display image / display brightness control unit 121a may include a calculation circuit for calculation.
- C 350 (cd / m 2 ).
- the above is an example in which common luminance adjustment is performed for each row.
- the present invention is not limited to this, and common luminance adjustment may be performed for each column.
- the minimum luminance value and the maximum luminance value are obtained in each divided area, and further, the minimum luminance value and the maximum luminance value in the entire display area DP are obtained, and the expression (3) is obtained.
- adjustment may be performed using the obtained value C as a uniform common value in all divided regions.
- step S101 the luminance distribution data detection processing unit 121b inputs an image signal from the camera 106 as a luminance distribution detection sensor, and corresponds to the divided areas 1 to 63 in the external environment. The brightness distribution data of is detected.
- step S102, N 1, and in step S103, the display image / display luminance control unit 121a determines whether or not the maximum luminance value A of the divided region N is 500 (cd / m 2 ) or less.
- the display image can be clearly distinguished from the scenery of the outside world regardless of the display luminance, and the process proceeds to step S106.
- the display image / display brightness control unit 121a does not adjust the brightness of the divided region N, that is, uses a reference brightness value.
- the process proceeds to step S104, and the display image / display luminance control unit 121a is the minimum area (minimum). It is determined whether (luminance value B) / (maximum luminance value A) is 0.7 or more. If (minimum luminance value B) / (maximum luminance value A) is determined to be less than 0.7 in the divided area N, the display image can be clearly distinguished from the scenery of the outside world regardless of the display luminance.
- the display image / display brightness control unit 121a does not adjust the brightness of the divided area N, that is, uses the reference brightness value.
- the display image / display luminance control unit 121a determines that 0.7 or more in step S105.
- the display luminance C is set so as to satisfy ⁇ (B + C) / (A + C) ⁇ 0.9.
- the user US may arbitrarily specify a divided area for brightness adjustment in the display area DP using the operation unit 122 or the like.
- the divided areas 24, 25, 33, 34, 42, and 43 indicated by hatching are designated as the first adjustment area for performing the brightness adjustment, and the second adjustment area for performing the brightness adjustment is designated.
- the divided areas 29 to 32 and 38 to 41 indicated by different hatching are designated.
- the divided areas to be specified need not be continuous, and discontinuous divided areas may be designated by numbers.
- the number of divisions of the display area DP is not limited to 63, and may be smaller or larger. Further, when there is an extremely high luminance division region or an extremely low luminance division region in the designated division region, the luminance adjustment of the division region may not be performed.
- the present invention is not limited to the embodiments described in the specification, and other embodiments and modifications are included for those skilled in the art from the embodiments and technical ideas described in the present specification. it is obvious.
- the description and the embodiments are for illustrative purposes only, and the scope of the present invention is indicated by the following claims.
- the present invention has been described by taking the HMD as an example.
- the present invention is not limited to the HMD, and the present invention is not limited to an HUD for an airplane or a vehicle, and an electronic device such as an advertising panel attached to glass. It is applicable to.
- the information displayed on the transmissive display may be a menu that can be selected by a gesture operation.
- HMD Head Mount Display
- Frame 101a Front part 101b Side part 101c Side part 101d Long hole 101e Long hole 102 Eyeglass lens 103 Main body part 104
- Display unit 104A Image forming part 104B Image display part 104DR Display control part 104a Light source 104b Unidirectional diffuser 104c Condensing lens 104d Display element 104f Eyepiece prism 104g Deflection prism 104h Hologram optical element 105 Proximity sensor 106 Camera 107 Right sub body 107a Protrusion 108 Left sub body 108a Protrusion 109 Geomagnetic sensor 110A Gyro & acceleration sensor 111B Microphone 111C Speaker / Earphone 112 Illuminance sensor 114 Temperature sensor 121 Control processing unit 121a Display image / display luminance control unit 121b luminance distribution data detection processing unit 122 operation unit 123 GPS reception unit 124 communication unit 127 battery 129 storage unit 130 power supply circuit B ′ pupil CD code CTU control unit DP display area DT detection area EY
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Optics & Photonics (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
Provided are an electronic apparatus and a display device provided with a transmission-type display whereby an external environment and a display image can be clearly distinguished and recognized even when the luminance or contrast of the external environment is reduced. A display control device in the display device according to the present invention adjusts the luminance of an image displayed in the transmission-type display so that when A ≤ 500 (1) and B/A ≥ α (2) (where α is an arbitrary value) are satisfied, A (cd/m2) being the maximum luminance of the external environment and B (cd/m2) being the minimum luminance of the external environment detected by a luminance sensor, the expression α < (B + C)/(A + C) ≤ 0.9 (3) is satisfied, C (cd/m2 being the luminance of the image displayed in the transmission-type display.
Description
本発明は,透過型ディスプレイを備えた表示装置及び電子機器に関する。
The present invention relates to a display device and an electronic apparatus provided with a transmissive display.
ウェラブル端末の一種であるヘッドマウントディスプレイ(以下、HMDという)や、車載用のヘッドアップディスプレイ(以下、HUDという)は、観察者が透過型ディスプレイを通して外界を観察できると同時に、かかる透過型ディスプレイに表示された情報画像を視認することが出来る。従って、観察者は透過型ディスプレイから目を離すことなく、或いは視線移動を殆ど伴うことなく必要な情報を得ることができるので、表示された情報と共に外界の観察を続けたい観察者にとっては有用である。
Head mounted display (hereinafter referred to as HMD), which is a type of wearable terminal, and in-vehicle head-up display (hereinafter referred to as HUD) allow an observer to observe the outside world through a transmissive display, and at the same time, to such a transmissive display. The displayed information image can be visually recognized. Therefore, the observer can obtain necessary information without taking his eyes off the transmissive display or with little eye movement, which is useful for an observer who wants to continue observation of the outside world with the displayed information. is there.
ところで、早朝や夕暮れ時或いは雨天時などでは、外界の景色は輝度が低く且つコントラストも低くなることで濃淡差が少なくなるが、このような外界の景色を、透過型ディスプレイを介して表示画像と共に観察したときに、輝度を調整しない表示光が重なることで明瞭に識別できなくなる恐れがある。
By the way, in the early morning, dusk, or rainy weather, the outside scene is low in brightness and contrast, and the contrast is reduced. However, such an outside scene is displayed together with the display image through the transmissive display. When observed, there is a possibility that display light that does not adjust the brightness overlaps and cannot be clearly identified.
ここで、特許文献1には、外界光の強度を検出する外光センサーを有し、外光センサーの出力に基づいて、光学素子の透過率を変化させる虚像表示装置が開示されている。特許文献1の技術によれば、外界の明るさの変化に応じて調整された映像を観察することができる。
Here, Patent Document 1 discloses a virtual image display device that has an external light sensor that detects the intensity of external light and changes the transmittance of the optical element based on the output of the external light sensor. According to the technique of Patent Document 1, it is possible to observe an image adjusted according to a change in the brightness of the outside world.
しかしながら特許文献1の技術は、外光センサーからの検出信号に基づいて調光板の透過率を調整して外界光を適宜遮光することにより、画像形成装置によって形成された虚像のコントラストの低下や見づらさ等を防止するものである。従って、外界の輝度やコントラストが低下した場合、特許文献1の技術では対応できないこととなる。
However, the technique of Patent Document 1 adjusts the transmittance of the light control plate based on the detection signal from the external light sensor to appropriately shield external light, thereby reducing the contrast of the virtual image formed by the image forming apparatus. This is to prevent difficulty in seeing. Therefore, when the brightness and contrast of the outside world are reduced, the technique of Patent Document 1 cannot cope with it.
一方、特許文献2には、照度検出手段によって検出する外界の照度が明るい側ほど、輝度レベル間の輝度の間隔が広く、また外界の照度が暗い側ほど、輝度レベル間の輝度の間隔が狭くなるように、かつ同一の輝度レベルにおいて外界照度に対する光源の輝度の割合が常に一定になるように、各輝度レベルに対してバックライトの輝度を夫々決定する技術が開示されている。
On the other hand, in Patent Document 2, the brighter the external illuminance detected by the illuminance detection means, the wider the luminance interval between the luminance levels, and the darker the external illuminance is, the narrower the luminance interval between the luminance levels. In addition, a technique is disclosed in which the luminance of the backlight is determined for each luminance level so that the ratio of the luminance of the light source to the external illuminance is always constant at the same luminance level.
特許文献2の技術によれば、外界の照度が暗い側ほど、輝度レベル間の輝度の間隔が狭くなるようにバックライトの輝度を決定することができる。しかしながら、外界のコントラストが低下した場合には、特許文献2の技術では対応できず問題が残る。
According to the technique of Patent Document 2, the luminance of the backlight can be determined so that the luminance interval between luminance levels becomes narrower as the illuminance of the outside world becomes darker. However, when the contrast of the outside world is lowered, the technique of Patent Document 2 cannot cope with the problem and remains a problem.
本発明は、上記の事情に鑑みてなされたものであって、外界の輝度やコントラストが低下した場合にも、外界と表示画像とを明瞭に識別して視認することができる透過型ディスプレイを備えた表示装置及び電子機器を提供することを目的とする。
The present invention has been made in view of the above circumstances, and includes a transmissive display that can clearly identify and visually recognize the outside world and a display image even when the brightness and contrast of the outside world are reduced. It is an object to provide a display device and an electronic device.
上述した目的のうち少なくとも一つを実現するために、本発明の一側面を反映した表示装置は、
画像を表示可能であって、表示された画像と共に外界を観察者が視認できる透過型ディスプレイと、
前記透過型ディスプレイに画像を表示するための表示制御装置と、
前記観察者が前記透過型ディスプレイを通して視認する外界の輝度を検出する輝度センサと、を有し、
前記表示制御装置は、前記輝度センサが検出した前記外界の最大輝度をA(cd/m2)、前記外界の最小輝度をB(cd/m2)としたときに、
A≦500 (1)
B/A≧α (2)
(但し、αは任意の値)
を満たすときは、前記透過型ディスプレイに表示する画像の輝度をC(cd/m2)としたときに、
α<(B+C)/(A+C)≦0.9 (3)
を満たすように、前記透過型ディスプレイに表示する画像の輝度を調整するものである。 In order to achieve at least one of the above-described objects, a display device reflecting one aspect of the present invention is provided.
A transmissive display capable of displaying an image and allowing an observer to visually recognize the outside world together with the displayed image;
A display control device for displaying an image on the transmissive display;
A brightness sensor that detects the brightness of the outside world that the viewer visually recognizes through the transmissive display,
When the maximum brightness of the external environment detected by the brightness sensor is A (cd / m 2 ) and the minimum brightness of the external environment is B (cd / m 2 ),
A ≦ 500 (1)
B / A ≧ α (2)
(However, α is an arbitrary value)
When the brightness of the image displayed on the transmissive display is C (cd / m 2 ),
α <(B + C) / (A + C) ≦ 0.9 (3)
The brightness of the image displayed on the transmissive display is adjusted so as to satisfy the above condition.
画像を表示可能であって、表示された画像と共に外界を観察者が視認できる透過型ディスプレイと、
前記透過型ディスプレイに画像を表示するための表示制御装置と、
前記観察者が前記透過型ディスプレイを通して視認する外界の輝度を検出する輝度センサと、を有し、
前記表示制御装置は、前記輝度センサが検出した前記外界の最大輝度をA(cd/m2)、前記外界の最小輝度をB(cd/m2)としたときに、
A≦500 (1)
B/A≧α (2)
(但し、αは任意の値)
を満たすときは、前記透過型ディスプレイに表示する画像の輝度をC(cd/m2)としたときに、
α<(B+C)/(A+C)≦0.9 (3)
を満たすように、前記透過型ディスプレイに表示する画像の輝度を調整するものである。 In order to achieve at least one of the above-described objects, a display device reflecting one aspect of the present invention is provided.
A transmissive display capable of displaying an image and allowing an observer to visually recognize the outside world together with the displayed image;
A display control device for displaying an image on the transmissive display;
A brightness sensor that detects the brightness of the outside world that the viewer visually recognizes through the transmissive display,
When the maximum brightness of the external environment detected by the brightness sensor is A (cd / m 2 ) and the minimum brightness of the external environment is B (cd / m 2 ),
A ≦ 500 (1)
B / A ≧ α (2)
(However, α is an arbitrary value)
When the brightness of the image displayed on the transmissive display is C (cd / m 2 ),
α <(B + C) / (A + C) ≦ 0.9 (3)
The brightness of the image displayed on the transmissive display is adjusted so as to satisfy the above condition.
本発明によれば、外界の輝度やコントラストが低下した場合にも、外界と表示画像とを明瞭に識別して視認することができる透過型ディスプレイを備えた表示装置及び電子機器を提供することができる。
According to the present invention, it is possible to provide a display device and an electronic apparatus including a transmissive display that can clearly identify and visually recognize the outside world and a display image even when the brightness and contrast of the outside world are reduced. it can.
以下に、本発明の実施形態を、図面を参照して説明する。図1は、本実施形態にかかる、電子機器であるヘッドマウントディスプレイ100の斜視図である。図2は、本実施形態にかかるHMD100を正面から見た図である。図3は、本実施形態にかかるHMD100を上方から見た図である。以下、HMD100の右側及左側とは、HMD100を装着したユーザー(観察者)にとっての右側及び左側をいうものとする。
Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a perspective view of a head mounted display 100 that is an electronic apparatus according to the present embodiment. FIG. 2 is a front view of the HMD 100 according to the present embodiment. FIG. 3 is a view of the HMD 100 according to the present embodiment as viewed from above. Hereinafter, the right side and the left side of the HMD 100 refer to the right side and the left side for the user (observer) wearing the HMD 100.
図1~3に示すように、本実施形態のHMD100は,支持部材であるフレーム101を有している。上方から見てコ字状であるフレーム101は、2つの眼鏡レンズ102を取り付ける前方部101aと、前方部101aの両端から後方へと延在する側部101b、101cとを有する。フレーム101に取り付けられた2つの眼鏡レンズ102は屈折力を有していてもよいし、有していなくてもよい。
As shown in FIGS. 1 to 3, the HMD 100 of this embodiment has a frame 101 as a support member. A frame 101 that is U-shaped when viewed from above has a front part 101a to which two spectacle lenses 102 are attached, and side parts 101b and 101c extending rearward from both ends of the front part 101a. The two spectacle lenses 102 attached to the frame 101 may or may not have refractive power.
右側(ユーザーの利き目などに応じて左側でもよい)の眼鏡レンズ102の上部において、支持部材である円筒状の主本体部103がフレーム101の前方部101aに固定されている。主本体部103にはディスプレイユニット104が設けられている。主本体部103内には、後述する制御処理部121からの指示に基づいてディスプレイユニット104の表示制御を司る表示画像/表示輝度制御部121a(後述する図6を参照)が配置されている。なお、必要であれば両眼の前にそれぞれディスプレイユニットを配置してもよい。
A cylindrical main body 103 as a support member is fixed to the front portion 101a of the frame 101 on the upper side of the spectacle lens 102 on the right side (which may be on the left side depending on the user's dominant eye). The main body 103 is provided with a display unit 104. In the main body 103, a display image / display luminance control unit 121a (see FIG. 6 described later) that controls display of the display unit 104 based on an instruction from the control processing unit 121 described later is disposed. If necessary, a display unit may be arranged in front of both eyes.
図4は、ディスプレイユニット104の構成を示す概略断面図である。表示装置であるディスプレイユニット104は、画像形成部104Aと画像表示部104Bとからなる。画像形成部104Aは、主本体部103内に組み込まれており、光源104aと、一方向拡散板104bと、集光レンズ104cと、表示素子104dとを有している。一方、いわゆるシースルー型の表示部材(透過型ディスプレイ)である画像表示部104Bは、主本体部103から下方に向かい、片方の眼鏡レンズ102(図1参照)に平行に延在するように配置された全体的に板状であって、接眼プリズム104fと、偏向プリズム104gと、ホログラム光学素子104hとを有している。
FIG. 4 is a schematic cross-sectional view showing the configuration of the display unit 104. The display unit 104 as a display device includes an image forming unit 104A and an image display unit 104B. The image forming unit 104A is incorporated in the main body unit 103, and includes a light source 104a, a unidirectional diffuser 104b, a condenser lens 104c, and a display element 104d. On the other hand, the image display unit 104B, which is a so-called see-through type display member (transmission type display), is arranged so as to extend downward from the main body unit 103 and in parallel with one eyeglass lens 102 (see FIG. 1). Further, it is generally plate-shaped and has an eyepiece prism 104f, a deflection prism 104g, and a hologram optical element 104h.
光源104aは、表示素子104dを照明する機能を有し、例えば光強度のピーク波長及び光強度半値の波長幅で462±12nm(B光)、525±17nm(G光)、635±11nm(R光)となる3つの波長帯域の光を発するRGB一体型のLEDで構成されている。このように光源104aが所定の波長幅の光を出射することにより、表示素子104dを照明して得られる画像光に所定の波長幅を持たせることができ、ホログラム光学素子104hにて画像光を回折させたときに、瞳孔B’の位置にて観察画角全域にわたってユーザーに画像を観察させることができる。また、光源104aの各色についてのピーク波長は、ホログラム光学素子104hの回折効率のピーク波長の近傍に設定されており、光利用効率の向上がはかられている。
The light source 104a has a function of illuminating the display element 104d. For example, 462 ± 12 nm (B light), 525 ± 17 nm (G light), 635 ± 11 nm (R It is composed of RGB-integrated LEDs that emit light in three wavelength bands. Thus, the light source 104a emits light having a predetermined wavelength width, whereby the image light obtained by illuminating the display element 104d can have a predetermined wavelength width, and the hologram optical element 104h transmits the image light. When diffracted, the user can observe an image over the entire observation angle of view at the position of the pupil B ′. Further, the peak wavelength for each color of the light source 104a is set in the vicinity of the peak wavelength of the diffraction efficiency of the hologram optical element 104h, so that the light use efficiency is improved.
また、光源104aは、RGBの光を出射するLEDで構成されているので、光源104aのコストを抑えることができるとともに、表示素子104dを照明したときに、表示素子104dにてカラー画像を表示することが可能となり、そのカラー画像をユーザーが視認可能とすることができる。また、RGBの各LED素子は発光波長幅が狭いので、そのようなLED素子を複数用いることにより、色再現性が高く、明るい画像表示が可能となる。
Further, since the light source 104a is composed of LEDs that emit RGB light, the cost of the light source 104a can be reduced, and a color image is displayed on the display element 104d when the display element 104d is illuminated. The color image can be visually recognized by the user. In addition, since each of the RGB LED elements has a narrow emission wavelength width, the use of a plurality of such LED elements enables high color reproducibility and bright image display.
表示素子104dは、光源104aからの出射光を画像データに応じて変調して画像を表示するものであり、光が透過する領域となる各画素をマトリクス状に有する透過型の液晶表示素子で構成されている。なお、表示素子104dは、反射型であってもよい。
The display element 104d displays an image by modulating the light emitted from the light source 104a in accordance with image data, and is configured by a transmissive liquid crystal display element having pixels that serve as light transmitting regions in a matrix. Has been. Note that the display element 104d may be of a reflective type.
接眼プリズム104fは、基端面PL1を介して入射する表示素子104dからの画像光を、相対する平行な内側面PL2と外側面PL3とで全反射させ、ホログラム光学素子104hを介してユーザーの瞳に導く一方、外光を透過させてユーザーの瞳に導くものであり、偏向プリズム104gとともに、例えばアクリル系樹脂で構成されている。この接眼プリズム104fと偏向プリズム104gとは、内側面PL2及び外側面PL3に対して傾斜した傾斜面PL4、PL5でホログラム光学素子104hを挟み、接着剤で接合されている。
The eyepiece prism 104f totally reflects the image light from the display element 104d incident through the base end face PL1 by the opposed parallel inner side face PL2 and outer side face PL3, and passes through the hologram optical element 104h to the user's pupil. On the other hand, external light is transmitted and guided to the user's pupil, and is composed of, for example, an acrylic resin together with the deflecting prism 104g. The eyepiece prism 104f and the deflection prism 104g are joined by an adhesive with the hologram optical element 104h sandwiched between inclined surfaces PL4 and PL5 inclined with respect to the inner surface PL2 and the outer surface PL3.
偏向プリズム104gは、接眼プリズム104fに接合されて、接眼プリズム104fと一体となって略平行平板となるものである。この偏向プリズム104gを接眼プリズム104fに接合することにより,ユーザーがディスプレイユニット104を介して観察する外界像に歪みが生じるのを防止することができる。
The deflection prism 104g is joined to the eyepiece prism 104f, and becomes a substantially parallel flat plate integrated with the eyepiece prism 104f. By joining the deflecting prism 104g to the eyepiece prism 104f, it is possible to prevent distortion in the external image observed by the user through the display unit 104.
すなわち、例えば、接眼プリズム104fに偏向プリズム104gを接合させない場合、外光は接眼プリズム104fの傾斜面PL4を透過するときに屈折するので、接眼プリズム104fを介して観察される外界像に歪みが生じる。しかし、接眼プリズム104fに相補的な傾斜面PL5を有する偏向プリズム104gを接合させて一体的な略平行平板を形成することで、外光が傾斜面PL4,PL5(ホログラム光学素子104h)を透過するときの屈折を偏向プリズム104gでキャンセルすることができる。その結果、シースルーで観察される外界像に歪みが生じるのを防止することができる。なお、ディスプレイユニット104とユーザーの瞳の間に眼鏡レンズ102(図1参照)を装着すると、通常眼鏡を使用しているユーザーでも問題なく画像を観察することが可能である。
That is, for example, when the deflecting prism 104g is not joined to the eyepiece prism 104f, external light is refracted when passing through the inclined surface PL4 of the eyepiece prism 104f, so that an external image observed through the eyepiece prism 104f is distorted. . However, by joining the deflecting prism 104g having the inclined surface PL5 complementary to the eyepiece prism 104f to form an integral substantially parallel plate, external light is transmitted through the inclined surfaces PL4 and PL5 (hologram optical element 104h). The refraction at that time can be canceled by the deflecting prism 104g. As a result, it is possible to prevent distortion in the external image observed through the see-through. In addition, if the spectacle lens 102 (refer FIG. 1) is mounted | worn between the display unit 104 and a user's pupil, it will be possible for the user who normally uses spectacles to observe an image without a problem.
ホログラム光学素子104hは、表示素子104dから出射される画像光(3原色に対応した波長の光)を回折反射して瞳孔B’に導き、表示素子104dに表示される画像を拡大してユーザーの瞳に虚像として導く体積位相型の反射型ホログラムである。このホログラム光学素子104hは、例えば、回折効率のピーク波長および回折効率半値の波長幅で465±5nm(B光)、521±5nm(G光)、634±5nm(R光)の3つの波長域の光を回折(反射)させるように作製されている。ここで、回折効率のピーク波長は、回折効率がピークとなるときの波長のことであり、回折効率半値の波長幅とは、回折効率が回折効率ピークの半値となるときの波長幅のことである。
The hologram optical element 104h diffracts and reflects the image light (light having a wavelength corresponding to the three primary colors) emitted from the display element 104d to guide it to the pupil B ′, and enlarges the image displayed on the display element 104d by the user. It is a volume phase type reflection hologram guided as a virtual image to the pupil. The hologram optical element 104h has, for example, three wavelength ranges of 465 ± 5 nm (B light), 521 ± 5 nm (G light), and 634 ± 5 nm (R light) with a peak wavelength of diffraction efficiency and a wavelength width of half the diffraction efficiency. The light is diffracted (reflected). Here, the peak wavelength of diffraction efficiency is the wavelength at which the diffraction efficiency reaches a peak, and the wavelength width at half maximum of the diffraction efficiency is the wavelength width at which the diffraction efficiency is at half maximum of the diffraction efficiency peak. is there.
反射型のホログラム光学素子104hは、高い波長選択性を有しており、上記波長域(露光波長近辺)の波長の光しか回折反射しないので、回折反射される波長以外の波長を含む外光はホログラム光学素子104hを透過することになり、高い外光透過率を実現することができる。
The reflection-type hologram optical element 104h has high wavelength selectivity, and only diffracts and reflects light having a wavelength in the above-mentioned wavelength range (near the exposure wavelength). The hologram optical element 104h is transmitted, and a high external light transmittance can be realized.
次に、ディスプレイユニット104の動作について説明する。光源104aから出射された光は、一方向拡散板104bにて拡散され、集光レンズ104cにて集光されて表示素子104dに入射する。表示素子104dに入射した光は、表示制御装置としての表示画像/表示輝度制御部121aから入力された画像データに基づいて画素ごとに変調され、画像光として出射される。これにより、表示素子104dにはカラー画像が表示される。
Next, the operation of the display unit 104 will be described. The light emitted from the light source 104a is diffused by the unidirectional diffusion plate 104b, condensed by the condenser lens 104c, and enters the display element 104d. The light incident on the display element 104d is modulated for each pixel based on the image data input from the display image / display luminance control unit 121a as a display control device, and is emitted as image light. As a result, a color image is displayed on the display element 104d.
表示素子104dからの画像光は、接眼プリズム104fの内部にその基端面PL1から入射し、内側面PL2と外側面PL3で複数回全反射されて、ホログラム光学素子104hに入射する。ホログラム光学素子104hに入射した光は、そこで反射され、内側面PL2を透過して瞳孔B’に達する。瞳孔B’の位置では、ユーザーは、表示素子104dに表示された画像の拡大虚像を観察することができ、画像表示部104Bに形成される画面として視認することができる。この場合、ホログラム光学素子104hが画面を構成しているとみることもできるし、内側面PL2に画面が形成されているとみることもできる。なお、本明細書において「画面」というときは、表示される画像を指すこともある。
Image light from the display element 104d enters the eyepiece prism 104f from its base end face PL1, is totally reflected a plurality of times by the inner side face PL2 and the outer side face PL3, and enters the hologram optical element 104h. The light incident on the hologram optical element 104h is reflected there, passes through the inner side surface PL2, and reaches the pupil B '. At the position of the pupil B ', the user can observe an enlarged virtual image of the image displayed on the display element 104d and can visually recognize it as a screen formed on the image display unit 104B. In this case, it can be considered that the hologram optical element 104h constitutes a screen, or it can be considered that a screen is formed on the inner surface PL2. In the present specification, “screen” may refer to an image to be displayed.
一方、接眼プリズム104f、偏向プリズム104gおよびホログラム光学素子104hは、外光をほとんど全て透過させるので、ユーザーはこれらを介して外界像(実像)を観察することができる。したがって、表示素子104dに表示された画像の虚像は、外界像の一部に重なって観察されることになる。このようにして、HMD100のユーザーは、ホログラム光学素子104hを介して、表示素子104dから提供される画像と外界像とを同時に観察することができる。尚、ディスプレイユニット104が非表示状態のとき画像表示部104Bは素通しとなり、外界像のみを観察できる。なお、本例では、光源と液晶表示素子と光学系とを組み合わせて表示ユニットを構成しているが、光源と液晶表示素子の組合せに代えて、自発光型の表示素子(例えば、有機EL表示素子)を用いても良い。また、光源と液晶表示素子と光学系の組合せに代えて、非発光状態で透過性を有する透過型有機EL表示パネルを用いてもよい。いずれにしても、画像表示部104Bに対向するユーザーの眼の視野に入るように、好ましくは、有効視野に少なくとも一部が重なるように、画面を配置すると、ユーザーは画像を容易に視認することができる。
On the other hand, since the eyepiece prism 104f, the deflecting prism 104g, and the hologram optical element 104h transmit almost all of the external light, the user can observe an external field image (real image) through them. Therefore, the virtual image of the image displayed on the display element 104d is observed so as to overlap with a part of the external image. In this manner, the user of the HMD 100 can simultaneously observe the image provided from the display element 104d and the external image via the hologram optical element 104h. Note that when the display unit 104 is in the non-display state, the image display unit 104B is transparent, and only the external image can be observed. In this example, a display unit is configured by combining a light source, a liquid crystal display element, and an optical system. However, instead of a combination of a light source and a liquid crystal display element, a self-luminous display element (for example, an organic EL display) is used. Element) may be used. Further, instead of a combination of a light source, a liquid crystal display element, and an optical system, a transmissive organic EL display panel having transparency in a non-light emitting state may be used. In any case, when the screen is arranged so as to fall within the visual field of the user's eye facing the image display unit 104B, and preferably at least partially overlaps the effective visual field, the user can easily visually recognize the image. Can do.
図1、2において、フレーム101の右側の側部101bには、右副本体部107が取り付けられ、フレーム101の左側の側部101cには、左副本体部108が取り付けられている。右副本体部107及び左副本体部108は、細長い板形状を有しており、それぞれ内側に細長い突起107a,108aを有している。この細長い突起107aを、フレーム101の側部101bの長孔101dに係合させることで、右副本体部107が位置決めされた状態でフレーム101に取り付けられ、また細長い突起108aを、フレーム101の側部101cの長孔101eに係合させることで、左副本体部108が位置決めされた状態でフレーム101に取り付けられている。
1 and 2, the right sub-body portion 107 is attached to the right side portion 101b of the frame 101, and the left sub-body portion 108 is attached to the left side portion 101c of the frame 101. The right sub-main body portion 107 and the left sub-main body portion 108 have an elongated plate shape, and have elongated protrusions 107a and 108a on the inner side, respectively. By engaging the elongated protrusion 107 a with the elongated hole 101 d of the side portion 101 b of the frame 101, the right sub-body portion 107 is attached to the frame 101 in a positioned state, and the elongated protrusion 108 a is attached to the side of the frame 101. By engaging with the long hole 101e of the portion 101c, the left sub-main body portion 108 is attached to the frame 101 in a positioned state.
右副本体部107内には、温度センサ114及び地磁気を検出する地磁気センサ109(後述する図6参照)と、姿勢に応じた出力を生成する、ジャイロ及び加速度センサ110A(後述する図6参照)とが搭載されており、左副本体部108内には、スピーカー・イヤホン111C及びマイク111B(後述する図6参照)とが設けられている。主本体部103には照度センサ112(後述する図6参照)が設けられている。主本体部103と右副本体部107とは、配線HSで信号伝達可能に接続されており、主本体部103と左副本体部108とは、不図示の配線で信号伝達可能に接続されている。図3に簡略図示するように、右副本体部107は、その後端から延在するコードCDを介して制御ユニットCTUに接続されている。なお、角速度センサ及び加速度センサを一体化した6軸センサを用いてもよい。また、入力される音声に応じてマイク111Bから生成される出力信号に基づいて、音声によってHMDを操作することもできる。また、主本体部103と左副本体部108とが無線接続されるように構成してもよい。尚、本実施形態では、主本体部103に設けられたカメラ106が、輝度分布検出センサを兼ねるようになっている。輝度分布検出センサとしてのカメラ106は、その光軸がユーザーUSの視線方向に向いていることが好ましく、且つユーザーUSの目の近傍に設けられていることが好ましい。但し、カメラとは別個の輝度分布検出センサを設けても良い。
In the right sub-body 107, a temperature sensor 114 and a geomagnetic sensor 109 for detecting geomagnetism (see FIG. 6 to be described later), and a gyro and acceleration sensor 110A for generating an output corresponding to the posture (see FIG. 6 to be described later). And a speaker / earphone 111 </ b> C and a microphone 111 </ b> B (see FIG. 6 described later) are provided in the left sub-main body 108. The main body 103 is provided with an illuminance sensor 112 (see FIG. 6 described later). The main main body 103 and the right sub main body 107 are connected so as to be able to transmit signals through a wiring HS, and the main main body 103 and the left sub main body 108 are connected so as to be able to transmit signals through a wiring (not shown). Yes. As schematically illustrated in FIG. 3, the right sub-main body 107 is connected to the control unit CTU via a cord CD extending from the rear end. A 6-axis sensor in which an angular velocity sensor and an acceleration sensor are integrated may be used. Further, the HMD can be operated by sound based on an output signal generated from the microphone 111B according to the input sound. Further, the main main body 103 and the left sub main body 108 may be configured to be wirelessly connected. In the present embodiment, the camera 106 provided in the main body 103 serves also as a luminance distribution detection sensor. The camera 106 as the luminance distribution detection sensor preferably has its optical axis facing the line of sight of the user US, and is preferably provided near the eyes of the user US. However, a luminance distribution detection sensor separate from the camera may be provided.
図5は、HMD100の主要回路のブロック図である。制御ユニットCTUは、ディスプレイユニット104やその他の機能デバイスに対して制御信号を生成する、制御処理部121と、操作部122と、GPS衛星からの電波を受信するGPS受信部123と、外部とデータのやりとりを行う通信部124と、プログラム、画像データ等を保存する記憶部129と、バッテリー127から付与された電圧を各部に適正な電圧に変換するための電源回路130とを有している。表示画像/表示輝度制御部121a及び輝度分布データ検出処理部121bを有する制御処理部121は、スマートフォンなどで用いられているアプリケーションプロセッサーを使用することが出来るが、制御処理部121の種類は問わない。例えば、アプリケーションプロセッサーの内部にGPUやCodecなど画像処理に必要なハードウェアが標準で組み込まれているものは、小型のHMDには適したプロセッサーであるといえる。
FIG. 5 is a block diagram of main circuits of the HMD 100. The control unit CTU generates a control signal for the display unit 104 and other functional devices, a control processing unit 121, an operation unit 122, a GPS receiving unit 123 that receives radio waves from GPS satellites, and external and data. A communication unit 124 that exchanges information, a storage unit 129 that stores a program, image data, and the like, and a power supply circuit 130 that converts a voltage applied from the battery 127 into an appropriate voltage for each unit. The control processing unit 121 having the display image / display luminance control unit 121a and the luminance distribution data detection processing unit 121b can use an application processor used in a smartphone or the like, but the type of the control processing unit 121 is not limited. . For example, if an application processor includes hardware necessary for image processing such as GPU or Codec as a standard, it can be said that the processor is suitable for a small HMD.
更に、制御処理部121には、近接センサ105から人体から放射される検出光としての不可視光を検出したときは、その信号が入力される。例えばユーザーUSが眼前で手や指を動かしたときなど、それに応じて近接センサ105が信号を出力するので、出力された信号を利用して、いわゆるジェスチャー検出を行うことができる。
Furthermore, when invisible light as detection light emitted from the human body from the proximity sensor 105 is detected, the control processing unit 121 receives the signal. For example, when the user US moves his / her hand or finger in front of his / her eyes, the proximity sensor 105 outputs a signal accordingly. Therefore, so-called gesture detection can be performed using the output signal.
制御処理部121は、電源回路130からの給電を受け、記憶部129に格納されたプログラムに従って動作し、操作部122からの電源オンなどの操作入力に従い、カメラ106からの画像データを入力して記憶部129に記憶し、必要に応じて通信部124を介して外部と通信を行うことができる。更に、制御処理部121が近接センサ105からの出力に応じた制御を実行することで、ユーザーは手や指を用いたジェスチャー操作によってHMD100の画面制御を行ったり、アプリケーションを実行したりすることができる。画面制御の例としては、ページめくり、スクロール、選択、決定などがある。
The control processing unit 121 receives power from the power supply circuit 130, operates in accordance with a program stored in the storage unit 129, and inputs image data from the camera 106 in accordance with an operation input such as power-on from the operation unit 122. The data can be stored in the storage unit 129 and communicated with the outside via the communication unit 124 as necessary. Furthermore, when the control processing unit 121 executes control according to the output from the proximity sensor 105, the user can perform screen control of the HMD 100 or execute an application by a gesture operation using a hand or a finger. it can. Examples of screen control include page turning, scrolling, selection, and determination.
図6は、ユーザーUSが本実施形態のHMD100を装着したときの正面図である。ユーザーUSの右目EYの眼前に配置された画像表示部104B上において、一点鎖線で示す範囲が画像を表示する表示領域DPであり、点線で示す範囲がカメラ106で検出できる検出領域DTである。ユーザーUSの右目EYで見たときに、表示領域DPと検出領域DTとは重なっていることが望ましい。
FIG. 6 is a front view when the user US wears the HMD 100 of the present embodiment. On the image display unit 104B arranged in front of the right eye EY of the user US, the range indicated by the alternate long and short dash line is the display area DP for displaying an image, and the range indicated by the dotted line is the detection area DT that can be detected by the camera 106. When viewed with the right eye EY of the user US, it is desirable that the display area DP and the detection area DT overlap.
ここで、制御処理部121が、表示領域DPを等間隔に7行9列に分割して、左上から右へと番号を昇順に付してゆく。図7は、このような表示領域DPを模式的に示したものであるが、表示領域DPの罫線や領域番号は、理解しやすいように示したものであり、ユーザーUSが実際に視認するものではない。ここでは分割した領域に対応する外界の輝度を、輝度分布データ検出処理部121bがそれぞれ取得できるものとする。
Here, the control processing unit 121 divides the display area DP into seven rows and nine columns at equal intervals, and assigns numbers in ascending order from the upper left to the right. FIG. 7 schematically shows such a display area DP, but the ruled lines and area numbers of the display area DP are shown for easy understanding and are actually visually recognized by the user US. is not. Here, it is assumed that the brightness distribution data detection processing unit 121b can acquire the brightness of the outside world corresponding to the divided areas.
図8(a)は、表示領域DPを介してユーザーUSが視認する外界の景色を示す図であり、図8(b)は、画像形成部104Aにより表示領域DPに表示される画像IMGの一例を示す図である。図9は、図8(a)及び図8(b)を重ねた状態を示す図であり、すなわち画像形成部104Aにより表示された画像IMGを、外界の景色と共にユーザーUSの右目EYにより視認した状態を示している。
FIG. 8A is a diagram illustrating an external scene viewed by the user US via the display area DP, and FIG. 8B is an example of an image IMG displayed on the display area DP by the image forming unit 104A. FIG. FIG. 9 is a diagram illustrating a state in which FIGS. 8A and 8B are overlapped, that is, the image IMG displayed by the image forming unit 104A is visually recognized by the right eye EY of the user US together with the scenery of the outside world. Indicates the state.
ところで、外界の景色の輝度が低く且つコントラストも低い環境条件では、ユーザーUSが画像表示部104Bの表示領域DPを介して外界の景色を表示画像IMGと共に観察したときに、両者が重なることで外界の景色と表示画像IMGとが明瞭に識別できなくなる恐れがある。かかる場合、制御処理部121は以下のような処理を行う。
By the way, in an environmental condition where the brightness of the outside scene is low and the contrast is low, when the user US observes the outside scene together with the display image IMG via the display area DP of the image display unit 104B, the two scenes overlap each other. There is a risk that the scenery and the display image IMG cannot be clearly identified. In such a case, the control processing unit 121 performs the following processing.
具体的には、制御処理部121の輝度分布データ検出処理部121bは、カメラ106からの画像信号を入力して、輝度分布データを検出する。ここでは、表示領域DPが63分割されているので、各領域に対応して輝度値を求めることができるが、輝度を調整する調整領域が定められていれば、その領域内で輝度値を求めれば良い。尚、輝度分布データ検出処理部121bは、カメラ106からの画像信号を処理することで、最大輝度値、最小輝度値のみ求めれば足りる。カメラ106と輝度分布データ検出処理部121bとで、輝度センサを構成する。
Specifically, the luminance distribution data detection processing unit 121b of the control processing unit 121 receives the image signal from the camera 106 and detects the luminance distribution data. Here, since the display area DP is divided into 63 areas, the luminance value can be obtained corresponding to each area. However, if an adjustment area for adjusting the luminance is defined, the luminance value can be obtained within that area. It ’s fine. The luminance distribution data detection processing unit 121b only needs to obtain the maximum luminance value and the minimum luminance value by processing the image signal from the camera 106. The camera 106 and the luminance distribution data detection processing unit 121b constitute a luminance sensor.
図10は、表示領域DPの分割領域上において、画像形成部104Aにより表示された画像IMGと外界の景色とを重ねて示す図である。図11は、図10のX-X線が通過する範囲(分割領域37~45)において、縦軸に外界の輝度を取り、横軸に外界の位置をとって示す図である。尚、図11の例では、輝度を調整する調整領域として分割領域37~45を選択しており、カメラ106の撮像素子の画素値に基づいて、分割領域毎に最大輝度値と最小輝度値を求めている。
FIG. 10 is a diagram in which the image IMG displayed by the image forming unit 104A and the scenery of the outside world are superimposed on the divided area of the display area DP. FIG. 11 is a diagram showing the brightness of the outside world on the vertical axis and the position of the outside world on the horizontal axis in the range (division areas 37 to 45) through which the XX line of FIG. 10 passes. In the example of FIG. 11, the divided areas 37 to 45 are selected as the adjustment areas for adjusting the luminance, and the maximum luminance value and the minimum luminance value are set for each divided area based on the pixel value of the image sensor of the camera 106. Looking for.
ここで、検出した外界の最大輝度をA(cd/m2)、外界の最小輝度をB(cd/m2)としたときに、
A≦500 (1)
B/A≧α (2)
(但し、αは任意の値、好ましくはαは0.5を超え、1未満の任意の値,より好ましくはαは0.6を超え、0.9未満の任意の値)
を満たすときは、表示される画像IMGの輝度を調整するものとし、逆に(1)、(2)式のいずれかを満たしていないときは、表示される画像IMGの輝度を無調整とする。以下、具体例で示す。 Here, when the detected maximum brightness of the outside world is A (cd / m 2 ) and the minimum brightness of the outside world is B (cd / m 2 ),
A ≦ 500 (1)
B / A ≧ α (2)
(Where α is any value, preferably α is greater than 0.5 and less than 1, more preferably α is greater than 0.6 and less than 0.9)
When the condition is satisfied, the brightness of the displayed image IMG is adjusted. Conversely, when the expression (1) or (2) is not satisfied, the brightness of the displayed image IMG is not adjusted. . Specific examples will be shown below.
A≦500 (1)
B/A≧α (2)
(但し、αは任意の値、好ましくはαは0.5を超え、1未満の任意の値,より好ましくはαは0.6を超え、0.9未満の任意の値)
を満たすときは、表示される画像IMGの輝度を調整するものとし、逆に(1)、(2)式のいずれかを満たしていないときは、表示される画像IMGの輝度を無調整とする。以下、具体例で示す。 Here, when the detected maximum brightness of the outside world is A (cd / m 2 ) and the minimum brightness of the outside world is B (cd / m 2 ),
A ≦ 500 (1)
B / A ≧ α (2)
(Where α is any value, preferably α is greater than 0.5 and less than 1, more preferably α is greater than 0.6 and less than 0.9)
When the condition is satisfied, the brightness of the displayed image IMG is adjusted. Conversely, when the expression (1) or (2) is not satisfied, the brightness of the displayed image IMG is not adjusted. . Specific examples will be shown below.
図11において、分割領域37~45の範囲で、外界の最小輝度分布と最大輝度分布をグラフで示している。ここで、調整領域内における外界の最大輝度は分割領域43で生じ、その最大輝度値A=500(cd/m2)であり、一方、調整領域内における外界最小輝度は分割領域40で生じ、その最小輝度値B=350(cd/m2)であるとする。このとき、
A≦500 (1)
を満たした場合、外界の景色の輝度が低いので、表示画像/表示輝度制御部121aは表示画像が見えにくくなると判断する。本例では、A=500であるから、(1)式を満たすこととなる。 In FIG. 11, the minimum luminance distribution and the maximum luminance distribution of the outside world in the range of the dividedregions 37 to 45 are shown by graphs. Here, the maximum luminance of the external field in the adjustment region occurs in the divided region 43, and the maximum luminance value A = 500 (cd / m 2 ), while the minimum external luminance in the adjustment region occurs in the divided region 40, Assume that the minimum luminance value B = 350 (cd / m 2 ). At this time,
A ≦ 500 (1)
When the above condition is satisfied, the brightness of the scenery in the outside world is low, so that the display image / displaybrightness control unit 121a determines that the display image is difficult to see. In this example, since A = 500, the expression (1) is satisfied.
A≦500 (1)
を満たした場合、外界の景色の輝度が低いので、表示画像/表示輝度制御部121aは表示画像が見えにくくなると判断する。本例では、A=500であるから、(1)式を満たすこととなる。 In FIG. 11, the minimum luminance distribution and the maximum luminance distribution of the outside world in the range of the divided
A ≦ 500 (1)
When the above condition is satisfied, the brightness of the scenery in the outside world is low, so that the display image / display
但し、最大輝度値Aが相当に低い場合、外界の環境が夜間や遮光された屋内等であると考えられ、本来的に外界を視認することが困難になる。そこで、以下の(4)式を満たす場合に限り、輝度調整を実行することとしても良い。
20≦A (4)
本例では、A=500であるから(4)式を満たす。 However, when the maximum luminance value A is considerably low, it is considered that the environment of the outside world is at night or indoors where light is shielded, and it is inherently difficult to visually recognize the outside world. Therefore, the luminance adjustment may be executed only when the following expression (4) is satisfied.
20 ≦ A (4)
In this example, since A = 500, the expression (4) is satisfied.
20≦A (4)
本例では、A=500であるから(4)式を満たす。 However, when the maximum luminance value A is considerably low, it is considered that the environment of the outside world is at night or indoors where light is shielded, and it is inherently difficult to visually recognize the outside world. Therefore, the luminance adjustment may be executed only when the following expression (4) is satisfied.
20 ≦ A (4)
In this example, since A = 500, the expression (4) is satisfied.
更に、
B/A≧α (2)
を満たす場合、外界の景色のコントラストが低いので、表示画像/表示輝度制御部121aは表示画像が見えにくくなると判断できる。本例では、αとして例えば0.7を選択した場合、B/A=0.7となるので、(2)式を満たすこととなる。 Furthermore,
B / A ≧ α (2)
If the condition is satisfied, the contrast of the scenery in the outside world is low, so that the display image / displaybrightness control unit 121a can determine that the display image is difficult to see. In this example, when 0.7 is selected as α, for example, B / A = 0.7, which satisfies Expression (2).
B/A≧α (2)
を満たす場合、外界の景色のコントラストが低いので、表示画像/表示輝度制御部121aは表示画像が見えにくくなると判断できる。本例では、αとして例えば0.7を選択した場合、B/A=0.7となるので、(2)式を満たすこととなる。 Furthermore,
B / A ≧ α (2)
If the condition is satisfied, the contrast of the scenery in the outside world is low, so that the display image / display
以上の(1)、(2)式を満たした場合、表示画像/表示輝度制御部121aは、
α<(B+C)/(A+C)≦0.9 (3)
を満たすように、分割領域37~45に表示する画像の輝度をC(cd/m2)に設定し、画像形成部104Aに調整信号を送信する。これにより画像形成部104Aは,例えばバックライトLEDの発光強度を変更することにより、表示輝度を調整した画像光を出射するのである。表示画像/表示輝度制御部121aは、演算のための演算回路を有していても良い。 When the above expressions (1) and (2) are satisfied, the display image / displaybrightness control unit 121a
α <(B + C) / (A + C) ≦ 0.9 (3)
The luminance of the image displayed in the dividedareas 37 to 45 is set to C (cd / m 2 ) so as to satisfy the condition, and an adjustment signal is transmitted to the image forming unit 104A. Accordingly, the image forming unit 104A emits image light whose display luminance is adjusted, for example, by changing the light emission intensity of the backlight LED. The display image / display brightness control unit 121a may include a calculation circuit for calculation.
α<(B+C)/(A+C)≦0.9 (3)
を満たすように、分割領域37~45に表示する画像の輝度をC(cd/m2)に設定し、画像形成部104Aに調整信号を送信する。これにより画像形成部104Aは,例えばバックライトLEDの発光強度を変更することにより、表示輝度を調整した画像光を出射するのである。表示画像/表示輝度制御部121aは、演算のための演算回路を有していても良い。 When the above expressions (1) and (2) are satisfied, the display image / display
α <(B + C) / (A + C) ≦ 0.9 (3)
The luminance of the image displayed in the divided
仮に、(3)式の(B+C)/(A+C)が0.9を超えると、外界の景色に対して表示画像IMGの輝度が高すぎて、外界の景色が表示画像IMGに埋没して外界の景色を視認できなくなる恐れがある。一方、(B+C)/(A+C)がα=0.7以下であると、外界の景色に対して表示画像IMGの輝度が低すぎて、外界の景色は視認できても、表示画像IMGを視認できなくなる恐れがある。つまり、(3)式を満たすようにすることで、外界の景色が低輝度且つ低コントラストであった場合に、外界の景色と表示画像IMGのいずれをも明瞭に視認できるのである。
If (B + C) / (A + C) in equation (3) exceeds 0.9, the brightness of the display image IMG is too high with respect to the outside scene, and the outside scene is buried in the display image IMG. You may not be able to see the scenery. On the other hand, if (B + C) / (A + C) is less than or equal to α = 0.7, the brightness of the display image IMG is too low with respect to the outside scene, and the display image IMG is visible even though the outside scene can be seen. There is a risk that it will not be possible. That is, by satisfying the expression (3), when the outside scene has low brightness and low contrast, both the outside scene and the display image IMG can be clearly seen.
図12に示す例では、C=350(cd/m2)とする。これにより、外界の最小輝度分割領域40では、B+C=700(cd/m2)となり、外界の最大輝度分割領域43では、A+C=850(cd/m2)となって、700/850=0.82となるから、(3)式を満たす。以上は、行ごとに共通の輝度調整が行われる例である。これに限らず、列ごとに共通の輝度調整を行っても良い。また表示領域DPを63分割した上で、各分割領域でそれぞれ最小輝度値と最大輝度値とを取得し、更に表示領域DP全体での最小輝度値と最大輝度値を求めて(3)式に当てはめた上で、得られた値Cを全分割領域で一律の共通値として用いて調整を行ってもよい。
In the example shown in FIG. 12, C = 350 (cd / m 2 ). As a result, B + C = 700 (cd / m 2 ) in the minimum luminance division area 40 of the outside world, and A + C = 850 (cd / m 2 ) in the maximum luminance division area 43 of the outside world, and 700/850 = 0. .82, the expression (3) is satisfied. The above is an example in which common luminance adjustment is performed for each row. However, the present invention is not limited to this, and common luminance adjustment may be performed for each column. Further, after the display area DP is divided into 63, the minimum luminance value and the maximum luminance value are obtained in each divided area, and further, the minimum luminance value and the maximum luminance value in the entire display area DP are obtained, and the expression (3) is obtained. After the fitting, adjustment may be performed using the obtained value C as a uniform common value in all divided regions.
以下、制御処理部121で行われる制御について、図13のフローチャートを参照して説明する。この例では、分割領域1~63毎に、画像輝度の調整を行うか否かを判断するものとする。ここでαを0.7と仮定したとき、ステップS101で、輝度分布データ検出処理部121bが、輝度分布検出センサとしてのカメラ106からの画像信号を入力して、分割領域1~63に対応して外界の輝度分布データを検出する。次いでステップS102でN=1とし,ステップS103で、表示画像/表示輝度制御部121aは分割領域Nの最大輝度値Aが500(cd/m2)以下か否かを判断する。分割領域Nの最大輝度値Aが500(cd/m2)を超えていたと判断された場合、表示輝度にかかわらず表示画像は外界の景色と明瞭に区別がつくので、ステップS106へと進み、表示画像/表示輝度制御部121aは分割領域Nの輝度調整を行わず、すなわち基準の輝度値を用いる。
Hereinafter, the control performed by the control processing unit 121 will be described with reference to the flowchart of FIG. In this example, it is determined for each of the divided areas 1 to 63 whether or not to adjust the image brightness. When α is assumed to be 0.7, in step S101, the luminance distribution data detection processing unit 121b inputs an image signal from the camera 106 as a luminance distribution detection sensor, and corresponds to the divided areas 1 to 63 in the external environment. The brightness distribution data of is detected. Next, in step S102, N = 1, and in step S103, the display image / display luminance control unit 121a determines whether or not the maximum luminance value A of the divided region N is 500 (cd / m 2 ) or less. If it is determined that the maximum luminance value A of the divided area N exceeds 500 (cd / m 2 ), the display image can be clearly distinguished from the scenery of the outside world regardless of the display luminance, and the process proceeds to step S106. The display image / display brightness control unit 121a does not adjust the brightness of the divided region N, that is, uses a reference brightness value.
これに対し、分割領域Nの最大輝度値Aが500(cd/m2)以下であると判断された場合、ステップS104へと進み、表示画像/表示輝度制御部121aは分割領域Nで(最小輝度値B)/(最大輝度値A)が0.7以上か否かを判断する。分割領域Nで(最小輝度値B)/(最大輝度値A)が0.7未満と判断された場合、表示輝度にかかわらず表示画像は外界の景色と明瞭に区別がつくので、ステップS106へと進み、表示画像/表示輝度制御部121aは分割領域Nの輝度調整を行わず、すなわち基準の輝度値を用いる。
On the other hand, if it is determined that the maximum luminance value A of the divided area N is 500 (cd / m 2 ) or less, the process proceeds to step S104, and the display image / display luminance control unit 121a is the minimum area (minimum). It is determined whether (luminance value B) / (maximum luminance value A) is 0.7 or more. If (minimum luminance value B) / (maximum luminance value A) is determined to be less than 0.7 in the divided area N, the display image can be clearly distinguished from the scenery of the outside world regardless of the display luminance. The display image / display brightness control unit 121a does not adjust the brightness of the divided area N, that is, uses the reference brightness value.
これに対し、分割領域Nで(最小輝度値B)/(最大輝度値A)が0.7以上であると判断された場合、ステップS105で表示画像/表示輝度制御部121aは、0.7<(B+C)/(A+C)≦0.9を満たすように、表示輝度Cを設定する。その後、ステップS107でN=63であるか否か判断され、Nが63未満である場合、判断していない分割領域が残存するので、ステップS108でN=N+1とし、次の分割領域にてステップS103~S107の処理が行われる。一方、N=63である場合には、63個の分割領域全ての判断がなされているので、フローを終了する。
On the other hand, when it is determined that (minimum luminance value B) / (maximum luminance value A) is 0.7 or more in the divided area N, the display image / display luminance control unit 121a determines that 0.7 or more in step S105. The display luminance C is set so as to satisfy <(B + C) / (A + C) ≦ 0.9. After that, it is determined whether or not N = 63 in step S107. If N is less than 63, an undetermined divided area remains. Therefore, N = N + 1 is set in step S108, and the step is performed in the next divided area. The processes of S103 to S107 are performed. On the other hand, if N = 63, all 63 divided areas have been determined, and thus the flow ends.
尚、(B/A)=70%以上、80%未満の場合は、α+0.05<(B+C)/(A+C)≦0.9を満たすように表示輝度Cを調整することが望ましい。又、(B/A)=80%以上、89%以下の場合は、α+0.01<(B+C)/(A+C)≦0.9を満たすように表示輝度Cを調整することが望ましい。
When (B / A) = 70% or more and less than 80%, it is desirable to adjust the display luminance C so as to satisfy α + 0.05 <(B + C) / (A + C) ≦ 0.9. When (B / A) = 80% or more and 89% or less, it is desirable to adjust the display luminance C so as to satisfy α + 0.01 <(B + C) / (A + C) ≦ 0.9.
変形例として、ユーザーUSが操作部122等を用いて、輝度調整を行う分割領域を表示領域DP内で任意に指定できるようにしても良い。例えば、図10に示す例では、輝度調整を行う第1の調整領域として、ハッチングで示す分割領域24,25,33,34,42,43を指定し、輝度調整を行う第2の調整領域として、異なるハッチングで示す分割領域29~32,38~41を指定している。更に、ユーザーUSが第1の調整領域では(B+C)/(A+C)=0.80とし、第2の調整領域では(B+C)/(A+C)=0.85とするように、調整値を調整領域毎に異ならせるようにしても良い。これによりユーザーUSの右目EYの特性に合わせて、より視認しやすくなるように輝度調整をカスタマイズすることができる。指定する分割領域は連続していなくても良く、不連続の分割領域を番号で指定しても良い。表示領域DPの分割数は63に限られず、より少なく又はより多くしても良い。更に指定した分割領域の中に、極端に輝度が高い分割領域又は極端に輝度が低い分割領域があった場合、その分割領域の輝度調整は行わないようにしても良い。
As a modification, the user US may arbitrarily specify a divided area for brightness adjustment in the display area DP using the operation unit 122 or the like. For example, in the example shown in FIG. 10, the divided areas 24, 25, 33, 34, 42, and 43 indicated by hatching are designated as the first adjustment area for performing the brightness adjustment, and the second adjustment area for performing the brightness adjustment is designated. The divided areas 29 to 32 and 38 to 41 indicated by different hatching are designated. Further, the user US adjusts the adjustment value so that (B + C) / (A + C) = 0.80 in the first adjustment area and (B + C) / (A + C) = 0.85 in the second adjustment area. You may make it differ for every area | region. Thereby, it is possible to customize the brightness adjustment so as to make it easier to visually recognize in accordance with characteristics of the right eye EY of the user US. The divided areas to be specified need not be continuous, and discontinuous divided areas may be designated by numbers. The number of divisions of the display area DP is not limited to 63, and may be smaller or larger. Further, when there is an extremely high luminance division region or an extremely low luminance division region in the designated division region, the luminance adjustment of the division region may not be performed.
本発明は、明細書に記載の実施形態に限定されるものではなく、他の実施形態・変形例を含むことは、本明細書に記載された実施形態や技術思想から本分野の当業者にとって明らかである。明細書の記載及び実施形態は、あくまでも例証を目的としており、本発明の範囲は後述するクレームによって示されている。例えば、以上の実施形態では、HMDを例にとり本発明を説明してきたが、本発明はHMDに限らず、航空機用或いは車載用のHUDや、ガラスに貼り付ける広告用のパネル等の電子機器全般に適用可能である。又、透過型ディスプレイに表示される情報は、ジェスチャー操作で選択可能なメニューなどであっても良い。
The present invention is not limited to the embodiments described in the specification, and other embodiments and modifications are included for those skilled in the art from the embodiments and technical ideas described in the present specification. it is obvious. The description and the embodiments are for illustrative purposes only, and the scope of the present invention is indicated by the following claims. For example, in the above embodiment, the present invention has been described by taking the HMD as an example. However, the present invention is not limited to the HMD, and the present invention is not limited to an HUD for an airplane or a vehicle, and an electronic device such as an advertising panel attached to glass. It is applicable to. The information displayed on the transmissive display may be a menu that can be selected by a gesture operation.
100 ヘッドマウントディスプレイ(HMD)
101 フレーム
101a 前方部
101b 側部
101c 側部
101d 長孔
101e 長孔
102 眼鏡レンズ
103 主本体部
104 ディスプレイユニット
104A 画像形成部
104B 画像表示部
104DR 表示制御部
104a 光源
104b 一方向拡散板
104c 集光レンズ
104d 表示素子
104f 接眼プリズム
104g 偏向プリズム
104h ホログラム光学素子
105 近接センサ
106 カメラ
107 右副本体部
107a 突起
108 左副本体部
108a 突起
109 地磁気センサ
110A ジャイロ&加速度センサ
111B マイク
111C スピーカー・イヤホン
112 照度センサ
114 温度センサ
121 制御処理部
121a 表示画像/表示輝度制御部
121b 輝度分布データ検出処理部
122 操作部
123 GPS受信部
124 通信部
127 バッテリー
129 記憶部
130 電源回路
B’ 瞳孔
CD コード
CTU 制御ユニット
DP 表示領域
DT 検出領域
EY 右目
HS 配線
IMG 表示画像
US ユーザー 100 Head Mount Display (HMD)
101Frame 101a Front part 101b Side part 101c Side part 101d Long hole 101e Long hole 102 Eyeglass lens 103 Main body part 104 Display unit 104A Image forming part 104B Image display part 104DR Display control part 104a Light source 104b Unidirectional diffuser 104c Condensing lens 104d Display element 104f Eyepiece prism 104g Deflection prism 104h Hologram optical element 105 Proximity sensor 106 Camera 107 Right sub body 107a Protrusion 108 Left sub body 108a Protrusion 109 Geomagnetic sensor 110A Gyro & acceleration sensor 111B Microphone 111C Speaker / Earphone 112 Illuminance sensor 114 Temperature sensor 121 Control processing unit 121a Display image / display luminance control unit 121b luminance distribution data detection processing unit 122 operation unit 123 GPS reception unit 124 communication unit 127 battery 129 storage unit 130 power supply circuit B ′ pupil CD code CTU control unit DP display area DT detection area EY right eye HS wiring IMG display image US user
101 フレーム
101a 前方部
101b 側部
101c 側部
101d 長孔
101e 長孔
102 眼鏡レンズ
103 主本体部
104 ディスプレイユニット
104A 画像形成部
104B 画像表示部
104DR 表示制御部
104a 光源
104b 一方向拡散板
104c 集光レンズ
104d 表示素子
104f 接眼プリズム
104g 偏向プリズム
104h ホログラム光学素子
105 近接センサ
106 カメラ
107 右副本体部
107a 突起
108 左副本体部
108a 突起
109 地磁気センサ
110A ジャイロ&加速度センサ
111B マイク
111C スピーカー・イヤホン
112 照度センサ
114 温度センサ
121 制御処理部
121a 表示画像/表示輝度制御部
121b 輝度分布データ検出処理部
122 操作部
123 GPS受信部
124 通信部
127 バッテリー
129 記憶部
130 電源回路
B’ 瞳孔
CD コード
CTU 制御ユニット
DP 表示領域
DT 検出領域
EY 右目
HS 配線
IMG 表示画像
US ユーザー 100 Head Mount Display (HMD)
101
Claims (6)
- 画像を表示可能であって、表示された画像と共に外界を観察者が視認できる透過型ディスプレイと、
前記透過型ディスプレイに画像を表示するための表示制御装置と、
前記観察者が前記透過型ディスプレイを通して視認する外界の輝度を検出する輝度センサと、を有し、
前記表示制御装置は、前記輝度センサが検出した前記外界の最大輝度をA(cd/m2)、前記外界の最小輝度をB(cd/m2)としたときに、
A≦500 (1)
B/A≧α (2)
(但し、αは任意の値)
を満たすときは、前記透過型ディスプレイに表示する画像の輝度をC(cd/m2)としたときに、
α<(B+C)/(A+C)≦0.9 (3)
を満たすように、前記透過型ディスプレイに表示する画像の輝度を調整する表示装置。 A transmissive display capable of displaying an image and allowing an observer to visually recognize the outside world together with the displayed image;
A display control device for displaying an image on the transmissive display;
A brightness sensor that detects the brightness of the outside world that the viewer visually recognizes through the transmissive display,
When the maximum brightness of the external environment detected by the brightness sensor is A (cd / m 2 ) and the minimum brightness of the external environment is B (cd / m 2 ),
A ≦ 500 (1)
B / A ≧ α (2)
(However, α is an arbitrary value)
When the brightness of the image displayed on the transmissive display is C (cd / m 2 ),
α <(B + C) / (A + C) ≦ 0.9 (3)
A display device that adjusts the luminance of an image displayed on the transmissive display so as to satisfy - 前記表示制御装置は、前記透過型ディスプレイの調整領域に表示される画像において、(3)式を満たすように輝度を調整する請求項1に記載の表示装置。 The display device according to claim 1, wherein the display control device adjusts the luminance so as to satisfy the expression (3) in an image displayed in the adjustment region of the transmissive display.
- 前記表示制御装置は、前記観察者が指定する範囲に表示される画像において、(3)式を満たすように輝度を調整する請求項1又は2に記載の表示装置。 The display device according to claim 1 or 2, wherein the display control device adjusts the luminance so that the expression (3) is satisfied in an image displayed in a range designated by the observer.
- 前記輝度センサは、前記観察者が外界を視認する前記透過型ディスプレイの分割された複数の領域毎に前記外界の輝度を検出し、前記表示制御装置は、前記分割された複数の領域毎に表示される画像において、(3)式を満たすように輝度を調整する請求項1~3のいずれかに記載の表示装置。 The brightness sensor detects the brightness of the outside world for each of a plurality of divided areas of the transmissive display where the observer visually recognizes the outside world, and the display control device displays for each of the plurality of divided areas. The display device according to any one of claims 1 to 3, wherein the brightness of the image to be adjusted is adjusted so as to satisfy the expression (3).
- 以下の式を満たした場合にのみ、前記表示制御装置は、前記透過型ディスプレイに表示する画像の輝度を調整する請求項1~5のいずれかに記載の表示装置。
20≦A (4) The display device according to any one of claims 1 to 5, wherein the display control device adjusts the luminance of an image displayed on the transmissive display only when the following expression is satisfied.
20 ≦ A (4) - 請求項1~5のいずれかに記載の表示装置を搭載した電子機器。 An electronic device equipped with the display device according to any one of claims 1 to 5.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2016115971 | 2016-06-10 | ||
JP2016-115971 | 2016-06-10 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017213165A1 true WO2017213165A1 (en) | 2017-12-14 |
Family
ID=60578607
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2017/021066 WO2017213165A1 (en) | 2016-06-10 | 2017-06-07 | Display device and electronic apparatus |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2017213165A1 (en) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006154437A (en) * | 2004-11-30 | 2006-06-15 | Konica Minolta Photo Imaging Inc | Video display device |
JP2008083290A (en) * | 2006-09-27 | 2008-04-10 | Sony Corp | Display apparatus, and display method |
JP2011085829A (en) * | 2009-10-19 | 2011-04-28 | Nikon Corp | Head-mounted display |
JP2013048358A (en) * | 2011-08-29 | 2013-03-07 | Canon Inc | Viewing system and control method of the same |
-
2017
- 2017-06-07 WO PCT/JP2017/021066 patent/WO2017213165A1/en active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006154437A (en) * | 2004-11-30 | 2006-06-15 | Konica Minolta Photo Imaging Inc | Video display device |
JP2008083290A (en) * | 2006-09-27 | 2008-04-10 | Sony Corp | Display apparatus, and display method |
JP2011085829A (en) * | 2009-10-19 | 2011-04-28 | Nikon Corp | Head-mounted display |
JP2013048358A (en) * | 2011-08-29 | 2013-03-07 | Canon Inc | Viewing system and control method of the same |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106489177B (en) | Near-eye display with self-luminous micro-display engine | |
CN110325891B (en) | System and method for manipulating light from an ambient light source | |
US8866702B1 (en) | Use of optical display system as a visual indicator for a wearable computing device | |
RU2488860C2 (en) | Display arrangement and device | |
US8957916B1 (en) | Display method | |
US8503085B2 (en) | Head-mounted display | |
JP6437532B2 (en) | Data display glasses with anti-glare screen | |
US9927613B2 (en) | Image display apparatus and head mounted display | |
US20210255465A1 (en) | Smart glass display device for both augmented reality and virtual reality comprising plastic lcd shade | |
US20140192092A1 (en) | Display device and control method thereof | |
EP3791226B1 (en) | Variable attenuation of an illumination source | |
JP2011059444A (en) | Spectacles-type image display device | |
JP7091605B2 (en) | Image display device | |
JP2009251194A (en) | Display, head-up display and moving object using the same | |
US20160321970A1 (en) | Display device, head-mounted display device, display system, and control method for display device | |
KR20200095985A (en) | A head mounted display apparatus using discoloration lens and illumination sensor | |
JPWO2010047212A1 (en) | Video display device | |
WO2017070215A1 (en) | Liquid crystal display with variable drive voltage | |
KR20220129542A (en) | display device | |
JP6561606B2 (en) | Display device and control method of display device | |
EP3674772B1 (en) | Head-mounted display apparatus | |
CN212083822U (en) | Augmented reality display optical device, glasses and HUD display system | |
EP3508906A1 (en) | Video display device and optical see-through display | |
WO2017213165A1 (en) | Display device and electronic apparatus | |
JP7055925B2 (en) | Electronic devices and display methods |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17810339 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17810339 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: JP |