WO2020017403A1 - Image display device and image display method - Google Patents

Abstract

An image display device according to an embodiment of the present technology is provided with a screen, an irradiation unit, an image capture unit, and a control unit. The screen has a display member, the optical characteristics of which change in accordance with irradiation with predetermined light. The irradiation unit is capable of irradiating the screen with at least one among the predetermined light and image light. The image capture unit captures an image of the state of the screen when irradiated with at least one among the predetermined light and the image light. The control unit controls the irradiation intensity of the at least one among the predetermined light and the image light on the screen in accordance with the captured state of the screen.

Description

Image display device and image display method

技術 The present technology relates to an image display device that displays an image on a screen or the like, and an image display method.

技術 Conventionally, techniques for irradiating a screen or the like with light to display an image have been developed. For example, Patent Literature 1 discloses an image display device that irradiates a screen with backlight light. In this image display device, a PDLC (Polymer Dispersed Liquid Crystal) panel that diffuses backlight light and a liquid crystal panel that controls the transmittance of the backlight light are used as panels (screens) that contribute to image display. By controlling the diffusion and transmission of the backlight, an image display capable of transmitting the background, displaying black, and the like is realized (see paragraphs [0027], [0051], [0054], and [0055] in the specification of Patent Document 1). 1, and FIG. 10).

International Publication No. WO 2014/017344

As described above, a technique for controlling image display on a screen or the like has been developed, and a technique capable of displaying a high-quality image with excellent visibility on a screen or the like has been demanded.

In view of the circumstances described above, an object of the present technology is to provide an image display device and an image display method capable of displaying a high-quality image with excellent visibility on a screen or the like.

In order to achieve the above object, an image display device according to an embodiment of the present technology includes a screen, an irradiation unit, an imaging unit, and a control unit.
The screen has a display member whose optical characteristics change according to irradiation of predetermined light.
The irradiation unit is capable of irradiating the screen with at least one of the predetermined light and the image light.
The photographing unit photographs a state of the screen irradiated with at least one of the predetermined light and the image light.
The control unit controls an irradiation intensity of at least one of the predetermined light and the image light on the screen according to a state of the screen captured.

画像 In this image display device, the optical characteristics of the display member of the screen are changed by the predetermined light. The screen is irradiated with predetermined light and image light, and the state of the screen is photographed. By controlling the irradiation intensity of the predetermined light and the image light in accordance with the state of the screen, it becomes possible to appropriately control, for example, the optical characteristics of the screen. As a result, it is possible to display a high-quality image with excellent visibility on a screen or the like.

The display member may have a transmittance or a reflectance that changes according to the irradiation of the predetermined light.
This makes it possible to change the black luminance of the screen by controlling the transmission and reflection of light, thereby realizing, for example, an image display with high contrast and excellent visibility.

The photographing unit may photograph a temperature distribution of the screen as a state of the screen.
Thus, for example, it is possible to easily and simultaneously detect the temperature of the display member at each position, for example, and easily perform image display or the like in accordance with the state of the display member.

The control unit may control an irradiation intensity of the predetermined light according to the photographed temperature distribution.
This makes it possible to precisely control the optical characteristics of the display member in accordance with the temperature at each coordinate position of the video signal projected on the screen, thereby realizing a high-precision image display using black luminance. It is possible to do.

The photographing unit may photograph a luminance distribution of the screen as a state of the screen.
This makes it possible to easily detect the actual brightness or the like of the screen depending on the observation environment, and easily and simultaneously perform image display or the like in accordance with the brightness.

The control unit may control an irradiation intensity of the image light according to the captured luminance distribution.
This makes it possible to adjust the brightness of the image light in accordance with the brightness of the screen, and it is possible to sufficiently suppress a decrease in the visibility of the image due to the background of the observation environment, external light, or the like.

The predetermined light may be light in a wavelength range different from the image light.
As a result, it is possible to display a desired black luminance without impairing the color expression of the image displayed on the screen, and it is possible to display a high-quality image with excellent visibility.

A light source unit that emits at least one of a first emission light serving as the predetermined light and a second emission light serving as the image light, and the first light source based on input image information. A generating unit configured to generate the predetermined light by modulating outgoing light, and to generate the image light by modulating the second outgoing light.
This makes it possible to generate the predetermined light and the image light with high accuracy. In addition, by controlling the light source unit and the generation unit, it becomes possible to accurately control the irradiation intensity of the predetermined light and the image light.

The control unit may be configured to output the next image information of the first image information according to a state of the screen irradiated with at least one of the predetermined light and the image light generated based on the first image information. The irradiation intensity of at least one of the predetermined light and the image light specified by the second image information may be corrected.
This makes it possible to control the irradiation intensity of the predetermined light and the image light so that the next image to be displayed is appropriately displayed according to the state of the screen, and realize a sufficiently high-quality image display. It is possible to do.

The display member may display a black area in an area irradiated with the predetermined light. In this case, the control unit corrects the irradiation intensity of the predetermined light applied to the scheduled area according to the temperature of the scheduled area on the screen designated as the black area by the second image information. May be.
Thus, for example, a black area of an image to be displayed next can be displayed at an appropriate timing, and a moving image or the like having high contrast and excellent visibility can be displayed with high accuracy.

The control unit may regulate irradiation of the predetermined light on another area on the screen different from the predetermined area.
Thereby, for example, it is possible to quickly erase the black area of the previously displayed image. As a result, the next image to be displayed can be displayed with high accuracy.

The photographing unit may photograph a temperature distribution of the screen as a state of the screen. In this case, the image display device may further include a contact detection unit that detects a contact position on the screen where the user has contacted, based on a temperature distribution of the screen.
This makes it possible to easily detect an operation input or the like performed by a user touching the screen, and to easily implement an intuitive interface.

The irradiating unit includes an emission optical system that guides the predetermined light and the image light along a common optical path, and emits the guided predetermined light and the image light along a predetermined axis. May have.
Thus, the optical path and the emission optical system of the predetermined light and the image light are shared, and the irradiation accuracy of each light can be improved. Further, it is possible to reduce the size of the device, the manufacturing cost, and the like.

The image display device may further include a branch unit that is disposed on the common optical path and branches light from the screen that has passed through the emission optical system. In this case, the photographing unit may photograph the state of the screen based on the branched light.
This makes it possible to photograph the screen using a common optical system that guides the predetermined light and the image light, and it is possible to reduce the size of the device.

The screen may be arranged at least partially around the predetermined axis. In this case, the irradiation unit may include an optical unit that causes the predetermined light and the image light emitted by the emission optical system to enter the screen.
This makes it possible to display, for example, an all-around image with high visibility on an all-around screen or the like.

The screen may be formed in a cylindrical shape having the predetermined axis as a substantially central axis.
This makes it possible to display an all-around image with high visibility on, for example, a cylindrical all-around screen.

The display member may have a light-transmitting property with respect to a wavelength in a visible region when viewed directly.
This makes it possible to form a transmissive screen, and realize high-quality image display with high contrast and excellent visibility with respect to the transmissive screen.

The display member may include a display layer that displays an image constituted by the image light, and a light control layer whose optical characteristics change according to the irradiation of the predetermined light.
This makes it possible to easily configure, for example, a screen that realizes high-contrast image display.

The light control layer may include a leuco dye or a photochromic material.
By using these materials, it is possible to realize, for example, a screen capable of changing optical characteristics at low cost.

An image display method according to an embodiment of the present technology is an image display method executed by a computer system, wherein a screen having a display member whose optical characteristics change according to irradiation of predetermined light includes the predetermined light and the predetermined light. Irradiating at least one of the image light is included.
A state of the screen irradiated with at least one of the predetermined light and the image light is photographed.
An irradiation intensity of at least one of the predetermined light and the image light on the screen is controlled according to a state of the screen captured.

As described above, according to the present technology, it is possible to display a high-quality image with excellent visibility on a screen or the like. Note that the effects described here are not necessarily limited, and may be any of the effects described in the present disclosure.

FIG. 1 is a schematic diagram illustrating a configuration example of an image display device according to a first embodiment of the present technology. It is a typical sectional view showing the example of composition of a screen. FIG. 3 is a schematic diagram illustrating an example of image projection on a screen. 5 is a flowchart illustrating an example of display control by the image display device. FIG. 4 is a block diagram illustrating a processing flow of display control by the image display device. FIG. 3 is a schematic diagram illustrating an example of image data. It is a schematic diagram which shows an example of the temperature distribution of a screen. It is a schematic diagram which shows another example of image data. It is a schematic diagram which shows the example of a structure of the three-dimensional data showing the temperature distribution of a screen. It is a schematic diagram for explaining the calculation processing of the correction intensity distribution. FIG. 7 is a schematic diagram illustrating a configuration example of an image display device according to a second embodiment. It is a schematic diagram which shows an example of the brightness distribution of a screen. FIG. 4 is a block diagram illustrating a processing flow of display control by the image display device. FIG. 11 is a schematic diagram illustrating a configuration example of an image display device according to a third embodiment. FIG. 14 is a schematic diagram illustrating a configuration example of an image display device according to a fourth embodiment. FIG. 4 is a schematic diagram illustrating an example of image projection on a rear screen. It is a schematic diagram showing a configuration example of an image display device according to a fifth embodiment. It is a schematic diagram which shows an example of an image projection with respect to a cylindrical screen. It is a schematic diagram which shows an example of the image data for cylindrical screens. It is a schematic diagram which shows an example of the temperature distribution of a cylindrical screen. It is a schematic diagram which shows another example of image data for cylindrical screens. It is a schematic diagram which shows the example of a structure of the cylindrical screen mentioned as a comparative example. It is a schematic diagram which shows an example of the process which detects the contact position with respect to a screen.

Hereinafter, embodiments according to the present technology will be described with reference to the drawings.

<First embodiment>
[Configuration of Image Display Device]
FIG. 1 is a schematic diagram illustrating a configuration example of an image display device according to a first embodiment of the present technology. The image display device 100 includes a screen 10 and an image projection unit 20. The image display device 100 is a projection-type display device that displays an image on the screen 10 by projecting light from the image projection unit 20 toward the screen 10. Note that, in the present disclosure, “image” includes a still image and a moving image.

In the image display device 100, the image projection unit 20 emits image light 1 that is light in a wavelength range of visible light and control light 2 that is light in a wavelength range different from the image light 1 as described later. . Here, the image light 1 is light constituting an image, and is typically light including red light R, green light G, and blue light B. The wavelength range of the control light 2 is set to have a different wavelength from the light in the RGB wavelength range. In the present embodiment, the control light 2 corresponds to a predetermined light.

FIG. 2 is a schematic cross-sectional view showing a configuration example of the screen 10. FIG. 3 is a schematic diagram illustrating an example of image projection on the screen 10. The screen 10 has a display member 11 that displays an image, and functions as a projection screen that displays an image by projecting light. The display member 11, for example, the light (the image light 1 and the control light 2) emitted from the image projection unit 20 is supported at a predetermined position by a base or a frame (not shown) so as to be appropriately irradiated.

The display member 11 has a display layer 12, a light control layer 13, and a protective layer 14. As shown in FIG. 2, the display member 11 (screen 10) has a dimming layer 13, a protective layer 14, and a display layer 12 laminated in this order from the side where the light from the image projection unit 20 is projected. It has a structure.

The display layer 12 displays an image constituted by the image light 1. In the present embodiment, the display layer 12 functions as a front screen that displays an image by reflecting or diffracting the incident image light 1 and emitting the image light 1 to the incident side (see FIG. 3). ). The display layer 12 is a commonly used screen, for example, a mat screen, a pearl screen, a silver screen, a bead screen, a transmission screen, and the like.

The mat screen is, for example, a so-called diffusion screen constituted by a cloth or a resin sheet having a surface coated with a paint containing a scattering agent. The pearl screen and the silver screen are so-called reflection screens in which a pearl-based resin or a metal powder-based paint is applied to the surface. The bead screen has an optical lens glass ball applied to the surface. The transmissive screen is, for example, a translucent screen that has light transmissivity to light in a visible wavelength range when viewed directly from the front, and is made of vinyl, acrylic, glass, or the like.

The display layer 12 may be configured using a diffractive optical element (such as a hologram), a half mirror, surface plasmon particles, a cholesteric liquid crystal, and a Fresnel lens. The specific configuration of the display layer 12 is not limited. For example, the display layer 12 only needs to reflect RGB light (image light) projected from the image projection unit 20, and for example, the display layer 12 may be configured using a wall surface or the like.

(4) The optical characteristics of the light control layer 13 change in response to the irradiation of the control light 2. Specifically, the light control layer 13 is configured such that the reflectance or the transmittance changes in accordance with the irradiation of the control light 2. For example, the light control layer 13 absorbs light (control light 2) having a wavelength different from the wavelength (RGB) used as the image light 1 and changes (decreases) the transmittance or the reflectance.

Thus, it can be said that the control light 2 is light for controlling the optical characteristics of the light control layer 13. As the control light 2, it is preferable to use, for example, light having a wavelength of 350 nm to 420 nm or 700 nm to 2.5 μm. Specifically, for example, ultraviolet (UV) and infrared (IR) are mentioned. This makes it possible to change the transmittance or the reflectance of the light control layer 13 without impairing the color expression of the image. Here, “dimming” means changing the transmittance or the reflectance of a screen in order to improve the contrast of an image.

(4) The light control layer 13 includes a photochromic material. The photochromic material is a material in which two states having different colors (absorption spectra) change reversibly by the action of light (control light 2). For example, in a region irradiated with the control light 2, the transmittance or the reflectance can be reduced. As a result, the portion irradiated with the control light 2 can be changed to, for example, black or the like. The color may be changeable to other colors such as blue, purple, brown, and red in addition to black.

As the photochromic material, for example, a photochromic dye composed of an organic material can be used. Photochromic dyes are classified into, for example, two types. One is a T-type photochromic dye that returns to a transparent state when the irradiation of the control light 2 is stopped, and the other is a P-type photochromic dye that returns to a transparent state at a wavelength different from that of the light to be colored. Examples of the T-type photochromic dye include spiropyran, hexaallylbiimidazole, oxazine, naphthopyran, and azobenzene. P-type photochromic dyes include fulgide and diarylethene.

As a photochromic material, an inorganic material such as barium magnesium silicate or silver halide may be used in addition to a photochromic dye which is an organic material. In addition, the type, type, and the like of the photochromic material are not limited. For example, any photochromic material whose reflectance or the like can be controlled by the control light 2 may be used.

(4) The light modulating layer 13 is formed by dispersing the above-described photochromic material in a base material such as a polymer and forming a film on the display layer 12 (protective layer 14), for example. It is preferable that the base material has no absorption in the visible region so as not to impair the display. This makes it possible to pass the image light 1 without deteriorating. It is preferable that the base material does not absorb the control light 2. This makes it possible to efficiently irradiate the control light 2 to the photochromic material.

The material used for the base material is not limited, for example, nylon, polylactic acid, polyamide, polyimide, polyethylene terephthalate, polyacrylonitrile, polyethylene oxide, polyvinyl carbazole, polyvinyl chloride, polyurethane, polystyrene, polyvinyl alcohol, polysulfone, polyvinyl pyrrolidone, poly Examples thereof include polymers such as vinylidene fluoride, polyhexafluoropropylene, cellulose acetate, collagen, gelatin, chitosan, and polysiloxane, and copolymers thereof. In addition, an organic-inorganic hybrid material in which the above-mentioned organic material is combined with an inorganic material such as silica, alumina, titania or zirconia may be used.

(4) The light control layer 13 may include a leuco dye. A leuco dye is a substance that changes color by light or heat, for example. The light control layer 13 is configured using, for example, a leuco dye that produces a desired change in reflectance or transmittance by irradiating light (control light 2). Examples of the leuco dye include a fluoran compound used in general thermal paper. Leuco dyes reversibly develop or decolor when used with an acidic compound called a color developer. As described above, even when a leuco dye is used, a black region or the like can be generated in response to the irradiation of the control light 2.

他 In addition, the specific configuration of the light control layer 13 is not limited. For example, an arbitrary material whose optical characteristics change by irradiating the control light 2 may be appropriately used. Further, for example, a material whose optical characteristics such as light absorptivity (extinction coefficient, etc.) and refractive index are changed as the light modulating layer 13 so that a desired image can be displayed according to the irradiation of the control light 2. May be used.

(4) The protective layer 14 cuts off the irradiation of the control light 2 to the display layer 12 and suppresses the deterioration (yellowing) of the display layer 12 due to the irradiation of the control light 2. The protective layer 14 is formed using, for example, a material that selectively absorbs or reflects ultraviolet light (UV) or infrared light (IR) used as the control light 2. Examples of such a material include scattering agents such as zinc oxide and titanium oxide, octyl methoxycinnamate (or ethylhexyl methoxycinnamate), t-butylmethoxydibenzoylmethane, oxybenzone-3, cyanine dye, phthalocyanine dye, Absorbers such as squarylium dyes are included.

厚 み The thickness of the protective layer 14 is set, for example, to 1 μm or more and 200 μm or less. The thickness of the protective layer 14 is not limited to this, and may be appropriately set according to the intensity of the control light 2 to be used or the like so that the deterioration or the like of the display layer 12 can be sufficiently suppressed. Note that the present technology can be applied to a configuration in which the protective layer 14 is not provided, that is, a configuration in which the display layer 12 and the light control layer 13 are directly stacked.

FIG. 3 schematically illustrates an example of an optical path of the control light 2 and the image light 1 emitted from the image projection unit 20 toward the screen 10. Hereinafter, a surface of the screen 10 facing the image projection unit 20 is referred to as a front surface S1 of the screen 10 and a surface opposite to the front surface S1 is referred to as a rear surface S2 of the screen 10.

The control light 2 incident on the front surface S1 of the screen 10 is absorbed by, for example, a photochromic material of the light control layer 13. As a result, the reflectance or transmittance of the region irradiated with the control light 2 decreases, and the region changes to black or the like. From another viewpoint, by irradiating the control light 2, it is possible to generate a black region or the like at an arbitrary position on the screen 10.

Thus, the display member 11 (the screen 10) displays the black area 3 in the area where the control light 2 has been irradiated. Note that the black region 3 is not limited to the case where the color is actually black, and may be a region where another color according to the characteristics of a photochromic material, a leuco dye, or the like develops. In addition, a region where black (gray scale) having a different tone develops is also included in the black region 3. The gray scale can be displayed by controlling the irradiation intensity of the control light 2, for example.

{Circle around (1)} The image light 1 incident on the front surface S1 of the screen 10 passes through the light control layer 13 and the protective layer 14 and reaches the display layer 12. In the display layer 12, for example, image light 1 that is visible light is diffusely reflected and emitted to the front surface S1 side. Thus, a color image or the like can be displayed on the front surface S1 side of the screen 10.

と す る Assume that a face image is displayed on the screen 10 as shown in FIG. 1, for example. In this case, for example, the control light 2 is irradiated to an area (black eye, eyebrow, or the like) where display of black or the like is designated. This makes it possible to display black eyes, eyebrows, and the like in which the black luminance is suppressed in the black region 3. Further, for example, an image light 1 is emitted to a region (lips, skin, etc.) for which color display is designated, and a color image is displayed. Therefore, an image including the black area 3 displayed by the control light 2 and the color image displayed by the image light 1 is displayed on the screen 10. As a result, it is possible to realize a color display with a wide luminance width and a high contrast.

As shown in FIG. 1, the image projection unit 20 includes a light source device 21, an intensity adjustment unit 22, an image generation optical system 23, a projection optical system 24, a light beam splitting unit 25, an imaging device 26, and a controller 27. In the present embodiment, the image projection unit 20 is configured as a scanning projector that performs image display by scanning a modulated light beam.

The light source device 21 is a light source that emits the control light 2 and the light that becomes the image light 1, and includes a first light source 30 and a second light source 31. In the present embodiment, the light source device 21 corresponds to a light source unit.

{Circle around (1)} The first light source 30 emits the first emission light serving as the control light 2. As described above, the control light 2 is light having a different wavelength range from the image light 1 (RGB light), and is light such as ultraviolet (UV) or infrared (IR). Therefore, the first light source 30 is configured to emit light other than RGB as the first emission light.

(4) As the first light source 30, a solid-state light source such as a semiconductor laser (LD) or a light emitting diode (LED) is used. Further, for example, a halogen lamp, a metal halide lamp, a xenon lamp, a krypton lamp, a metal halide lamp, a sodium lamp, an HID lamp, or the like may be used as the first light source 30.

{Circle around (2)} The second light source 31 emits second emitted light that becomes the image light 1. In the example illustrated in FIG. 1, a red light source 31R that emits red light R, a green light source 31G that emits green light G, and a blue light source 31B that emits blue light B are used as the second light sources 31. The RGB light emitted from these light sources 31R to 31B is the second emitted light.

The red light source 31R, the green light source 31G, and the blue light source 31B (the second light source 31) are each configured using a solid-state light source such as a semiconductor laser (LD) or a light-emitting diode (LED). The specific configuration of the second light source 31 is not limited, and any light source that can emit RGB light may be used.

The intensity adjuster 22 adjusts the output of each light source included in the light source device 21. For example, the intensity adjustment unit 22 includes a power unit (light source driver) connected to each of the first light source 30, the red light source 31R, the green light source 31G, and the blue light source 31B. Therefore, it can be said that the intensity adjustment unit 22 adjusts the intensity of the first emission light, the red light R, the green light G, and the blue light B.

The image generation optical system 23 is an optical system that generates the control light 2 and the image light 1 from the first emission light and the second emission light, respectively. In the present embodiment, the image generation optical system 23 functions as a scanning mechanism that scans the first emission light and the second emission light emitted from the light source device 21. As the image generation optical system 23, for example, a scanning mechanism such as a MEMS (Micro Electro Mechanical System), a DMD (Digital Mirror Device), or a galvanometer mirror is used.

In the present embodiment, the control light 2 and the image light 1 are respectively generated based on information of an image displayed on the screen 10 (hereinafter, referred to as image data). The image data is data that specifies, for example, the RGB values of each pixel included in the image. The format of the image data is not limited, and arbitrary image data for a still image or a moving image may be used. In the present embodiment, the image data corresponds to image information.

For example, the output of the first light source 30 is adjusted by the intensity adjusting unit 22 in accordance with a black level (luminance value or the like) representing the black brightness of each pixel, and the intensity of the first emitted light is modulated in a time-division manner. You. The outputs of the RGB light sources 31R to 31B (second light source 31) are adjusted according to the RGB values of each pixel and the like, and the intensity of each of the RGB light (second emitted light) is modulated in a time-division manner. . Each of the first outgoing light and the RGB light whose intensity has been modulated in a time-division manner is emitted, for example, as one light beam along the same optical path.

The light beam including the first outgoing light beam and the RGB light beams is scanned by the scanning mechanism of the image generating optical system 23 so that the light beam corresponding to each pixel is emitted to an appropriate position. As a result, the control light 2 and the image light 1 for displaying the image represented by the image data are emitted from the image generation optical system 23. As shown in FIG. 1, the control light 2 and the image light 1 emitted from the image generation optical system 23 are guided along a common optical path 32 and enter the subsequent projection optical system 24.

As described above, the intensity adjustment unit 22 and the image generation optical system 23 generate the control light 2 by modulating the first emission light and modulate the second emission light based on the input image data. An image light 1 is generated. By using the control light 2 and the image light 1, it is possible to realize, for example, image display at a predetermined frame rate. In the present embodiment, the generation unit is realized by the cooperative movement of the intensity adjustment unit 22 and the image generation optical system 23.

The projection optical system 24 emits the control light 2 and the image light 1 guided along the common optical path 32 along the optical axis O. As shown in FIG. 1, in the present embodiment, the screen 10 and the image projection unit 20 are arranged such that the optical axis O of the projection optical system 24 intersects the screen 10. In the present embodiment, the optical axis O corresponds to a predetermined axis, and the projection optical system 24 corresponds to an emission optical system.

The projection optical system 24 is an optical system that is configured using, for example, a predetermined lens system for projecting the control light 2 and the image light 1 and that enlarges and projects the control light 2 and the image light 1 in accordance with the screen 10. The specific configuration of the projection optical system 24 is not limited, and may be appropriately configured according to the size of the screen 10, the arrangement position of the image projection unit 20, and the like. Further, an optical system having a focal position adjusting mechanism, a zoom function, and the like may be used.

As described above, the control light 2 and the image light 1 generated by the light source device 21, the intensity adjusting unit 22, and the image generation optical system 23 are irradiated on the screen 10 by the projection optical system 24. In the present embodiment, the light source device 21, the intensity adjustment unit 22, the image generation optical system 23, and the projection optical system 24 constitute an irradiation unit that can emit predetermined light and image light to the screen.

The light beam splitter 25 is disposed on a common optical path 32 between the image generation optical system 23 and the projection optical system 24, and splits light from the screen 10 that has passed through the projection optical system 24. As the light beam branching unit 25, for example, an optical element such as a half mirror, a beam splitter, and a dichroic mirror is used. The light from the screen 10 includes, for example, the control light 2 and the image light 1 reflected by the screen 10, external light incident through the screen 10, and infrared light (emitted light) emitted from the screen 10. included. In the present embodiment, the light beam branching unit corresponds to 25 and the branching unit.

In the present embodiment, as will be described later, outgoing light in the infrared region among the light from the screen 10 is referred to. The light beam splitter 25 is configured to selectively split, for example, radiation light in a desired infrared region. The light beam splitter 25 is configured to pass, for example, the control light 2 and the image light 1. This makes it possible to accurately extract radiation in the infrared region and the like emitted from the screen 10 while suppressing the influence on the control light 2 and the image light 1.

(4) The imaging device 26 captures an image of the state of the screen 10 irradiated with the control light 2 and the image light 1. That is, it can be said that the imaging device 26 captures the screen 10 on which an image is displayed and detects the state of the screen 10. As shown in FIG. 1, light from the screen 10 is split by the light splitting unit 25 and enters the imaging device 26. The imaging device 26 captures an image of the state of the screen 10 based on the light split by the light splitting unit 25. In the present embodiment, the imaging device 26 corresponds to a photographing unit.

In the present embodiment, the imaging device 26 captures the temperature distribution of the screen 10 as the state of the screen 10. The temperature distribution of the screen 10 is captured, for example, by detecting infrared rays (radiated light) emitted from the screen 10. Therefore, the temperature distribution of the screen 10 is obtained as a three-dimensional measurement value representing the temperature of each coordinate position on the screen 10 corresponding to each coordinate position of the video signal projected on the screen 10. Here, the three-dimensional measurement value is data represented by three components including, for example, (X, Y) two-dimensional coordinates and infrared intensity (Z component) at each coordinate position.

各 Each data point included in the temperature distribution can be associated with each pixel of the image displayed on the screen 10. This makes it possible to refer to, for example, the temperature of the screen 10 at the display position of a certain pixel.

Also, in the present embodiment, the light applied to the screen 10 and the light from the screen 10 pass through the same optical system (projection optical system 24). Thereby, for example, the optical axis of the light emitted to the screen 10 and the optical axis of the light from the screen 10 can be made coaxial. As a result, it is possible to sufficiently avoid a positional deviation or the like between the irradiation range of the control light 2 and the image light 1 and the shooting range of the imaging device 26. As a result, it is possible to accurately associate each data point of the temperature distribution with each pixel on the screen 10 and accurately detect the temperature of the display position of each pixel on the screen 10.

The emitted light of the screen 10 can be detected using, for example, a filter (IR filter) that absorbs visible light and transmits infrared light. As the imaging device 26, for example, an infrared camera that combines an image sensor such as a CMOS (Complementary Metal-Oxide Semiconductor) sensor or a CCD (Charge Coupled Device) sensor with an IR filter or the like is used.

The controller 27 controls the operation of each block included in the image projection unit 20. The controller 27 has a hardware configuration necessary for the computer, such as a CPU and a memory (RAM, ROM). The image display method according to the present technology is executed when the CPU loads a program stored in the ROM or the like in advance into the RAM and executes the program.

As the controller 27, for example, a PLD (Programmable Logic Device) such as an FPGA (Field Programmable Gate Array) or another device such as an ASIC (Application Specific Integrated Circuit) may be used.

In the present embodiment, the comparison unit 28 is configured as a functional block by the CPU executing a predetermined program. In addition, the controller 27 is appropriately configured with functional blocks for executing various processes for operating the image projection unit 20 and the like. The program is installed in the controller 27 via, for example, various recording media. Alternatively, the installation of the program may be executed via the Internet or the like.

The comparing unit 28 controls the irradiation intensity of the control light 2 by comparing the temperature distribution of the screen 10 with the image data of the image to be displayed next. Here, the image displayed next is, for example, an image displayed in a frame next to the current frame in image display performed at a predetermined frame rate or the like.

In the present embodiment, the comparison unit 28 calculates a corrected intensity distribution in which the irradiation intensity of the control light 2 specified by the image data of the image to be displayed next is corrected. Therefore, the correction intensity distribution is data specifying the irradiation intensity of the control light 2 for displaying the next image (next frame). From another viewpoint, it can be said that the correction intensity distribution is a control value for controlling the irradiation intensity of the control light 2.

補正 The calculated corrected intensity distribution is input to the intensity adjusting unit 22 described above. Then, the output of the first light source 30 (the intensity of the first emitted light) is modulated by the intensity adjustment unit 22 based on the corrected intensity distribution. Thereby, it is possible to irradiate the control light 2 toward the screen 10 at an irradiation intensity according to the temperature distribution of the screen 10.

比較 Thus, the comparison unit 28 controls the irradiation intensity of the control light 2 on the screen 10 in accordance with the state of the screen 10 photographed. In the present embodiment, the comparison unit 28 corresponds to a control unit. The operation of the comparison unit 28 will be described later in detail with reference to FIG.

[Display control by image display device]
FIG. 4 is a flowchart illustrating an example of display control by the image display device 100. FIG. 5 is a block diagram showing a processing flow of display control by the image display device 100. In FIG. 5, illustration of the image generation optical system 23 and the projection optical system 24 shown in FIG. 1 is omitted.

The display control shown in FIGS. 4 and 5 is, for example, a loop process repeatedly executed during the operation of the image projection unit 20. This loop processing is executed, for example, at the start and end of image display. Alternatively, a mode in which the display control is executed may be selected, and whether or not the loop processing is executed may be switched.

In the present embodiment, as shown in FIG. 5, the output of the imaging device 26 is fed back to the comparison unit 28, and the irradiation intensity of the control light 2 is controlled. Therefore, it can be said that the display control shown in FIGS. 4 and 5 is feedback control for the control light 2. The feedback control is executed for each frame displayed at a predetermined frame rate, for example. Therefore, the repetition frequency of the loop processing is the same as the frame rate of the image display.

{Circle around (1)} The first loop processing is started, for example, in a state where the feedback to the control light 2 is not executed. The second and subsequent loop processes are started in a state in which the feedback of the control light 2 by the loop process executed immediately before is executed. In any case, it is possible to appropriately implement feedback control.

{Circle around (1)} The temperature distribution of the screen 10 is photographed by the imaging device 26 (step 101). For example, light that has entered the image projection unit 20 from the screen 10 via the projection optical system 24 is split by the light beam splitting unit 25 and is incident on the imaging device 26 (infrared camera). In the imaging device 26, infrared light included in the light from the screen 10 is detected by an image sensor or the like, and the temperature distribution of the screen 10 is photographed. In FIG. 5, light from the screen 10 that is branched by the light beam branching unit 25 and enters the imaging device 26 is schematically illustrated by a dotted line.

撮 影 The photographing of the screen 10 is performed in a state where an image is displayed on the screen 10. That is, the temperature distribution of the screen 10 is photographed in a state where the control light 2 and the image light 1 are irradiated on the screen 10. Hereinafter, the image data of the image displayed at the time when the temperature distribution of the screen 10 was captured is referred to as first image data.

FIG. 6 is a schematic diagram showing an example of image data. FIG. 6 schematically shows image data 40 for displaying a face image in the center of a rectangular display range. The image data 40 is data of a face image displayed on the screen 10 shown in FIG.

Hereinafter, the image data 40 shown in FIG. 6 will be described as the first image data 40a used when the screen 10 is photographed. When the screen 10 is photographed at another timing, the other image data 40 different from the image data 40 shown in FIG. 6 becomes the first image data 40a.

{For example, the first image data 40a includes a pixel designated as black (black pixel 41). For example, a pixel representing a black eye or an eyebrow is an example of the black pixel 41. The control light 2 for displaying the black pixel 41 is generated based on the information (black level and pixel position) of the black pixel 41. As a result, a black area 3 is displayed in an area on the screen 10 irradiated with the control light 2, that is, an area where the black pixel 41 is projected (see FIG. 1).

{Also, for example, the first image data 40a includes a pixel (color pixel 42) in which a color other than black is designated. For example, a pixel representing a lip, skin, or the like is an example of the color pixel 42. The image light 1 for displaying the color pixels 42 is generated based on the information (RGB values and pixel positions) of the color pixels 42, and is emitted toward the screen 10. As a result, for example, a face image can be displayed in full color.

In the first image data 40a, the hatched area is an area in which a specific color is not specified (hereinafter, referred to as a transparent area 43). The transparent area 43 is an area where a display color such as black and white or color is not specified, and is, for example, an area to which the control light 2 and the image light 1 are hardly irradiated.

FIG. 7 is a schematic diagram showing an example of the temperature distribution of the screen 10. FIG. 7 schematically illustrates, using a gray scale, a temperature distribution 44 of the screen 10 on which an image using the first image data 40 illustrated in FIG. 6 is displayed. The higher the gray scale density, the higher the temperature.

As described above, the control light 2 such as ultraviolet UV or infrared IR is applied to the black area 3 on the screen 10 where the black eyes, eyebrows and the like are displayed. For example, when part of the light energy supplied to the black region 3 is absorbed by the screen 10 as heat energy, the temperature of the black region 3 increases. As a result, as shown in the temperature distribution 44, a case where a relatively high temperature is detected in a pixel corresponding to the black region 3 may be considered.

Also, in the region on the screen 10 (the region corresponding to the contour of the face) on which the image light 1 which is visible light is irradiated, the energy of the image light 1 may be absorbed as heat energy, and the temperature may increase. Further, for example, a temperature distribution may be generated over the entire screen 10 by accumulating heat associated with image display up to that time.

他 In addition, for example, there is a possibility that temperature unevenness may occur due to the outside air temperature of the place where the screen 10 is arranged (for example, blowing from an air conditioner). It is also conceivable that the temperature of the screen 10 changes when a user or the like touches the screen 10. As described above, the temperature distribution 44 of the screen 10 includes information such as the temperature based on the currently displayed display image (the control light 2 and the image light 1), the temperature of the outside air environment, and the temperature due to contact with a hand or a finger. included.

Returning to FIG. 4, when the temperature distribution of the screen 10 is photographed, the correction intensity distribution of the control light 2 is calculated by the comparing unit 28 (Step 102). As illustrated in FIG. 5, the three-dimensional measurement value that is the temperature distribution 44 of the screen 10 and the second image data that is the next image data 40 of the first image data 40 a are input to the comparison unit 28. .

FIG. 8 is a schematic diagram showing another example of the image data 40. Hereinafter, the image data 40 shown in FIG. 8 will be described as the second image data 40b used next to the first image data 40a shown in FIG. The second image data 40b is different from the first image data 40a in the position of the iris and the shape of the eyebrows. Therefore, in the image to be displayed next, the irradiation position and irradiation intensity of the control light 2 are changed.

In the present embodiment, the image data 40 is the next image data 40 after the first image data 40a according to the state of the screen 10 irradiated with the control light 2 and the image light 1 generated based on the first image data 40a. The irradiation intensity of the control light 2 specified by the second image data 40b is corrected. Specifically, according to the temperature distribution 44 of the screen 10 captured in step 101, a corrected intensity distribution in which the irradiation intensity of the control light 2 specified by the second image data 40b is corrected is calculated.

FIG. 9 is a schematic diagram showing a configuration example of three-dimensional data representing the temperature distribution 44 of the screen 10. FIG. 10 is a schematic diagram for explaining the calculation processing of the correction intensity distribution. Hereinafter, the calculation processing of the corrected intensity distribution 47 will be described with reference to FIGS.

FIG. 9 shows three-dimensional data representing the temperature distribution 44. The three-dimensional data includes a plurality of data points 45 arranged along the vertical direction and the horizontal direction, and the measured value of the temperature of each point of the screen 10 corresponding to each data point 45 (pixel) (the magnitude of the temperature is measured. Etc.) are stored. That is, the temperature distribution 44 can be regarded as three-dimensional image data in which the temperature of each point on the screen 10 is recorded.

{For example, a point on the screen 10 corresponding to a data point 45 (a pixel with a deep data) on which a high value is recorded is a point with a high temperature. Conversely, points on the screen 10 corresponding to data points 45 (pixels with shallow data) where low values are recorded are points with low temperatures.

デ ー タ Each data point 45 included in the temperature distribution 44 is associated with each pixel of the image displayed on the screen 10. Hereinafter, it is assumed that the pixel I (x, y) of the image data 40 corresponds to the data point T (x, y) of the temperature distribution 44. That is, the temperature recorded at the data point T (x, y) represents the temperature at the position where the pixel I (x, y) is displayed. Note that x is an index indicating the position of a data point in the horizontal direction in the figure, and y is an index indicating the position of a data point in the vertical direction in the figure.

対 応 付 け Such association can be realized by using the imaging device 26 having the same resolution as the image data 40 and appropriately aligning the imaging device 26, for example. Note that the present invention is not limited to the case where each pixel is associated with each data point on a one-to-one basis, and the association can be performed using an arbitrary method. For example, a plurality of pixels adjacent to each other may be associated with one data point. In addition, for example, the association between pixels and data points, that is, the association between the image data 40 and the temperature distribution 44 may be performed using convolution or filter processing.

10 is a schematic diagram showing the temperature distribution 44 of the screen 10 in the partial area 46 shown in FIG. 9, and the darker the gray scale, the higher the temperature. The partial area 46 is composed of a block of 5 × 5 data points 45. Hereinafter, the lower left data point 45 of the temperature distribution 44 is described as T (1, 1). Therefore, for example, the data point 45 at the upper left of the temperature distribution 44 is T (1,5).

The upper right part of FIG. 10 is a schematic diagram showing the data (first image data 40a) of the current display image displayed in the partial area 46 at the timing when the temperature distribution 44 was captured. In the first image data 40a, the darker the gray scale, the lower the black luminance, that is, the darker the color. Further, the pixel I _a (x, y) of the first image data 40a is associated with the data point T (x, y) of the temperature distribution 44. That is, the lower left pixel I _a (1,1) of the first image data 40a corresponds to the data point T (1,1) of the temperature distribution 44.

The lower right part of FIG. 10 is a schematic diagram showing the data (second image data 40b) of the next display image displayed in the partial area 46. The darker the gray scale, the lower the black luminance. The pixel I _b (x, y) of the second image data 40b is associated with the data point T (x, y) of the temperature distribution 44.

The lower left diagram of FIG. 10 is a schematic diagram illustrating an example of the correction intensity distribution 47 in the partial region 46. The pixel C (x, y) of the corrected intensity distribution 47 is associated with the pixel I _b (x, y) of the second image data 40b, that is, the data point T (x, y) of the temperature distribution 44. The color of each pixel C in the correction intensity distribution 47 indicates the irradiation intensity of the control light 2 (the emission intensity of the first emission light), and the darker the gray scale, the higher the irradiation intensity.

Hereinafter, the irradiation position on the screen 10 at which the pixel I _a (x, y) of the first image data 40a is displayed is described as S (x, y). For example, T (x, y) represents the temperature of the irradiation position S (x, y) on the screen 10. The pixel I _b (x, y) of the second image data 40b represents a color to be displayed at the irradiation position S (x, y) at the next timing. The pixel C (x, y) of the correction intensity distribution 47 represents a correction value of the irradiation intensity of the control light 2 irradiated to the irradiation position S (x, y).

For example, in the first image data 40a, black is designated as the display color of the pixel I _a (3, 3) at the center of the partial area 46. Therefore, the control light 2 is applied to the irradiation position S (3,3) where I _a (3,3) is displayed. As a result, the black area 3 is displayed at the irradiation position S (3, 3). The temperature of the irradiation position S (3,3) is detected as a measured value of the data point T (3,3) of the temperature distribution 44. As shown in FIG. 10, the data point T (3, 3) has a higher temperature than the other parts due to the irradiation of the control light 2.

In the first image data 40, display colors are also specified for eight pixels adjacent to the center pixel I _a (3, 3). This display color is a brighter color (for example, gray or another color) having a higher luminance than I _a (3, 3). Therefore, the control light 2 and the image light 1 having low intensity are irradiated to eight irradiation positions adjacent to the irradiation positions S (3, 3). Accordingly, as shown in the temperature distribution 44, at eight data points adjacent to the data point T (3,3), a temperature lower than T (3,3) and higher than other regions is detected.

Generally, in the screen 10 (light control layer 13) using a photochromic material or a leuco dye, the higher the temperature, the faster the response speed of coloring and decoloring. That is, the higher the temperature of the part irradiated with the control light 2 is, the shorter the time when the control light 2 is irradiated becomes black. Here, the time until the color changes to black is, for example, the time until the desired black color develops.

As described above, when an image is displayed on the screen 10 including the light control layer 13, the projection screen has a temperature distribution due to the light energy of the currently displayed image, the environmental temperature, and the like, and the reaction speed varies within the plane. It can happen.

For example, it is assumed that the control light 2 is irradiated at the same intensity on each irradiation position of the screen 10. In this case, the time until the same black color (black luminance) is colored is slower as the temperature at the irradiation position is lower, and is shorter as the temperature at the irradiation position is higher. Therefore, when the control light 2 is irradiated with a single intensity on the screen 10 having the temperature distribution 44, there is a possibility that unevenness of black luminance or the like according to the temperature distribution 44 may occur.

In the present embodiment, based on the current temperature distribution 44 of the screen 10, the comparison unit 28 adjusts the irradiation intensity of the control light 2 so that black or the like of the next display image can be appropriately colored. A correction value (correction intensity distribution 47) is calculated. Specifically, the irradiation intensity of the control light 2 applied to the scheduled area 48 is corrected according to the temperature of the scheduled area 48 on the screen 10 designated as the black area 3 by the second image data 40b.

The “scheduled area 48” is, for example, an irradiation position on the screen 10 at which the black pixel 41 specified as black in the second image data 40b is displayed. For example, in the second image data 40b, the position of the iris of the face image moves from the position of the immediately preceding image. The position of the destination iris on the screen 10 is the scheduled area (see FIG. 1). Note that, in FIG. 10, the same reference numerals as in the scheduled area 48 are assigned to the black pixels 41 of the second image data 40b.

For example, in the second image data 40b shown in FIG. 10, the center pixel I _b (3, 3) and the pixels I _b (3, 4), I _b (3, 2), and I _b adjacent to the upper, lower, left, and right sides thereof are displayed. Five pixels of (2, 3) and I _b (4, 3) are designated as black pixels 41. The irradiation positions where the five black pixels 41 are displayed (S (3,3), S (3,4), S (3,2), S (2,3), and S (4,3)) Is the scheduled area 48. In the example shown in FIG. 10, the same black luminance (black level) is set for each of the five black pixels 41.

The comparing unit 28 extracts, for example, the black pixels 41 (planned area 48) from the second image data 40b and refers to the temperature of the data point 45 corresponding to each black pixel 41. Then, the irradiation intensity of the control light 2 is corrected so as to satisfy the intensity for coloring the black luminance of each black pixel 41.

For example, the temperature T (3,3) of the irradiation position S (3,3), which is the scheduled area 48, is higher than the others. That is, at the irradiation position S (3, 3) where the pixel I _b (3, 3) at the center of the next display image is displayed, black is colored in a short time. In such a case, for example, even if the irradiation intensity of the control light 2 is set low, it is possible to color black at an appropriate timing with respect to the irradiation position S (3, 3). Therefore, for the pixel C (3, 3) of the correction intensity distribution 47, for example, an irradiation intensity lower than the original irradiation intensity (light gray in the figure) is calculated.

Further, for example, the temperature T (3,4) of the irradiation position S (3,4), which is the scheduled area 48, is lower than the temperature T (3,3) of the irradiation position S (3,3). . Therefore, at the irradiation position S (3, 4), the response speed until black is colored is lower than at the irradiation position S (3, 3). In this case, for the pixel C (3, 4) of the correction intensity distribution 47, an irradiation intensity (dark gray in the figure) higher than, for example, the irradiation intensity set to C (3,3) is calculated.

Similarly, the pixels C (3,2), C (2) of the correction intensity distribution 47 corresponding to the irradiation positions S (3,2), S (2,3), and S (4,3), which are the planned regions 48, respectively. , 3) and C (4, 3), the irradiation intensity higher than the irradiation intensity of C (3, 3) is calculated. By setting the irradiation intensity of the control light 2 high as described above, it is possible to color a desired black in a short time even in a region where the temperature is low. That is, the response time of the black luminance display can be reduced.

As a result, the five irradiation positions (S (3,3), S (3,4), S (3,2), S (2,3), and S (4,3)) serving as the scheduled region 48 are set. On the other hand, it is possible to display the black area 3 having the same black luminance at an appropriate timing. As described above, in the present embodiment, the irradiation intensity of the control light 2 is controlled according to the temperature distribution 44 of the captured screen 10.

The irradiation intensity (correction value) of each pixel in the correction intensity distribution 47 can be appropriately calculated according to the characteristics of the light control layer 13 and the like. For example, the irradiation intensity of each pixel included in the scheduled area 48 is calculated using the response speed of the light control layer 13 at each temperature and the like so that coloring is completed at a desired timing. In addition, the method of calculating the irradiation intensity of the correction intensity distribution 47 is not limited.

{Circle around (2)} The comparison unit 28 regulates the irradiation of the control light 2 to another area different from the predetermined area 48 on the screen 10. Specifically, the correction intensity distribution 47 is calculated so that the irradiation intensity of the control light 2 becomes zero for an area other than the scheduled area 48 designated as the black area 3. In the correction intensity distribution 47 illustrated in FIG. 10, pixels in which the irradiation intensity of the control light 2 is set to zero are illustrated in white.

(4) For example, when the irradiation of the control light 2 to the light control layer 13 is cut, the displayed black color is erased. In other words, even if it is an area where black was displayed until then, if it is an area where black is not displayed next, it is possible to eliminate black by not irradiating the control light 2. Thus, in the correction intensity distribution 47, it can be said that the irradiation intensity of the control light 2 is corrected so as to be an intensity for decoloring the black luminance of the current display image.

In the present embodiment, an intensity distribution that specifies the intensity of the image light 1 (red light R, green light G, and blue light B) is calculated using the RGB values specified by the second image data 40b. You. The intensity distribution for the image light 1 and the corrected intensity distribution for the control light 2 are output to the intensity adjustment unit 22.

Returning to FIG. 4, the output of the first light source 30 is controlled by the intensity adjustment unit 22 based on the corrected intensity distribution 47 (Step 103). For example, based on the corrected intensity distribution 47, a control value that specifies the intensity of the control light 2 (first emitted light) applied to each irradiation position S (x, y) is Output by division. In step 103, the second light source 31 (the red light source 31R, the green light source 31G, and the blue light source 31B) is appropriately controlled by the intensity adjustment unit 22 based on the intensity distribution for the image light 1.

The control light 2 according to the correction intensity distribution 47 and the next image light 1 are emitted by the light source device 21 and the image generation optical system 23 (step 104). The emitted control light 2 and image light 1 pass through the light beam splitter 25 and are emitted from the projection optical system 24 toward the screen 10. Thus, an image represented by the second image data 40 is displayed on the screen 10. In the next loop processing, the screen 10 on which this image is displayed is photographed, and the processing of steps 101 to 104 is executed again.

By controlling the intensity of the control light 2 in accordance with the temperature distribution 44 of the screen 10 as described above, it is possible to shorten the response time of black luminance display, for example. As a result, black luminance display or the like can be performed at an appropriate timing, and a display image with no afterimage and high contrast can be realized. This makes it possible to display a high-quality image with excellent visibility.

As described above, in the image display device 100 according to the present embodiment, the optical characteristics of the display member 11 of the screen 10 are changed by the control light 2. The screen 10 is irradiated with the control light 2 and the image light 1, and the state of the screen 10 is photographed. By controlling the irradiation intensity of the control light 2 according to the state of the screen, it becomes possible to appropriately control, for example, the optical characteristics of the screen. As a result, it is possible to display a high-quality image with excellent visibility on a screen or the like.

映像 In image display using a general projector, the brightness of the screen in the non-lighting state is black luminance. For this reason, in a bright environment in which the amount of reflected light from the screen is large, the contrast of the displayed image is reduced, and the visibility is deteriorated. In particular, in a transparent screen formed of a transparent glass substrate or the like containing a scattering agent, the visibility is significantly deteriorated.

For example, a method of controlling the transmittance of the screen using a screen having a TFT liquid crystal and a PDL element is conceivable. In this method, an image is displayed with a pixel size defined by a TFT liquid crystal or a PDL element, and it may be difficult to utilize characteristics of a projector such as enlarging or reducing an image and projecting the image. In addition, providing each element may increase the screen manufacturing cost.

As a method for detecting the temperature of the screen, a method using a contact-type thermometer such as a heating wire can be considered. In such temperature sensing using wiring, multipoint measurement is required to obtain a screen temperature distribution. As a result, the design for the screen may be impaired by the wiring for multipoint measurement.

In the present embodiment, the screen 10 whose reflectance or transmittance changes by irradiating the control light 2 is used. As a result, it is possible to arbitrarily change the luminance of the non-lighting area where the image light 1 or the like is not irradiated. As a result, the level of black luminance can be suppressed, and the contrast of an image can be improved.

照射 The irradiation intensity of the control light 2 is controlled based on the temperature distribution of the screen 10. As a result, for example, even when the temperature distribution 44 of the screen 10 becomes uneven due to image display, a change in outside air temperature, a user's contact, etc., the display speed of black luminance is appropriately controlled. It is possible. As a result, it is possible to display an image in which unevenness of black luminance and afterimages are eliminated, and it is possible to display video content and the like having high contrast and excellent visibility.

{Circle around (4)} When the transparent screen 10 is used, displaying the black area 3 makes it possible to avoid a situation in which the background is seen through. Accordingly, it is possible to realize image display with high contrast and excellent visibility even on the transparent screen 10.

The light control layer 13 whose optical characteristics (transmittance and reflectivity) change in response to the irradiation of the control light 2 is configured using a photochromic material, a leuco dye, or the like. Accordingly, it is possible to perform appropriate image display regardless of the irradiation range of the image light 1 or the control light 2, and it is possible to easily realize enlargement / reduction of an image. In addition, since it is not necessary to provide wiring or the like on the screen 10, it is possible to easily configure the screens 10 of various shapes and sizes while suppressing the manufacturing cost of the screen 10.

In the present embodiment, the temperature distribution 44 is photographed as the state of the screen 10 using the imaging device 26. As described above, by using optical means, it is possible to detect the temperature distribution 44 of the screen 10 in detail without impairing the design of the screen 10.

{Circle around (2)} The imaging device 26 captures an image of the screen 10 via a common projection optical system with the control light 2 and the image light 1. Accordingly, it is possible to suppress the displacement between the temperature distribution 44 and the image data 40 and the like, and it is possible to realize the association between the data points of the temperature distribution 44 and the pixels of the image data 40 with high accuracy. As a result, the control accuracy of the control light 2 can be sufficiently improved. In addition, by using such an arrangement, the image projection unit 20 can be configured to be small.

<Second embodiment>
An image display device according to a second embodiment of the present technology will be described. In the following description, the description of the same parts as those in the configuration and operation of the image display device 100 described in the above embodiment will be omitted or simplified.

FIG. 11 is a schematic diagram illustrating a configuration example of an image display device according to the second embodiment. The image display device 200 includes a screen 210 and an image projection unit 220. The screen 210 is configured similarly to the screen 10 shown in FIG. 1, for example. That is, the screen 210 has a characteristic that the transmittance or the reflectance changes in accordance with the irradiation of the control light 2.

The image projection unit 220 includes a light source device 221, an intensity adjustment unit 222, an image generation optical system 223, a projection optical system 224, a light beam splitting unit 225, an imaging device 226, and a controller 227. The intensity adjustment unit 222, the image generation optical system 223, and the projection optical system 224 are configured, for example, in the same manner as the intensity adjustment unit 22, the image generation optical system 23, and the projection optical system 24 illustrated in FIG.

In the present embodiment, the light source device 221 has the second light source 31 including the red light source 31R, the green light source 31G, and the blue light source 31B. Therefore, it can be said that the light source device 221 has, for example, a configuration in which the first light source 30 is removed from the light source device 21 illustrated in FIG. In the present embodiment, the RGB light emitted from the light sources 31R to 31B is the second emitted light (image light). Note that the light source device 221 may be provided with a light source (first light source) that emits control light. Further, for example, a light source or the like that emits control light may be used separately from the light source device 221.

The ray branching unit 225 is disposed on the common optical path 32 between the image generation optical system 223 and the projection optical system 224, and branches the light from the screen 210 passing through the projection optical system 224. As the light beam branching unit 225, for example, an optical element such as a half mirror, a beam splitter, and a dichroic mirror is used.

In the present embodiment, of the light from the screen 210, visible light (RGB light) is branched by the light beam branching unit 225. The transmittance of the light beam branching unit 225 is set, for example, so that the luminance of the display image by the image light 1 does not significantly decrease. An arbitrary transmittance is set so that the intensity of the branched visible light becomes an intensity at which the subsequent visible light camera (imaging device 226) can capture the luminance distribution. The specific configuration of the light beam branching unit 225 is not limited, and is appropriately configured using, for example, a multilayer reflection film, an antireflection film, or the like.

The imaging device 226 captures the state of the screen 210 based on the light from the screen 210 branched by the light beam branching unit 225. In the present embodiment, the brightness distribution of the screen 210 is photographed as the state of the screen 210. The luminance distribution 50 is, for example, a distribution of brightness of visible light emitted from the screen 210, and is an image of the screen 210 when the screen 210 is photographed using visible light.

As the imaging device 226, a visible light camera provided with an image sensor such as a CMOS or a CCD is used. The visible light camera can take a color image, for example. Accordingly, the luminance distribution 50 is an intensity distribution of the red light R, the green light G, and the blue light B emitted from the screen 210. Note that the present technology is applicable even when a visible light camera or the like that captures a monochrome image is used.

FIG. 12 is a schematic diagram showing an example of the luminance distribution of the screen 210. FIG. 12 schematically illustrates a luminance distribution 50 of a screen 210 on which an image using the first image data 40a illustrated in FIG. 6 is displayed, using a gray scale. Actually, the luminance distribution 50 is a color image including the luminance values of the RGB color lights.

輝 度 As shown in FIG. 12, the luminance distribution 50 includes the currently displayed image. This is an image due to return light generated when, for example, light diffusely reflected by the display layer of the screen 210 enters the projection optical system 224.

{Circle around (4)} The luminance distribution 50 includes another image (reflection or the like) different from the image due to the return light. For example, when a transmissive screen 210 or the like is used, the background light transmitted through the screen 210 is detected as the luminance distribution 50. In some cases, illumination light around the installation environment of the screen 210 or other external light is reflected by the screen 210 and detected. As described above, by photographing the luminance distribution 50 of the screen 210, it is possible to acquire information on the actual image projected on the screen 210.

Returning to FIG. 11, the controller 227 is a computer that controls the operation of the image projection unit 220, and has a comparison unit 228 as a functional block. In the present embodiment, the comparing unit 228 controls the irradiation intensity of the image light 1 according to the state of the screen 210 captured. Specifically, the irradiation intensity of the image light 1 is controlled by comparing the luminance distribution 50 of the screen 210 with the image data of the image to be displayed next (second image data 40a).

The comparing unit 228 corrects the irradiation intensity of the image light 1 specified by the second image data 40a based on the luminance distribution 50, and calculates a corrected intensity distribution of the image light 1. The correction intensity distribution of the image light 1 includes a correction intensity distribution for the red light R, a correction intensity distribution for the green light G, and a correction intensity distribution for the blue light B. Hereinafter, the corrected intensity distribution of each color light of RGB is collectively described as a corrected color distribution.

The correction color distribution is data that specifies the irradiation intensity of the image light 1 for displaying the next image (next frame). From another viewpoint, it can be said that the corrected color distribution is a control value for controlling the irradiation intensity of each of the RGB color lights included in the image light 1.

The calculated corrected color distribution is input to the intensity adjustment unit 222. Then, the output of the second light source 31 (the red light source 31R, the green light source 31G, and the blue light source 31B) is modulated by the intensity adjustment unit 222 based on the corrected color distribution. Accordingly, it is possible to irradiate the image light 1 toward the screen 210 with an irradiation intensity according to the luminance distribution of the screen 210. As described above, the comparison unit 228 controls the irradiation intensity of the image light 1 according to the captured luminance distribution.

FIG. 13 is a block diagram showing a processing flow of display control by the image display device 200. The display control by the image display device 200 is a loop process executed by feeding back the output of the imaging device 226 to the comparison unit 228, as shown in FIG.

First, the imaging device 226 captures the luminance distribution 50 of the screen 210 on which the current display image represented by the first image data 40a is displayed. The taken luminance distribution 50 of the screen 210 is input to the comparing unit 228 as a three-dimensional measurement value. At this time, the second image data 40, which is the image data 40 of the next display image, is input to the comparison unit 228.

In the present embodiment, the comparison unit 228 determines whether or not the image data 1 generated based on the first image data 40a corresponds to the state of the screen 210 on which the image light 1 is irradiated. The irradiation intensity of the image light 1 specified by the certain second image data 40b is corrected. That is, the comparison unit 228 calculates a corrected color distribution in which the irradiation intensity of the image light 1 is corrected. In the calculation of the corrected color distribution, for example, the RGB values of each pixel included in the second image data 40b are corrected.

For example, white light (such as ceiling illumination) may be reflected on the screen 210. In the area where the white light is reflected, the luminance of the white light is added in addition to the luminance of the display image, and it may be difficult to appropriately represent the color, brightness, and the like of the display image.

{In this case, the comparison unit 228 increases the luminance of the pixel displayed in the area where the white light is reflected (reflection area), for example. That is, among the pixels included in the second image data 40b, the intensity of each color light of RGB is increased at the same rate for the pixels included in the reflection area. For example, such a corrected color distribution is calculated. As a result, it is possible to express the color of the next display image precisely even in a bright area where white light is reflected.

{Circle around (1)} For example, the color of the irradiated image light 1 and the color of the reflected image may be mixed. In this case, a corrected color distribution in which the RGB values of each pixel are corrected is calculated so that the color of the pixel displayed in the reflection area is appropriately displayed. As a result, the color of the next display image can be appropriately displayed even in a region where another color is superimposed.

他 In addition, the method of calculating the corrected color distribution based on the luminance distribution 50 is not limited. For example, a reflected image can be extracted by comparing the first image data 40a with the luminance distribution 50. A correction color distribution may be calculated based on the extracted image. In addition, for example, reflection in the luminance distribution 50 is determined using machine learning or the like, and a corrected color distribution is calculated based on the determination result. For example, such processing may be performed.

The calculated corrected color distribution of the image light 1 is output to the intensity adjustment unit 222. The output of each of the red light source 31R, the green light source 31G, and the blue light source 31B, which are the second light sources 31, is controlled by the intensity adjustment unit 222 based on the corrected color distribution. From the light source device 221 and the image generation optical system 223, image light 1 according to the corrected color distribution is emitted.

In this manner, the intensity of the irradiation of the image light 1 and the ratio of each color light of RGB are controlled according to the luminance distribution 50 of the screen 210. Thereby, even if the brightness of the display image is not uniform within the screen 210 due to the background transmitted through the projection screen or the illumination around the installation environment, the color of the display image can be displayed properly. Becomes possible. This makes it possible to display a high-quality image with excellent visibility on the screen 210.

In the case where the first light source is provided in the light source device 221, the intensity of the control light is adjusted according to the flowchart described with reference to FIG. For example, the comparing unit 228 calculates an intensity distribution that specifies the intensity of the control light based on the second image data 40b. The output of the first light source is controlled based on the intensity distribution for the control light. Thereby, it is possible to realize image display with high contrast while appropriately displaying the color of the display image.

<Third embodiment>
FIG. 14 is a schematic diagram illustrating a configuration example of an image display device according to the third embodiment. In the present embodiment, the irradiation intensity of the control light 2 and the image light 1 on the screen 310 is controlled according to the temperature distribution and the luminance distribution of the screen 310.

The image display device 300 includes a screen 310 whose optical characteristics change according to the control light 2, and an image projection unit 320. The image projection unit 320 includes a light source device 321, an intensity adjustment unit 322, an image generation optical system 323, and a projection optical system 324. The light source device 321, the intensity adjustment unit 322, the image generation optical system 323, and the projection optical system 324 are, for example, similar to the light source device 21, the intensity adjustment unit 22, the image generation optical system 23, and the projection optical system 24 illustrated in FIG. Be composed.

{Circle around (2)} The image projection unit 320 includes an infrared splitter 325a, a first imaging device 326a, a visible light splitter 325b, a second imaging device 326b, and a controller 327 (comparing unit 328). As shown in FIG. 14, the infrared splitter 325a and the visible light splitter 325b are arranged on the optical path between the image generation optical system 323 and the projection optical system 324 (the common optical path 32 for the control light 2 and the image light 1). Is done. The order in which the infrared splitter 325a and the visible light splitter 325b are arranged is not limited.

(4) The infrared ray branching unit 325a branches the infrared ray out of the light from the screen 310 that has passed through the projection optical system 324. The first imaging device 326a is, for example, an infrared camera, and captures the temperature distribution of the screen 310 by capturing the infrared rays branched by the infrared branch unit 325a. The infrared splitter 325a and the first imaging device 326a are configured, for example, similarly to the light splitter 25 and the imaging device 26 illustrated in FIG.

The visible light branching unit 325 b branches visible light of the light from the screen 310 that has passed through the projection optical system 324. The second imaging device 326b is, for example, a visible light camera, and captures the luminance distribution of the screen 310 by capturing the infrared light branched by the visible light branching unit 325b. The visible light branching unit 325b and the second imaging device 326b are configured, for example, similarly to the light branching unit 225 and the imaging device 226 illustrated in FIG.

The comparing unit 328 controls the irradiation intensity of the control light 2 according to the temperature distribution of the screen 310 captured. For example, a corrected intensity distribution in which the irradiation intensity of the control light 2 specified by the image data 40 of the next display image (second image data 40b) is corrected is calculated (see FIGS. 4 and 5). The comparing unit 328 controls the irradiation intensity of the image light 1 according to the luminance distribution of the screen 310 captured. For example, a corrected color distribution obtained by correcting the irradiation intensity of the image light 1 specified by the second image data 40b is calculated (see FIG. 13 and the like).

As described above, in the present embodiment, the irradiation intensities of the control light 2 and the image light 1 are controlled using the corrected intensity distribution of the control light 2 and the corrected color distribution of the image light 1. Thereby, even when there is unevenness in temperature, uneven brightness, or the like in the plane of the screen 310, uniform image display on the screen 310 can be performed, and display quality can be improved. In addition, an image with high contrast can be displayed in an appropriate color, and the visibility and the like of the image can be sufficiently improved.

<Fourth embodiment>
FIG. 15 is a schematic diagram illustrating a configuration example of an image display device according to the fourth embodiment. In the above embodiment, the front screens 10, 210, and 310 were used. In this embodiment, a rear screen 410 is used. The image display device 400 includes a rear screen 410 and an image projection unit 420.

On the rear type screen 410, as shown in FIG. 15, an image is displayed on a surface (rear surface S2) opposite to a surface (front surface S1) to which the control light 2 and the image light 1 are irradiated. Therefore, the user views the image from the side opposite to the image projection unit 420 with the screen 410 interposed therebetween.

The image projection unit 420 has the same configuration as any of the image projection units 20, 220, and 320 shown in FIGS. 1, 11, and 14, for example. That is, the image projection unit 420 is configured to control the irradiation intensity of at least one of the control light 2 and the image light 1 according to the temperature distribution and the luminance distribution of the screen 410.

FIG. 16 is a schematic view showing an example of image projection on the rear screen 410. The rear screen 410 includes a light control layer 413, a protective layer 414, and a display layer 412 in order from the front surface S1 facing the image projection unit 420. The light control layer 413 and the protective layer 414 have the same configuration as the light control layer 13 and the protective layer 14 described with reference to FIG.

The display layer 412 functions as a rear screen that displays an image by diffracting or refracting the incident image light 1 and emitting the image light 1 to the side opposite to the side on which the image light 1 is incident. As the display layer 412, for example, a thin screen that can transmit image light, a transparent screen, a transmission hologram, or the like is used. The specific structure of the display layer 412 is not limited, and an arbitrary screen functioning as a rear screen may be used as the display layer 412.

As shown in FIG. 16, the image light 1 incident on the front surface S1 of the screen 410 reaches the display layer 412 through the light control layer 413 and the protective layer 414. In the display layer 412, for example, image light 1 that is visible light is diffused and transmitted, and emitted to the rear surface S2 side. Accordingly, a color image or the like can be displayed on the rear surface S2 side of the screen 410.

(4) On the screen 410, the black area 3 is displayed by the control light 2 incident on the light control layer 413 on the front surface S1 side. The black area 3 lowers the black luminance of the screen 410 viewed from the rear surface S2 side. Note that a configuration in which the light control layer 413 is disposed on the rear surface S2 side of the screen 410 may be employed. In this case, the control light 2 that has passed through the display layer 412 is incident on the light control layer 413, and the black region 3 is displayed.

Even in the case where the rear screen 410 is used as described above, the irradiation intensity of the control light 2 and the image light 1 is appropriately controlled according to the temperature distribution and the luminance distribution of the screen 410, so that a high contrast can be visually recognized. It is possible to realize high-quality image display with excellent performance.

<Fifth embodiment>
FIG. 17 is a schematic diagram illustrating a configuration example of an image display device according to the fifth embodiment. In the present embodiment, a cylindrical screen 510 is used instead of the flat screen. The image display device 500 includes a pedestal 501, an image projection unit 520, a screen 510, and a top mirror 502.

The pedestal 501 has a cylindrical shape and is provided at a lower portion of the image display device 500. As shown in FIG. 17, an image projection unit 520 is provided inside the pedestal 501. The pedestal 501 holds the screen 510 and the top plate mirror 502 by an arbitrary holding mechanism (not shown). The shape and the like of the pedestal 501 are not limited, and an arbitrary shape such as a rectangular parallelepiped may be used.

The image projection unit 520 is configured to fit inside the pedestal 501. The projection optical system 524 of the image projection unit 520 is disposed at the center of the pedestal 501 upward. From the projection optical system 524, the control light 2 and the image light 1 are emitted upward along the optical axis O and above the image display device 500. The image projection unit 520 has, for example, a configuration similar to that of the image projection unit 20 illustrated in FIG. The specific configuration of the image projection unit 520 is not limited. For example, the image projection units 220 and 320 illustrated in FIGS. 11 and 14 may be used.

The screen 510 has a cylindrical shape and is arranged all around the optical axis O. In the present embodiment, the screen 510 is arranged such that the center axis of the screen 510 (cylindrical shape) coincides with the optical axis O of the projection optical system 524. That is, it can be said that the screen 510 has a cylindrical shape having the optical axis O as a substantially central axis.

The shape of the screen 510 is not limited. For example, a rectangular parallelepiped screen 510, a polygonal prism screen 510, or the like may be used. Further, for example, the present invention is not limited to the case where the screen 510 is arranged over the entire circumference of the optical axis O. For example, a semi-cylindrical screen 510 may be used. That is, the present technology is applicable to the screen 510 arranged at least partially around the optical axis O.

The screen 510 has a laminated structure in which a light control layer, a protective layer, and a display layer are laminated. For example, a cylindrical screen 510 is formed by laminating the laminated structure on a cylindrical transparent substrate or the like. The light control layer and the protective layer of the screen 510 have the same configuration as, for example, the light control layer 13 and the protective layer 14 described with reference to FIG.

The display layer of the screen 510 is formed using, for example, a diffractive optical element. A diffractive optical element (DOE: Diffractive @ Optical | Element) is an optical element that diffracts light. By using a diffractive optical element, for example, a transparent screen or the like having high transmittance can be configured. This makes it possible to display an all-around image or the like with a floating feeling, and to provide a viewing experience with a high degree of entertainment.

As the diffractive optical element, for example, a holographic optical element (HOE) that diffracts light using interference fringes recorded in a hologram is used. For example, a transmission HOE that diffracts and transmits incident light and a reflection HOE that diffracts and reflects incident light can be used (see FIG. 18).

The diffraction efficiency of the HOE changes according to the incident angle of the incident light. Therefore, by appropriately designing the HOE, it becomes possible to selectively diffract light at a predetermined incident angle and efficiently transmit light at other incident angles. This makes it possible to transmit, for example, light incident from the direction of the line of sight (facing, etc.) with high efficiency, and to exhibit excellent transparency.

具体 The specific configuration of the diffractive optical element is not limited. For example, a volume HOE in which interference fringes are recorded inside the element, a relief type (embossed) HOE in which interference fringes are recorded due to irregularities on the element surface, or the like may be used. In addition to diffraction by interference fringes, a diffractive optical element that diffracts light using a diffraction grating having a predetermined pattern or the like may be used.

他 In addition, the configuration of the display layer is not limited. For example, any transmissive screen may be used as the display layer. Further, for example, the present technology is applicable even when a translucent screen or a screen having no transparency is used.

The top plate mirror 502 has a reflecting surface 503 that reflects the control light 2 and the image light 1. The top plate mirror 502 is arranged to face the projection optical system 524 with the optical axis O as a reference such that the reflection surface 503 faces the projection optical system 524. Therefore, the top mirror 502 is disposed on the optical axis O above the projection optical system 524.

(4) The control light 2 and the image light 1 reflected by the reflection surface 503 are applied to a cylindrical screen 510. That is, it can be said that the top mirror 502 is an optical element that causes the control light 2 and the image light 1 emitted by the projection optical system 524 to enter the screen 510. In the present embodiment, the top mirror 502 corresponds to an optical unit.

In the present embodiment, the reflection surface 503 has a rotationally symmetric shape with respect to the optical axis O. Specifically, the reflection surface 503 is configured to include a rotation surface (parabolic surface) obtained by rotating a curve obtained by cutting out a part of a parabola with reference to the optical axis O. The paraboloid is configured so that the concave side of the parabola (the focal point of the parabola) is the side that reflects light, and the axis of the parabola is different from the optical axis O.

For example, the incident angle of the reflected light (the control light 2 and the image light 1) with respect to the screen 510 can be made substantially constant by appropriately setting the position, the inclination, and the like of the parabola constituting the reflection surface 503. For example, when the screen 510 is configured using a HOE or the like, the reflection surface 503 is configured such that the angle of incidence of the reflected light on the screen 510 is an angle at which the diffraction efficiency by the HOE is high. Thereby, high-luminance image display is realized on a transparent screen. Further, by making the incident angles uniform, it is possible to sufficiently suppress unevenness in luminance of an image and the like.

The specific configuration of the reflecting surface 503 is not limited, and for example, the reflecting surface 503 that controls the incident angle of the reflected light on the screen 510 may be appropriately used. For example, the reflective surface 503 may be configured using a free-form surface designed using an optical path simulation or the like. Further, for example, the shape of the reflection surface 503 may be appropriately designed according to the shape of the screen 510. In addition, any reflecting surface 503 that can reflect the control light 2 and the image light 1 toward the screen 510 may be used.

FIG. 18 is a schematic diagram showing an example of image projection on a cylindrical screen 510. On the left side of FIG. 18, an example of an optical path when a transmission type screen 510 (for example, transmission type HOE) is used is schematically illustrated. On the right side of FIG. 18, an example of an optical path when a reflective screen 510 (for example, a reflective HOE) is used is schematically illustrated.

As shown in FIG. 18, for example, the control light 2 and the image light 1 emitted from the projection optical system 524 enter the reflection surface 503 of the top mirror 502 along the optical axis O. The control light 2 and the image light 1 reflected by the reflection surface 503 are applied to the inside of the cylindrical screen 510.

The control light 2 applied to the screen 510 is absorbed by the light control layer of the screen 510, and a black area 3 having a low black luminance is displayed at the irradiation position. Further, the image light 1 applied to the screen 510 is diffused and transmitted (left figure) or diffusely reflected (right figure) by the display layer 12 and emitted to the outside of the screen 510. Thereby, the user who is looking at the screen 510 from the outside can visually recognize the all-around image and the like.

FIG. 19 is a schematic diagram showing an example of the image data 60 for the cylindrical screen 510. FIG. 20 is a schematic diagram illustrating an example of the temperature distribution 61 of the cylindrical screen 510. FIG. 21 is a schematic diagram illustrating another example of the image data 60 for the cylindrical screen 510.

When an image is displayed on the cylindrical screen 510, as shown in FIGS. 19 and 21, image data 60 of an image deformed according to the shape of the screen 510 or the like is used. In the following, the image data 60 shown in FIG. 19 is assumed to be the image data 60 (first image data 60a) of the currently displayed image, and the image data 60 shown in FIG. Description will be given as the second image data 60b).

{For example, the control light 2 and the image light 1 are generated based on the image data 60 shown in FIG. The generated control light 2 and image light 1 are applied to a screen 510 via a top plate mirror 502. As a result, the face image shown in FIG. 17 is displayed on one side of the cylindrical screen 510 along the curved surface of the screen 510.

(4) In a state where the image represented by the first image data 60a (currently displayed image) is displayed on the screen 510, the imaging by the imaging device 526 is performed. The light from the screen 510 that is incident on the imaging device 526 is, for example, light that travels in the same optical path as the light applied to the screen 510 in the direction opposite to the applied light. That is, the light that travels from each position of the screen 510 toward the inside toward the top mirror 502 and is reflected by the top mirror 502 and enters the projection optical system 524 enters the imaging device 526 via the light beam branching unit 525. I do.

FIG. 20 schematically illustrates the temperature distribution 61 of the screen 510 on which the current display image (first image data 60a) shown in FIG. 19 is displayed. As described above, the temperature distribution 61 is captured based on the light that has traveled in the optical path of the control light 2 and the image light 1 irradiating the screen 510 in the opposite direction. Therefore, for example, the temperature distribution on the screen 510 due to the irradiation of the control light 2 and the image light 1 is detected as a distribution reflecting the deformed image of the first image data 60a.

As described above, by irradiating the light to the screen 510 and photographing the light from the screen 510 using the common optical system, it is possible to easily and highly accurately associate the image data 60 with the temperature distribution 61. It is possible to realize it. Thus, for example, each pixel of the image data 60 can correspond to each data point of the temperature distribution 61 on a one-to-one basis, and the processing speed and control accuracy can be sufficiently improved.

The intensity designated by the second image data 60b shown in FIG. 21 is corrected by the comparing unit 528 based on the temperature distribution 61 of the screen 510 taken, and the corrected intensity distribution of the control light 2 is calculated. The next display image is displayed based on the corrected intensity distribution.

It should be noted that even when the luminance distribution is photographed instead of the temperature distribution 61 (see FIG. 11), or when both the temperature distribution 61 and the luminance distribution are photographed (see FIG. 14), each photographed data and image Highly accurate association with the data 60 is possible.

As described above, even when the cylindrical screen 510 or the like is used, the irradiation intensity of the control light 2 or the image light 1 can be controlled according to the state of the screen 510 (the temperature distribution 61 or the luminance distribution). It is possible. This makes it possible to display a high-quality all-around image or the like with high contrast and high visibility, and to exhibit high entertainment properties.

FIG. 22 is a schematic diagram showing a configuration example of a cylindrical screen 530 that is given as a comparative example. In FIG. 22, an infrared camera 531 for photographing the cylindrical screen 530 from outside is provided. In the configuration in which the infrared camera 531 is installed on the outer periphery of the cylindrical screen 530, a plurality of infrared cameras 531 must be installed so as to surround the entire circumference of the cylindrical screen 530, and the device may be increased in size. Further, since the member is arranged outside the main body, there is a possibility that the design property is impaired. Further, since it is not possible to share the projection optical system for photographing, there is a possibility that the positional relationship between the video signal and the screen may be shifted.

In the present embodiment, as shown in FIG. 17, a configuration is used in which light from the screen 510 that has passed through the projection optical system 524 is branched and photographed. Thus, the imaging device 526 can be installed inside the image projection unit 520, and the temperature or luminance distribution of the cylindrical screen 510 can be acquired with high accuracy. As a result, the image display device 500 can be made compact. In addition, since it is not necessary to arrange a member or the like outside the device, it is possible to exhibit high designability.

Further, by photographing the screen 510 via the common projection optical system 524 with the projected light (the control light 2 and the image light 1), the image data 60 and the photographed data (the temperature distribution 61 and the luminance distribution) are obtained. Can be realized with high accuracy. This makes it possible to detect the state of the temperature, the luminance, and the like at the position irradiated with the control light 2 and the image light 1 with high accuracy, and to appropriately feed back the detection result. As a result, it is possible to greatly improve the image quality of the entire circumference image and the like.

<Sixth embodiment>
In the present embodiment, a process of detecting the touch position of the user who touches the screen is executed by sensing the temperature distribution of the screen in real time. Information on the detected contact position (contact data) is used, for example, as operation input information by the user.

In the present embodiment, an image display device (see FIGS. 1, 14, 17 and the like) provided with an imaging device (such as an infrared camera) for photographing the temperature distribution of the screen is used. The controller of the image display device includes a contact detection unit as a functional block.

(4) The contact detection unit detects a contact position on the screen where the user has contacted, based on a temperature distribution of the screen captured by the imaging device. For example, an image capturing apparatus captures a temperature distribution at a predetermined frame rate. The contact detection unit appropriately obtains the photographed temperature distribution, and detects a position (contact position) on the screen where the user is touching, based on a change in the temperature distribution and the like.

FIG. 23 is a schematic diagram showing an example of a process of detecting a contact position on the screen. FIG. 23A is a schematic diagram showing the temperature distribution 44a of the screen 610 before the user touches it. FIG. 23B is a schematic diagram showing the screen 610 touched by the user's hand 5. FIG. 23C is a schematic diagram showing the temperature distribution 44b of the screen 610 after the user has touched it.

As shown in FIG. 23A, when the screen 610 is photographed before the user touches it, a state in which the temperature distribution due to the irradiation of the control light 2 or the image light 1 or the temperature distribution due to the outside air in the installation environment or the like is detected. It is assumed that the user's hand 5 contacts the screen 610 in this state as shown in FIG. 23B. In this case, the temperature distribution of the screen 610 may be locally changed by transmitting the temperature of the user's hand 5.

(4) On the screen 610 after the user has touched, for example, as shown in FIG. 23C, an area where the temperature of the screen 610 sharply increases is detected. In the example shown in FIG. 23C, five regions having higher temperatures than the surroundings are detected. These five regions are, for example, contact regions 70 generated when the user touches the screen 610 with five fingertips.

The contact detection unit detects, for example, the occurrence of a region where the temperature locally changes (the contact region 70) as shown in FIG. 23C by monitoring the temperature distribution of the screen 610, for example. For example, a region where a change from the immediately preceding temperature distribution is larger than a predetermined threshold is detected as the contact region 70. Further, for example, the contact area 70 may be detected based on image processing using machine learning or the like. The method for detecting the contact area 70 is not limited, and any processing for detecting an area where the temperature has changed or the like may be used.

位置 The position of the contact area 70 is the contact position on the screen where the user has made contact. For example, a position in the contact area 70 where the temperature is the highest, a position at the center of the contact area 70, and the like are detected as the contact positions. This makes it possible to detect which position on the screen 610 the user has touched, that is, where the user has touched the displayed image.

接触 By monitoring the temperature distribution in this way, it is possible to easily detect the contact position (contact data) on the screen 610. By using the contact data, it is possible to display an image according to the contact operation of the user (for example, to direct a line of sight to the contact position), and to configure a display device with an interaction. This makes it possible to provide a viewing experience with a high degree of entertainment.

It is also possible to accept user operations based on the contact data. For example, various operation inputs such as icon selection, keyboard input, and finger gesture can be easily detected. Accordingly, various operations on the screen become possible, and operability can be greatly improved.

<Other embodiments>
The present technology is not limited to the embodiments described above, and can realize other various embodiments.

In the above embodiment, the irradiation intensity of the control light is controlled according to the temperature distribution of the screen. The present invention is not limited to this. For example, the irradiation intensity of the control light may be controlled according to the luminance distribution of the screen. For example, in an area where the reflection of white light is strong, the irradiation intensity of the control light may be controlled so that the black luminance becomes low (so that the black area becomes dark). As a result, even in a bright area, a low luminance level can be maintained, and a high-contrast image can be displayed.

In the above description, the irradiation intensity of the image light is controlled according to the luminance distribution of the screen. However, the present invention is not limited to this. For example, the irradiation intensity of the image light may be controlled according to the temperature distribution of the screen. By using the temperature distribution of the screen, for example, it is possible to adjust the image light according to the degree to which the black area has been erased. For example, such processing may be performed.

In the example shown in FIG. 11, the light source device equipped with only the RGB light sources (second light sources) has been described. For example, a light source device having only a first light source that emits ultraviolet light, infrared light, or the like may be used. That is, a configuration in which only the control light is emitted from the image projection unit may be employed. In this case, for example, a grayscale image or the like can be displayed on a screen. Further, for example, by providing another projector or the like that emits image light, a color image or the like can be displayed. Even with such a configuration, it is possible to realize an image display with high contrast and excellent visibility by controlling the intensity of the control light based on, for example, the temperature distribution of the screen. For example, such a configuration may be used.

方法 The method of setting the region to be irradiated with the control light is not limited. For example, in a gray scale, a pixel whose luminance is lower than a predetermined threshold value is set as a black pixel, and control light is irradiated to a region where the black pixel is displayed. This makes it possible to display, for example, a gray scale on the low luminance side using the light control layer. Further, control light may be used to display a pixel or the like designated as a dark color with a low RGB value. That is, a dark color may be expressed by irradiating the image light and the control light in a superimposed manner.

In the above description, the scanning type projector (image projection unit) that performs image display by scanning a beam including the control light and the image light has been described. The present invention is not limited to this, and a projector of a type that performs light modulation using, for example, a transmissive or reflective liquid crystal panel (LCD) may be used.

For example, a three-LCD (three-panel) projector that includes three liquid crystal panels that respectively modulate RGB color lights and generates image light by combining the modulated color lights may be used. In such a projector, it is possible to generate control light by providing another liquid crystal panel for modulating the output of the first light source. In this case, the four liquid crystal panels that generate image light and control light function as generation units according to the present technology.

In the # 3 LCD type projector, the irradiation intensity of the control light and the image light on the screen can be adjusted by each liquid crystal panel. Therefore, for example, by controlling each liquid crystal panel using the correction intensity distribution of the control light and the correction color distribution of the image light, it is possible to irradiate the control light and the image light with the irradiation intensity according to the state of the screen.

In the above-described embodiment, the screen is photographed by the imaging device using an optical system (projection optical system or the like) common to the light irradiated to the screen. The configuration for photographing the screen is not limited. For example, the screen may be shot using an imaging device arranged outside the image projection unit. Even in such a case, display control according to the state of the screen can be performed by appropriately associating the temperature distribution or luminance distribution of the screen with the image data 40. For example, such a configuration may be adopted.

In FIG. 17, a top plate mirror that reflects control light and image light toward a cylindrical screen is used. The method of projecting an image on a cylindrical screen is not limited. For example, in place of the top mirror, an optical lens or the like that refracts light emitted from the projection optical system and makes the light incident on a cylindrical screen may be used. As the optical lens, for example, a Fresnel lens or the like is used. The present technology is applicable even with such a configuration.

の う ち Among the characteristic parts according to the present technology described above, it is also possible to combine at least two characteristic parts. That is, various features described in each embodiment may be arbitrarily combined without distinction of each embodiment. Further, the various effects described above are only examples and are not limited, and other effects may be exhibited.

Note that the present technology can also adopt the following configurations.
(1) a screen having a display member whose optical characteristics change according to irradiation of predetermined light;
An irradiation unit that can irradiate the screen with at least one of the predetermined light and the image light,
An imaging unit that captures the state of the screen that has been irradiated with at least one of the predetermined light and the image light,
A controller configured to control an irradiation intensity of at least one of the predetermined light and the image light on the screen in accordance with a state of the captured screen.
(2) The image display device according to (1),
The image display device, wherein the display member changes transmittance or reflectance according to the irradiation of the predetermined light.
(3) The image display device according to (1) or (2),
The image display device, wherein the photographing unit photographs a temperature distribution of the screen as a state of the screen.
(4) The image display device according to (3),
The image display device, wherein the control unit controls an irradiation intensity of the predetermined light in accordance with the photographed temperature distribution.
(5) The image display device according to any one of (1) to (4),
The image display device, wherein the photographing unit photographs a luminance distribution of the screen as a state of the screen.
(6) The image display device according to (5),
The image display device, wherein the control unit controls an irradiation intensity of the image light according to the captured luminance distribution.
(7) The image display device according to any one of (1) to (6),
The image display device, wherein the predetermined light is light in a wavelength range different from the image light.
(8) The image display device according to any one of (1) to (7),
A light source unit that emits at least one of a first emission light serving as the predetermined light and a second emission light serving as the image light, and the first light source based on input image information. A generating unit configured to generate the predetermined light by modulating the emitted light, and to generate the image light by modulating the second emitted light.
(9) The image display device according to (8),
The control unit may be configured to output the next image information of the first image information according to a state of the screen irradiated with at least one of the predetermined light and the image light generated based on the first image information. An image display device that corrects the irradiation intensity of at least one of the predetermined light and the image light specified by the second image information.
(10) The image display device according to (9),
The display member displays a black area in an area irradiated with the predetermined light,
The control unit corrects an irradiation intensity of the predetermined light applied to the scheduled area according to a temperature of the scheduled area on the screen designated as the black area by the second image information. apparatus.
(11) The image display device according to (10),
The image display device, wherein the control unit regulates irradiation of the predetermined light on another area different from the scheduled area on the screen.
(12) The image display device according to any one of (1) to (11),
The imaging unit captures the temperature distribution of the screen as the state of the screen,
The image display device further includes a contact detection unit that detects a contact position on the screen where the user has made contact based on the temperature distribution of the screen.
(13) The image display device according to any one of (1) to (12),
The irradiating unit includes an emission optical system that guides the predetermined light and the image light along a common optical path, and emits the guided predetermined light and the image light along a predetermined axis. An image display device.
(14) The image display device according to (13), further comprising:
It is arranged on the common optical path, and comprises a branching unit that branches light from the screen that has passed through the emission optical system,
The image display device, wherein the photographing unit photographs a state of the screen based on the branched light.
(15) The image display device according to (13) or (14),
The screen is disposed at least partially around the predetermined axis,
The image display device, wherein the irradiation unit includes an optical unit that causes the predetermined light and the image light emitted by the emission optical system to enter the screen.
(16) The image display device according to any one of (13) to (15),
The image display device, wherein the screen has a cylindrical shape having the predetermined axis as a substantially central axis.
(17) The image display device according to any one of (1) to (16),
The image display device, wherein the display member has a light transmittance with respect to a wavelength in a visible region when viewed directly.
(18) The image display device according to any one of (1) to (17),
The image display device, wherein the display member includes a display layer that displays an image constituted by the image light, and a dimming layer whose optical characteristics change in response to the irradiation of the predetermined light.
(19) The image display device according to (18),
The image display device, wherein the light control layer includes a leuco dye or a photochromic material.
(20) irradiating at least one of the predetermined light and the image light to a screen having a display member whose optical characteristics change according to irradiation of the predetermined light;
Capture the state of the screen that has been irradiated with at least one of the predetermined light and the image light,
An image display method, wherein a computer system executes: controlling an irradiation intensity of at least one of the predetermined light and the image light on the screen in accordance with a state of the captured screen.

DESCRIPTION OF SYMBOLS 1 ... Image light 2 ... Control light 3 ... Black area 10, 210, 310, 410, 510, 610 ... Screen 12, 412 ... Display layer 13, 413 ... Light control layer 21 ... Light source device 22, 222, 322 ... Intensity adjustment Units 23, 223, 323,... Image generation optical system 24, 224, 324, 524 Projection optical system 25, 225, 525 ... Light beam splitting unit 325a ... Infrared splitting unit 325b ... Apparatus 326a: First imaging apparatus 326b: Second imaging apparatus 27, 227, 327: Controller 28, 228, 328, 528: Comparison unit 32: Common optical path 40, 60 ... Image data 40a, 60a: First Image data 40b, 60b ... second image data 44, 44a, 44b, 61 ... temperature distribution 47 ... correction intensity distribution 48 ... scheduled area 50 ... Luminance distribution 70 contact area 502 top mirror 100, 200, 300, 400, 500 image display device

Claims (20)

1. A screen having a display member whose optical characteristics change according to irradiation of predetermined light,
   An irradiation unit that can irradiate the screen with at least one of the predetermined light and the image light,
   An imaging unit that captures the state of the screen that has been irradiated with at least one of the predetermined light and the image light,
   A controller configured to control an irradiation intensity of at least one of the predetermined light and the image light on the screen in accordance with a state of the captured screen.
2. The image display device according to claim 1,
   The image display device, wherein the display member changes transmittance or reflectance according to the irradiation of the predetermined light.
3. The image display device according to claim 1,
   The image display device, wherein the photographing unit photographs a temperature distribution of the screen as a state of the screen.
4. The image display device according to claim 3, wherein
   The image display device, wherein the control unit controls an irradiation intensity of the predetermined light in accordance with the photographed temperature distribution.
5. The image display device according to claim 1,
   The image display device, wherein the photographing unit photographs a luminance distribution of the screen as a state of the screen.
6. The image display device according to claim 5, wherein
   The image display device, wherein the control unit controls an irradiation intensity of the image light according to the captured luminance distribution.
7. The image display device according to claim 1,
   The image display device, wherein the predetermined light is light in a wavelength range different from the image light.
8. The image display device according to claim 1,
   A light source unit that emits at least one of a first emission light serving as the predetermined light and a second emission light serving as the image light, and the first light source based on input image information. A generating unit configured to generate the predetermined light by modulating the emitted light, and to generate the image light by modulating the second emitted light.
9. The image display device according to claim 8, wherein:
   The control unit may be configured to output the next image information of the first image information according to a state of the screen irradiated with at least one of the predetermined light and the image light generated based on the first image information. An image display device that corrects the irradiation intensity of at least one of the predetermined light and the image light specified by the second image information.
10. The image display device according to claim 9,
    The display member displays a black area in an area irradiated with the predetermined light,
    The control unit corrects an irradiation intensity of the predetermined light applied to the scheduled area according to a temperature of the scheduled area on the screen designated as the black area by the second image information. apparatus.
11. The image display device according to claim 10,
    The image display device, wherein the control unit regulates irradiation of the predetermined light on another area different from the scheduled area on the screen.
12. The image display device according to claim 1,
    The imaging unit captures the temperature distribution of the screen as the state of the screen,
    The image display device further includes a contact detection unit that detects a contact position on the screen where the user has made contact based on the temperature distribution of the screen.
13. The image display device according to claim 1,
    The irradiating unit includes an emission optical system that guides the predetermined light and the image light along a common optical path, and emits the guided predetermined light and the image light along a predetermined axis. An image display device.
14. The image display device according to claim 13, further comprising:
    It is arranged on the common optical path, and comprises a branching unit that branches light from the screen that has passed through the emission optical system,
    The image display device, wherein the photographing unit photographs a state of the screen based on the branched light.
15. The image display device according to claim 13,
    The screen is disposed at least partially around the predetermined axis,
    The image display device, wherein the irradiation unit includes an optical unit that causes the predetermined light and the image light emitted by the emission optical system to enter the screen.
16. The image display device according to claim 13,
    The image display device, wherein the screen has a cylindrical shape having the predetermined axis as a substantially central axis.
17. The image display device according to claim 1,
    The image display device, wherein the display member has a light transmittance with respect to a wavelength in a visible region when viewed directly from the front.
18. The image display device according to claim 1,
    The image display device, wherein the display member includes a display layer that displays an image constituted by the image light, and a light control layer whose optical characteristics change in response to the irradiation of the predetermined light.
19. The image display device according to claim 18, wherein
    The image display device, wherein the dimming layer includes a leuco dye or a photochromic material.
20. A screen having a display member whose optical characteristics change in response to irradiation of the predetermined light is irradiated with at least one of the predetermined light and image light,
    Capture the state of the screen irradiated with at least one of the predetermined light and the image light,
    An image display method in which a computer system executes: controlling an irradiation intensity of at least one of the predetermined light and the image light on the screen in accordance with a state of the captured screen.

Images