JP7371627B2 - Image display device and image display method - Google Patents

Description

The present technology relates to an image display device that displays an image on a screen or the like, and an image display method.

Conventionally, techniques have been developed for displaying images by irradiating light onto a screen or the like. For example, Patent Document 1 describes an image display device that irradiates a screen with backlight light. In this image display device, a PDLC (Polymer Dispersed Liquid Crystal) panel that diffuses backlight light and a liquid crystal panel that controls the transmittance of the backlight light are used as panels (screens) that contribute to image display. By controlling the diffusion and transmission of backlight light, an image display that allows background transparency and black display is realized (see paragraphs [0027] [0051] [0054] [0055] of patent document 1). 1, and Figure 10, etc.).

International Publication No. 2014/017344

As described above, technologies for controlling image display on screens and the like have been developed, and there is a need for technologies that can display high-quality images with excellent visibility on screens and the like.

In view of the above circumstances, an object of the present technology is to provide an image display device and an image display method that can display high-quality images with excellent visibility on a screen or the like.

In order to achieve the above object, an image display device according to one embodiment of the present technology includes a screen, an irradiation section, a photographing section, and a control section.
The screen includes a display member whose optical characteristics change according to irradiation with predetermined light.
The irradiation unit is capable of irradiating the screen with at least one of the predetermined light and the image light.
The photographing unit photographs a state of the screen irradiated with at least one of the predetermined light and the image light.
The control unit controls the irradiation intensity of at least one of the predetermined light and the image light to the screen, depending on the state of the screen in which the image was taken.

In this image display device, the optical characteristics of the display member of the screen change depending on the predetermined light. The screen is irradiated with predetermined light and image light, and the state of the screen is photographed. By controlling the irradiation intensity of the predetermined light and the image light according to the state of the screen, it is possible to appropriately control, for example, the optical characteristics of the screen. As a result, it becomes possible to display a high-quality image with excellent visibility on a screen or the like.

The transmittance or reflectance of the display member may change depending on the irradiation with the predetermined light.
This makes it possible to change the black luminance of the screen by controlling the transmission and reflection of light, making it possible to realize, for example, an image display with high contrast and excellent visibility.

The photographing unit may photograph a temperature distribution of the screen as the state of the screen.
This makes it possible to easily detect, for example, the temperature of the display member at each position at the same time, and it becomes possible to easily display images that match the state of the display member.

The control unit may control the irradiation intensity of the predetermined light according to the photographed temperature distribution.
This makes it possible to precisely control the optical characteristics of the display member according to the temperature at each coordinate position of the video signal projected onto the screen, realizing highly accurate image display using black luminance. It becomes possible to do so.

The photographing unit may photograph a luminance distribution of the screen as the state of the screen.
Thereby, it becomes possible to easily detect the actual brightness of the screen depending on the viewing environment, and it becomes possible to simultaneously easily display images in accordance with this brightness.

The control unit may control the irradiation intensity of the image light according to the photographed luminance distribution.
This makes it possible to adjust the brightness of the image light in accordance with the brightness of the screen, and it becomes possible to sufficiently suppress the reduction in image visibility caused by the background of the viewing environment, external light, and the like.

The predetermined light may be light in a wavelength range different from that of the image light.
This makes it possible to display a desired black luminance without impairing the color expression of the image displayed on the screen, and it becomes possible to display a high-quality image with excellent visibility.

The irradiation section includes a light source section that emits at least one of a first emitted light that becomes the predetermined light and a second emitted light that becomes the image light; The image forming apparatus may further include a generating section that modulates the emitted light to generate the predetermined light, and modulates the second emitted light to generate the image light.
This makes it possible to accurately generate predetermined light and image light. Furthermore, by controlling the light source section and the generation section, it is possible to precisely control the irradiation intensity of the predetermined light and the image light.

The control unit is configured to display image information next to the first image information according to a state of the screen irradiated with at least one of the predetermined light and the image light generated based on the first image information. The irradiation intensity of at least one of the predetermined light and the image light specified by the second image information may be corrected.
This makes it possible to control the irradiation intensity of the predetermined light and image light so that the next image is displayed appropriately according to the screen condition, achieving sufficiently high-quality image display. It becomes possible to do so.

The display member may display a black area in a region irradiated with the predetermined light. In this case, the control unit corrects the irradiation intensity of the predetermined light applied to the predetermined area according to the temperature of the predetermined area on the screen designated as the black area by the second image information. You may.
As a result, for example, it becomes possible to display the black area of the next displayed image at an appropriate timing, and it becomes possible to accurately display a moving image or the like with high contrast and excellent visibility.

The control unit may regulate irradiation of the predetermined light onto an area other than the planned area on the screen.
This makes it possible, for example, to quickly erase the black area of the previously displayed image. As a result, the next image to be displayed can be displayed with high precision.

The photographing unit may photograph a temperature distribution of the screen as the state of the screen. In this case, the image display device may further include a contact detection unit that detects a contact position on the screen that the user has touched based on the temperature distribution of the screen.
This makes it possible to easily detect operation inputs performed by the user by touching the screen, and it becomes possible to easily implement an intuitive interface.

The irradiation unit includes an output optical system that guides the predetermined light and the image light along a common optical path and emits the guided predetermined light and the image light along a predetermined axis. May have.
This makes it possible to share the optical path, output optical system, etc. of the predetermined light and the image light, and to improve the irradiation accuracy of each light. Moreover, it becomes possible to suppress the device size, manufacturing cost, etc.

The image display device may further include a branching section that is arranged on the common optical path and branches light from the screen that has passed through the output optical system. In this case, the photographing section may photograph the state of the screen based on the branched light.
This makes it possible to photograph the screen using a common optical system that guides predetermined light and image light, and it becomes possible to suppress the size of the device and the like.

The screen may be arranged at least partially around the predetermined axis. In this case, the irradiation unit may include an optical unit that causes the predetermined light and the image light emitted by the output optical system to enter the screen.
This makes it possible to display a highly visible all-round image on, for example, a all-round screen.

The screen may have a cylindrical shape with the predetermined axis substantially as the central axis.
This makes it possible to display a highly visible all-round image on, for example, a cylindrical all-around screen.

The display member may be transparent to wavelengths in the visible range when viewed from the front.
This makes it possible to configure a transmissive screen, and to achieve high-quality image display with high contrast and excellent visibility for the transmissive screen.

The display member may include a display layer that displays an image formed by the image light, and a light control layer whose optical characteristics change according to irradiation with the predetermined light.
This makes it possible to easily configure, for example, a screen that achieves high-contrast image display.

The light control layer may include a leuco dye or a photochromic material.
By using these materials, it is possible to realize, for example, a screen or the like whose optical properties can be changed at low cost.

An image display method according to an embodiment of the present technology is an image display method executed by a computer system, in which the predetermined light and It includes irradiating at least one of the image lights.
A state of the screen irradiated with at least one of the predetermined light and the image light is photographed.
The irradiation intensity of at least one of the predetermined light and the image light with respect to the screen is controlled depending on the state of the screen in which the image was taken.

As described above, according to the present technology, it is possible to display a high-quality image with excellent visibility on a screen or the like. Note that the effects described here are not necessarily limited, and may be any of the effects described in this disclosure.

1 is a schematic diagram showing a configuration example of an image display device according to a first embodiment of the present technology. It is a typical sectional view showing an example of composition of a screen. FIG. 3 is a schematic diagram showing an example of image projection onto a screen. 3 is a flowchart illustrating an example of display control by an image display device. FIG. 2 is a block diagram showing a processing flow of display control by the image display device. FIG. 3 is a schematic diagram showing an example of image data. It is a schematic diagram which shows an example of the temperature distribution of a screen. FIG. 7 is a schematic diagram showing another example of image data. It is a schematic diagram which shows the example of a structure of three-dimensional data showing temperature distribution of a screen. FIG. 3 is a schematic diagram for explaining a calculation process of a corrected intensity distribution. FIG. 2 is a schematic diagram showing a configuration example of an image display device according to a second embodiment. FIG. 3 is a schematic diagram showing an example of the brightness distribution of a screen. FIG. 2 is a block diagram showing a processing flow of display control by the image display device. FIG. 7 is a schematic diagram showing a configuration example of an image display device according to a third embodiment. FIG. 7 is a schematic diagram showing a configuration example of an image display device according to a fourth embodiment. FIG. 3 is a schematic diagram showing an example of image projection onto a rear-type screen. FIG. 7 is a schematic diagram showing a configuration example of an image display device according to a fifth embodiment. FIG. 3 is a schematic diagram showing an example of image projection onto a cylindrical screen. FIG. 2 is a schematic diagram showing an example of image data for a cylindrical screen. It is a schematic diagram which shows an example of the temperature distribution of a cylindrical screen. FIG. 7 is a schematic diagram showing another example of image data for a cylindrical screen. It is a schematic diagram which shows the structural example of the cylindrical screen mentioned as a comparative example. FIG. 3 is a schematic diagram showing an example of a process of detecting a contact position on a screen.

Embodiments of the present technology will be described below with reference to the drawings.

<First embodiment>
[Configuration of image display device]
FIG. 1 is a schematic diagram showing a configuration example of an image display device according to a first embodiment of the present technology. Image display device 100 includes a screen 10 and an image projection section 20. The image display device 100 is a projection type display device that displays an image on the screen 10 by projecting light from the image projection unit 20 toward the screen 10 . Note that in the present disclosure, "image" includes still images and moving images.

In the image display device 100, as described later, the image projection unit 20 emits image light 1, which is light in a wavelength range of visible light, and control light 2, which is light in a wavelength range different from that of the image light 1. . Here, the image light 1 is light that constitutes an image, and typically includes red light R, green light G, and blue light B. The wavelength range of the control light 2 is set to be a different wavelength from the light in these RGB wavelength ranges. In this embodiment, the control light 2 corresponds to predetermined light.

FIG. 2 is a schematic cross-sectional view showing a configuration example of the screen 10. FIG. 3 is a schematic diagram showing an example of image projection onto the screen 10. The screen 10 has a display member 11 that displays an image, and functions as a projection screen that displays an image by projecting light. The display member 11 is supported at a predetermined position by a base body, a frame, etc. (not shown) so that light (image light 1 and control light 2) emitted from the display member 11, for example, the image projection unit 20, is properly irradiated.

The display member 11 includes a display layer 12 , a light control layer 13 , and a protective layer 14 . As shown in FIG. 2, the display member 11 (screen 10) has a light control layer 13, a protective layer 14, and a display layer 12 laminated in this order from the side on which light from the image projection unit 20 is projected. It has a structure.

The display layer 12 displays an image formed by the image light 1. In this embodiment, the display layer 12 functions as a front screen that displays an image by reflecting or diffracting the incident image light 1 and emitting it to the side on which the image light 1 has entered (see FIG. 3). ). The display layer 12 is a commonly used screen, such as a matte screen, a pearl screen, a silver screen, a bead screen, and a transparent screen.

The matte screen is, for example, a so-called diffusion type screen made of cloth or a resin sheet whose surface is coated with a paint containing a scattering agent. Pearl screens and silver screens are so-called reflective screens whose surfaces are coated with pearl resin or metal powder paint. A bead screen has optical lens glass spheres coated on its surface. The transmission screen is, for example, a translucent screen that is transparent to visible wavelength light when viewed head-on, and is made of vinyl, acrylic, glass, or the like.

In addition to this, the display layer 12 may be configured using a diffractive optical element (such as a hologram), a half mirror, a surface plasmon particle, a cholesteric liquid crystal, a Fresnel lens, or the like. The specific configuration of the display layer 12 is not limited. For example, the display layer 12 only needs to reflect RGB light (image light) projected from the image projection unit 20, and the display layer 12 may be configured using, for example, a wall surface or the like.

The optical characteristics of the light control layer 13 change depending on the irradiation of the control light 2 . Specifically, the light control layer 13 is configured so that its reflectance or transmittance changes depending on the irradiation of the control light 2. For example, the light control layer 13 absorbs light (control light 2) having a wavelength different from the wavelength (RGB) used as the image light 1, and changes (decreases) the transmittance or reflectance.

In this way, the control light 2 can be said to be light for controlling the optical characteristics of the light control layer 13. As the control light 2, it is preferable to use light having a wavelength of, for example, 350 nm or more and 420 nm or less, or 700 nm or more and 2.5 μm or less. Specifically, for example, ultraviolet rays (UV) and infrared rays (IR) can be mentioned. This makes it possible to change the transmittance or reflectance of the light control layer 13 without impairing the color expression of the image. Here, "light control" refers to changing the transmittance or reflectance of the screen in order to improve the contrast of the image.

The light control layer 13 includes a photochromic material. A photochromic material is a material that reversibly changes into two states with different colors (absorption spectra) under the action of light (control light 2). For example, in the area irradiated with the control light 2, it is possible to reduce the transmittance or reflectance. As a result, it becomes possible to change the color of the area irradiated with the control light 2 to black, for example. Note that it may be possible to change to other colors other than black, such as blue, purple, brown, and red.

Examples of the photochromic material include photochromic dyes made of organic materials. For example, photochromic dyes are classified into two types. One is a T-type photochromic dye that returns to a transparent state when irradiation with the control light 2 is stopped, and the other is a P-type photochromic dye that returns to a transparent state by a wavelength different from that of the coloring light. Examples of T-type photochromic dyes include spiropyran, hexaallylbiimidazole, oxazine, naphthopyran, and azobenzene. Examples of P-type photochromic dyes include fulgide and diarylethene.

Further, as the photochromic material, in addition to photochromic dyes which are organic materials, inorganic materials such as barium magnesium silicate and silver halide may be used. In addition, the type, type, etc. of the photochromic material are not limited, and any photochromic material whose reflectance etc. can be controlled by the control light 2 may be used, for example.

The light control layer 13 is formed by dispersing the above-described photochromic material in a base material such as a polymer, and forming this as a film on, for example, the display layer 12 (protective layer 14). The base material preferably has no absorption in the visible range so as not to impair the display. This allows the image light 1 to pass through without being altered. Further, it is preferable that the base material does not absorb the control light 2. This makes it possible to efficiently irradiate the photochromic material with the control light 2.

The material used for the base material is not limited, and examples include nylon, polylactic acid, polyamide, polyimide, polyethylene terephthalate, polyacrylonitrile, polyethylene oxide, polyvinyl carbazole, polyvinyl chloride, polyurethane, polystyrene, polyvinyl alcohol, polysulfone, polyvinylpyrrolidone, polyvinyl pyrrolidone, Examples include polymers such as vinylidene fluoride, polyhexafluoropropylene, cellulose acetate, collagen, gelatin, chitosan, and polysiloxane, or copolymers thereof. Other examples include organic-inorganic hybrid materials that combine the above-mentioned organic materials with inorganic materials such as silica, alumina, titania, or zirconia.

Further, the light control layer 13 may be configured to include a leuco dye. Leuco pigments are substances that change color due to light or heat, for example. The light control layer 13 is configured using, for example, a leuco dye that causes a desired change in reflectance or transmittance when irradiated with light (control light 2). Examples of leuco dyes include fluoran compounds used in general thermal paper. Leuco dyes reversibly develop or discolor when used together with an acidic compound called a color developer. In this way, even when using a leuco dye, it is possible to generate a black area or the like in response to irradiation with the control light 2.

In addition, the specific structure of the light control layer 13 is not limited, and any material whose optical characteristics change upon irradiation with the control light 2, for example, may be used as appropriate. Further, for example, a material whose optical properties such as light absorption rate (extinction coefficient, etc.) and refractive index change can be used as the light control layer 13 so that a desired image display can be performed according to the irradiation with the control light 2. may be used.

The protective layer 14 cuts irradiation of the control light 2 to the display layer 12 and suppresses deterioration (yellowing) of the display layer 12 due to irradiation of the control light 2. The protective layer 14 is formed using a material that selectively absorbs or reflects ultraviolet (UV) or infrared (IR) used as the control light 2, for example. Examples of such materials include scattering agents such as zinc oxide and titanium oxide, octyl methoxycinnamate (or ethylhexyl methoxycinnamate), t-butylmethoxydibenzoylmethane, oxybenzone-3, cyanine dyes, phthalocyanine dyes, Examples include absorbers such as squarylium dyes.

The thickness of the protective layer 14 is set, for example, to 1 μm or more and 200 μm or less. Without being limited thereto, the thickness of the protective layer 14 may be appropriately set according to the intensity of the control light 2 used, etc. so that deterioration of the display layer 12 and the like can be sufficiently suppressed. Note that the present technology is applicable even to a configuration in which the protective layer 14 is not provided, that is, a configuration in which the display layer 12 and the light control layer 13 are directly laminated.

FIG. 3 schematically shows an example of the optical paths of the control light 2 and the image light 1 irradiated from the image projection unit 20 toward the screen 10. Hereinafter, the surface of the screen 10 facing the image projection unit 20 will be referred to as the front surface S1 of the screen 10, and the surface opposite to the front surface S1 will be referred to as the rear surface S2 of the screen 10.

The control light 2 incident on the front surface S1 of the screen 10 is absorbed by, for example, the photochromic material of the light control layer 13. As a result, the reflectance or transmittance of the area irradiated with the control light 2 decreases, and the area changes to black or the like. From another perspective, by irradiating the control light 2, it is possible to generate a black area or the like at any position on the screen 10.

In this way, the display member 11 (screen 10) displays the black area 3 in the area irradiated with the control light 2. Note that the black area 3 is not limited to the case where it actually becomes black, but may be an area where another color is developed depending on the characteristics of the photochromic material, leuco dye, etc., for example. The black area 3 also includes an area in which black (gray scale) with different tones is produced. Note that the gray scale can be displayed by controlling the irradiation intensity of the control light 2, for example.

Further, the image light 1 incident on the front surface S1 of the screen 10 passes through the light control layer 13 and the protective layer 14 and reaches the display layer 12. In the display layer 12, the image light 1, which is, for example, visible light, is diffusely reflected and emitted toward the front surface S1. This makes it possible to display a color image or the like on the front surface S1 side of the screen 10.

For example, as shown in FIG. 1, it is assumed that an image of a face is displayed on the screen 10. In this case, the control light 2 is irradiated to a region (the iris of the eye, eyebrows, etc.) where display of black or the like is specified, for example. This makes it possible to display the iris of the eye, eyebrows, etc. in the black area 3 with suppressed black luminance. Further, for example, the image light 1 is irradiated onto an area where color display is designated (lips, skin, etc.), and a color image is displayed. Therefore, an image including a black area 3 displayed by the control light 2 and a color image displayed by the image light 1 is displayed on the screen 10. As a result, it becomes possible to realize a color display with a wide brightness range and high contrast.

As shown in FIG. 1, the image projection section 20 includes a light source device 21, an intensity adjustment section 22, an image generation optical system 23, a projection optical system 24, a light branching section 25, an imaging device 26, and a controller 27. In this embodiment, the image projection unit 20 is configured as a scanning projector that displays an image by scanning a modulated light beam.

The light source device 21 is a light source that emits light that becomes the control light 2 and the image light 1, and includes a first light source 30 and a second light source 31. In this embodiment, the light source device 21 corresponds to a light source section.

The first light source 30 emits first emitted light that becomes the control light 2 . As described above, the control light 2 is light in a different wavelength range from the image light 1 (RGB light), and is, for example, ultraviolet (UV) or infrared (IR) light. Therefore, the first light source 30 is configured to emit light other than RGB as the first emitted light.

As the first light source 30, a solid-state light source such as a semiconductor laser (LD) or a light emitting diode (LED) is used, for example. Further, for example, a halogen lamp, a metal halide lamp, a xenon lamp, a krypton lamp, a metal halide lamp, a sodium lamp, an HID lamp, or the like may be used as the first light source 30.

The second light source 31 emits second emitted light that becomes the image light 1. In the example shown in FIG. 1, a red light source 31R that emits red light R, a green light source 31G that emits green light G, and a blue light source 31B that emits blue light B are used as the second light source 31. The RGB light emitted from these light sources 31R to 31B becomes second emitted light.

The red light source 31R, the green light source 31G, and the blue light source 31B (second light source 31) are each configured using, for example, a solid-state light source such as a semiconductor laser (LD) or a light emitting diode (LED). The specific configuration of the second light source 31 is not limited, and any light source capable of emitting RGB light may be used.

The intensity adjustment unit 22 adjusts the output of each light source included in the light source device 21. For example, the intensity adjustment section 22 includes a power unit (light source driver) and the like connected to each of the first light source 30, red light source 31R, green light source 31G, and blue light source 31B. Therefore, it can be said that the intensity adjustment section 22 adjusts the intensity of the first emitted light, the red light R, the green light G, and the blue light B.

The image generation optical system 23 is an optical system that generates the control light 2 and the image light 1 from the first output light and the second output light, respectively. In this embodiment, the image generation optical system 23 functions as a scanning mechanism that scans the first outgoing light and the second outgoing light emitted from the light source device 21. As the image generation optical system 23, a scanning mechanism such as a MEMS (Micro Electro Mechanical System), a DMD (Digital Mirror Device), or a galvano mirror is used, for example.

In this embodiment, the control light 2 and the image light 1 are each generated based on information on an image displayed on the screen 10 (hereinafter referred to as image data). The image data is data that specifies, for example, the RGB values of each pixel included in the image. The format of the image data is not limited, and any image data for still images or moving images may be used. In this embodiment, image data corresponds to image information.

For example, the intensity adjustment unit 22 adjusts the output of the first light source 30 according to the black level (luminance value, etc.) representing the brightness of the black color of each pixel, and modulates the intensity of the first emitted light in a time-division manner. Ru. In addition, the output of each RGB light source 31R to 31B (second light source 31) is adjusted according to the RGB value of each pixel, and the intensity of each RGB light (second emitted light) is modulated in a time-division manner. . The first emitted light whose intensity is modulated in a time-division manner and each of the RGB lights are emitted, for example, as a single light beam along the same optical path.

The first emitted light and the light beam including each of the RGB lights are scanned by the scanning mechanism of the image generation optical system 23 so that the light corresponding to each pixel is emitted to an appropriate position. As a result, the image generation optical system 23 emits control light 2 and image light 1 for displaying an image represented by image data. As shown in FIG. 1, the control light 2 and the image light 1 emitted from the image generation optical system 23 are guided along a common optical path 32 and enter the projection optical system 24 at the subsequent stage.

In this way, the intensity adjustment unit 22 and the image generation optical system 23 modulate the first emitted light to generate the control light 2 and modulate the second emitted light based on the input image data. Image light 1 is generated. By using the control light 2 and the image light 1, it is possible to display an image at a predetermined frame rate, for example. In this embodiment, the generation unit is realized by the intensity adjustment unit 22 and the image generation optical system 23 working together.

The projection optical system 24 emits the control light 2 and the image light 1 guided along the common optical path 32 along the optical axis O. As shown in FIG. 1, in this embodiment, the screen 10 and the image projection unit 20 are arranged so that the optical axis O of the projection optical system 24 intersects the screen 10. In this embodiment, the optical axis O corresponds to a predetermined axis, and the projection optical system 24 corresponds to an output optical system.

The projection optical system 24 is configured using, for example, a predetermined lens system for projecting the control light 2 and the image light 1, and is an optical system that enlarges and projects the control light 2 and the image light 1 onto the screen 10. The specific configuration of the projection optical system 24 is not limited, and may be configured as appropriate depending on the size of the screen 10, the arrangement position of the image projection unit 20, and the like. Further, an optical system having a focal position adjustment mechanism, a zoom function, etc. may be used.

In this way, the control light 2 and image light 1 generated by the light source device 21, the intensity adjustment section 22, and the image generation optical system 23 are irradiated onto the screen 10 by the projection optical system 24. In this embodiment, the light source device 21, the intensity adjustment section 22, the image generation optical system 23, and the projection optical system 24 constitute an irradiation section that can irradiate a screen with predetermined light and image light.

The light branching unit 25 is arranged on a common optical path 32 between the image generation optical system 23 and the projection optical system 24, and branches the light from the screen 10 that has passed through the projection optical system 24. As the beam branching section 25, for example, an optical element such as a half mirror, a beam splitter, or a dichroic mirror is used. Note that the light from the screen 10 includes, for example, the control light 2 and the image light 1 reflected by the screen 10, external light incident through the screen 10, infrared rays (radiant light) emitted from the screen 10, etc. included. In this embodiment, the beam branching section corresponds to 25, the branching section.

In this embodiment, as will be described later, of the light from the screen 10, radiation in the infrared region is referred to. The light branching unit 25 is configured to selectively branch, for example, desired radiation light in an infrared region. Further, the beam branching section 25 is configured to allow the control light 2 and the image light 1 to pass therethrough, for example. This makes it possible to accurately extract infrared light emitted from the screen 10 while suppressing the influence on the control light 2 and the image light 1.

The imaging device 26 photographs the state of the screen 10 irradiated with the control light 2 and the image light 1. That is, it can be said that the imaging device 26 detects the state of the screen 10 by photographing the screen 10 on which an image is displayed. As shown in FIG. 1, the light from the screen 10 is branched by a beam splitter 25 and then enters an imaging device 26. The imaging device 26 photographs the state of the screen 10 based on the light branched by the beam branching section 25 . In this embodiment, the imaging device 26 corresponds to an imaging unit.

In this embodiment, the imaging device 26 photographs the temperature distribution of the screen 10 as the state of the screen 10. The temperature distribution of the screen 10 is photographed, for example, by detecting infrared rays (radiant light) emitted from the screen 10. Therefore, the temperature distribution on the screen 10 is obtained as a three-dimensional measurement value representing the temperature at each coordinate position on the screen 10 corresponding to each coordinate position of the video signal projected onto the screen 10. Here, the three-dimensional measurement value is data expressed by three components including, for example, two-dimensional coordinates (X, Y) and the intensity of infrared rays (Z component) at each coordinate position.

Each data point included in the temperature distribution can be associated with each pixel of the image displayed on the screen 10. This makes it possible, for example, to refer to the temperature of the screen 10 at the display position of a certain pixel.

Further, in this embodiment, the light irradiated onto the screen 10 and the light from the screen 10 pass through the same optical system (projection optical system 24). Thereby, for example, the optical axis of the light irradiated onto the screen 10 and the optical axis of the light from the screen 10 can be made coaxial. As a result, it is possible to sufficiently avoid misalignment between the irradiation range of the control light 2 and the image light 1 and the photographing range of the imaging device 26. As a result, it becomes possible to accurately associate each data point of the temperature distribution with each pixel on the screen 10, and it becomes possible to accurately detect the temperature at the display position of each pixel on the screen 10.

The emitted light from the screen 10 can be detected using, for example, a filter (IR filter) that absorbs visible light and transmits infrared rays. As the imaging device 26, an infrared camera or the like is used, which is a combination of an image sensor such as a CMOS (Complementary Metal-Oxide Semiconductor) sensor or a CCD (Charge Coupled Device) sensor, and an IR filter.

The controller 27 controls the operation of each block included in the image projection section 20. The controller 27 has a hardware configuration necessary for a computer, such as a CPU and memory (RAM, ROM). The image display method according to the present technology is executed by the CPU loading a program stored in advance in a ROM or the like into a RAM and executing it.

As the controller 27, a device such as a PLD (Programmable Logic Device) such as an FPGA (Field Programmable Gate Array), or another ASIC (Application Specific Integrated Circuit) may be used.

In this embodiment, the comparison unit 28 as a functional block is configured by the CPU executing a predetermined program. In addition, the controller 27 includes functional blocks and the like that execute various processes for operating the image projection section 20 as appropriate. The program is installed in the controller 27 via various recording media, for example. Alternatively, the program may be installed via the Internet or the like.

The comparison unit 28 controls the irradiation intensity of the control light 2 by comparing the temperature distribution of the screen 10 and the image data of the next displayed image. Here, the image to be displayed next is an image to be displayed in the frame following the current frame, for example, in image display performed at a predetermined frame rate.

In this embodiment, the comparator 28 calculates a corrected intensity distribution in which the irradiation intensity of the control light 2 specified by the image data of the next displayed image is corrected. Therefore, the corrected intensity distribution becomes data specifying the irradiation intensity of the control light 2 for displaying the next image (next frame). From another perspective, it can be said that the corrected intensity distribution is a control value for controlling the irradiation intensity of the control light 2.

The calculated corrected intensity distribution is input to the intensity adjustment section 22 described above. Then, the output of the first light source 30 (the intensity of the first emitted light) is modulated by the intensity adjustment section 22 based on the corrected intensity distribution. This makes it possible to irradiate the control light 2 toward the screen 10 with an irradiation intensity that corresponds to the temperature distribution of the screen 10.

In this way, the comparison unit 28 controls the intensity of the control light 2 applied to the screen 10 according to the state of the screen 10 that is photographed. In this embodiment, the comparison section 28 corresponds to a control section. The operation of the comparing section 28 will be explained in detail later using FIG. 10 and the like.

[Display control by image display device]
FIG. 4 is a flowchart illustrating an example of display control by the image display device 100. FIG. 5 is a block diagram showing a processing flow of display control by the image display device 100. In FIG. 5, illustration of the image generation optical system 23 and the projection optical system 24 shown in FIG. 1 is omitted.

The display control shown in FIGS. 4 and 5 is, for example, a loop process that is repeatedly executed while the image projection unit 20 is operating. This loop processing is executed, for example, at the start and end of image display. Alternatively, a mode for executing display control, etc. may be selected, and whether or not to execute loop processing may be switched.

In this embodiment, as shown in FIG. 5, the output of the imaging device 26 is fed back to the comparison unit 28, and the irradiation intensity of the control light 2 is controlled. Therefore, it can be said that the display control shown in FIGS. 4 and 5 is feedback control for the control light 2. Further, this feedback control is executed for each frame displayed at a predetermined frame rate, for example. Therefore, the repetition frequency of the loop process is the same as the frame rate of image display.

Note that the first loop process is started in a state where, for example, feedback to the control light 2 is not being executed. Further, the second and subsequent loop processes are started in a state in which feedback of the control light 2 has been executed by the loop process executed immediately before. In either case, it is possible to appropriately implement feedback control.

First, the temperature distribution of the screen 10 is photographed by the imaging device 26 (step 101). For example, light that enters the image projection section 20 from the screen 10 via the projection optical system 24 is branched by the beam branching section 25 and enters the imaging device 26 (infrared camera). In the imaging device 26, infrared light contained in the light from the screen 10 is detected by an image sensor or the like, and the temperature distribution of the screen 10 is photographed. In FIG. 5, the light from the screen 10 that is split by the light beam splitter 25 and enters the imaging device 26 is schematically illustrated by dotted lines.

Photographing of the screen 10 is performed while an image is displayed on the screen 10. That is, the temperature distribution of the screen 10 is photographed while the screen 10 is irradiated with the control light 2 and the image light 1. Below, the image data of the image displayed at the timing when the temperature distribution of the screen 10 was photographed will be referred to as first image data.

FIG. 6 is a schematic diagram showing an example of image data. FIG. 6 schematically shows image data 40 that displays a face image in the center of a rectangular display range. This image data 40 is data of a face image displayed on the screen 10 shown in FIG.

In the following, the image data 40 shown in FIG. 6 will be described as first image data 40a that was used when the screen 10 was photographed. Note that when the screen 10 is photographed at another timing, other image data 40 different from the image data 40 shown in FIG. 6 becomes the first image data 40a.

For example, the first image data 40a includes a pixel designated as black (black pixel 41). For example, pixels representing the iris of the eye, eyebrows, etc. are examples of the black pixel 41. Control light 2 for displaying the black pixel 41 is generated based on information on the black pixel 41 (black level and pixel position). As a result, a black area 3 is displayed in the area on the screen 10 that is irradiated with the control light 2, that is, in the area where the black pixels 41 are projected (see FIG. 1).

Further, for example, the first image data 40a includes pixels (color pixels 42) designated with a color other than black. For example, pixels representing lips, skin, etc. are examples of the color pixels 42. Image light 1 for displaying the color pixel 42 is generated based on the information (RGB values and pixel position) of the color pixel 42 and is irradiated toward the screen 10 . As a result, it becomes possible to display, for example, a face image in full color.

Note that in the first image data 40a, a diagonally shaded area is an area in which a specific color is not specified (hereinafter referred to as a transparent area 43). The transparent area 43 is an area where a display color such as black and white or color is not specified, and is an area where, for example, the control light 2 and the image light 1 are hardly irradiated.

FIG. 7 is a schematic diagram showing an example of the temperature distribution of the screen 10. In FIG. 7, a temperature distribution 44 of the screen 10 on which an image using the first image data 40 shown in FIG. 6 is displayed is schematically illustrated using gray scale. Note that the darker the gray scale density, the higher the temperature.

As described above, the control light 2 such as ultraviolet UV or infrared IR is irradiated onto the black area 3 on the screen 10 in which the iris of the eye, eyebrows, etc. are displayed. For example, when part of the light energy supplied to the black area 3 is absorbed by the screen 10 as thermal energy, the temperature of the black area 3 increases. As a result, as shown in the temperature distribution 44, a relatively high temperature may be detected in the pixel corresponding to the black area 3.

Also, in the area on the screen 10 that is irradiated with the image light 1, which is visible light (the area corresponding to the outline of the face), the energy of the image light 1 is absorbed as thermal energy, and the temperature may increase. Furthermore, for example, temperature distribution may occur over the entire screen 10 due to the accumulation of heat associated with previous image display.

In addition to this, for example, temperature irregularities may occur due to the outside air temperature at the location where the screen 10 is placed (for example, air blowing from an air conditioner, etc.). It is also conceivable that the temperature of the screen 10 changes when a user or the like touches the screen 10. In this way, the temperature distribution 44 of the screen 10 includes information such as the temperature caused by the currently displayed display image (control light 2 and image light 1), the temperature of the outside environment, and the temperature caused by contact with hands, fingers, etc. included.

Returning to FIG. 4, when the temperature distribution of the screen 10 is photographed, the comparator 28 calculates the corrected intensity distribution of the control light 2 (step 102). As shown in FIG. 5, the comparison unit 28 receives a three-dimensional measurement value, which is the temperature distribution 44 of the screen 10, and second image data, which is the image data 40 following the first image data 40a. .

FIG. 8 is a schematic diagram showing another example of the image data 40. In the following, the image data 40 shown in FIG. 8 will be described as second image data 40b used next to the first image data 40a shown in FIG. The second image data 40b differs from the first image data 40a in the position of the iris and the shape of the eyebrows. Therefore, in the next image to be displayed, the irradiation position, irradiation intensity, etc. of the control light 2 will be changed.

In this embodiment, depending on the state of the screen 10 irradiated with the control light 2 and the image light 1 generated based on the first image data 40a, the image data 40 is the next image data 40 after the first image data 40a. The irradiation intensity of the control light 2 specified by the second image data 40b is corrected. Specifically, in accordance with the temperature distribution 44 of the screen 10 photographed in step 101, a corrected intensity distribution is calculated by correcting the irradiation intensity of the control light 2 specified by the second image data 40b.

FIG. 9 is a schematic diagram showing a configuration example of three-dimensional data representing the temperature distribution 44 of the screen 10. FIG. 10 is a schematic diagram for explaining the calculation process of the corrected intensity distribution. The calculation process of the corrected intensity distribution 47 will be described below with reference to FIGS. 9 and 10.

FIG. 9 shows three-dimensional data representing the temperature distribution 44. The three-dimensional data includes a plurality of data points 45 arranged along the vertical and horizontal directions, and the measured temperature of each point on the screen 10 corresponding to each data point 45 (pixel) (the magnitude of the temperature is measured (equivalent to the value) etc. are stored. That is, the temperature distribution 44 can be regarded as three-dimensional image data in which the temperature at each point on the screen 10 is recorded.

For example, a point on the screen 10 corresponding to a data point 45 (pixel with deep data) where a high value is recorded is a point with a high temperature. Conversely, a point on the screen 10 corresponding to a data point 45 (pixel with shallow data) where a low value is recorded is a point with a low temperature.

Each data point 45 included in the temperature distribution 44 is associated with each pixel of the image displayed on the screen 10. In the following, it is assumed that a pixel I(x,y) of the image data 40 corresponds to a data point T(x,y) of the temperature distribution 44. That is, the temperature recorded at the data point T(x,y) represents the temperature at the position where the pixel I(x,y) is displayed. Note that x is an index representing the position of a data point in the horizontal direction in the figure, and y is an index representing the position of a data point in the vertical direction in the figure.

Such correspondence can be realized by, for example, using an imaging device 26 having the same resolution as the image data 40 and aligning the imaging device 26 appropriately. Note that the correspondence is not limited to one-to-one correspondence between each pixel and each data point, and correspondence using any method is possible. For example, a plurality of pixels adjacent to each other may be associated with one data point. Further, for example, the correspondence between pixels and data points, that is, the correspondence between the image data 40 and the temperature distribution 44 may be executed using convolution, filter processing, or the like.

The upper left diagram in FIG. 10 is a schematic diagram showing the temperature distribution 44 of the screen 10 in the partial area 46 shown in FIG. 9, and the darker the gray scale, the higher the temperature. The partial area 46 is composed of a 5×5 block of data points 45. Below, the lower left data point 45 of the temperature distribution 44 will be described as T(1,1). Therefore, for example, the upper left data point 45 of the temperature distribution 44 becomes T(1,5).

The upper right diagram in FIG. 10 is a schematic diagram showing data of the current display image (first image data 40a) that was displayed in the partial area 46 at the timing when the temperature distribution 44 was photographed. In the first image data 40a, the darker the gray scale, the lower the black luminance, that is, the darker the color. Further, the pixel I _a (x, y) of the first image data 40 a is associated with the data point T (x, y) of the temperature distribution 44 . That is, the lower left pixel I _a (1,1) of the first image data 40a corresponds to the data point T(1,1) of the temperature distribution 44.

The lower right diagram in FIG. 10 is a schematic diagram showing data of the next display image (second image data 40b) to be displayed in the partial area 46, and represents a state in which the darker the gray scale, the lower the black luminance. The pixel I _b (x,y) of the second image data 40b is associated with the data point T(x,y) of the temperature distribution 44.

The lower left diagram in FIG. 10 is a schematic diagram showing an example of the corrected intensity distribution 47 in the partial region 46. The pixel C(x,y) of the corrected intensity distribution 47 is associated with the pixel I _b (x,y) of the second image data 40b, that is, the data point T(x,y) of the temperature distribution 44. The color of each pixel C of the corrected intensity distribution 47 represents the irradiation intensity of the control light 2 (the output intensity of the first output light), and the darker the gray scale, the higher the irradiation intensity.

In the following, the irradiation position on the screen 10 where the pixel I _a (x, y) of the first image data 40a is displayed will be referred to as S(x, y). For example, T(x,y) represents the temperature of the irradiation position S(x,y) on the screen 10. Furthermore, the pixel I _b (x, y) of the second image data 40b represents the color scheduled to be displayed at the irradiation position S (x, y) at the next timing. Furthermore, a pixel C (x, y) of the corrected intensity distribution 47 represents a correction value of the irradiation intensity of the control light 2 irradiated to the irradiation position S (x, y).

For example, in the first image data 40a, black is specified as the display color of the central pixel I _a (3, 3) of the partial area 46. Therefore, the control light 2 is irradiated to the irradiation position S(3,3) where I _a (3,3) is displayed. As a result, a black area 3 is displayed at the irradiation position S (3, 3). The temperature at the irradiation position S(3,3) is detected as the measured value at the data point T(3,3) of the temperature distribution 44. As shown in FIG. 10, the data point T (3, 3) has a higher temperature than other parts due to the irradiation of the control light 2.

Furthermore, in the first image data 40, display colors are also specified for eight pixels adjacent to the center pixel I _a (3, 3). This display color has higher luminance than I _a (3,3) and is a bright color (for example, gray or another color). Therefore, the eight irradiation positions adjacent to the irradiation position S(3, 3) are irradiated with the control light 2, image light 1, etc. with low intensity. Accordingly, as shown in the temperature distribution 44, at eight data points adjacent to data point T(3,3), temperatures lower than T(3,3) and higher than other areas are detected.

Generally, in the screen 10 (light control layer 13) using a photochromic material or leuco dye, the higher the temperature, the faster the response speed of coloring and decoloring. That is, the higher the temperature of the area to which the control light 2 is irradiated, the shorter the time it takes to turn the area to black when the control light 2 is irradiated. The time it takes for the color to change to black is, for example, the time it takes for the desired black color to develop.

In this way, when displaying an image on the screen 10 including the light control layer 13, the projection screen has a temperature distribution depending on the light energy of the currently displayed image, the environmental temperature, etc., and the reaction speed varies within the plane. There may be cases where this happens.

For example, assume that each irradiation position on the screen 10 is irradiated with the control light 2 with the same intensity. In this case, the time it takes for the same black color (black luminance) to be colored is slower as the temperature of the irradiation position is lower, and faster as the temperature of the irradiation position is higher. Therefore, when the control light 2 is irradiated with a single intensity onto the screen 10 having the temperature distribution 44, there is a possibility that uneven black brightness or the like will occur depending on the temperature distribution 44.

In this embodiment, the comparison unit 28 adjusts the irradiation intensity of the control light 2 so that it is possible to appropriately color the next display image, such as black, based on the current temperature distribution 44 of the screen 10. A correction value (corrected intensity distribution 47) is calculated. Specifically, the irradiation intensity of the control light 2 irradiated onto the scheduled area 48 is corrected according to the temperature of the scheduled area 48 on the screen 10 designated as the black area 3 by the second image data 40b.

The planned area 48 is, for example, an irradiation position on the screen 10 where a black pixel 41 designated as black in the second image data 40b is displayed. For example, in the second image data 40b, the position of the iris of the face image moves from the position in the previous image. The position of the iris of the movement destination on the screen 10 becomes the planned area (see FIG. 1). Note that in FIG. 10, the same reference numerals as the planned area 48 are given to the black pixels 41 of the second image data 40b.

For example, in the second image data 40b shown in FIG. 10, the central pixel I _b (3,3) and the adjacent pixels I _b (3,4), I _b (3,2), I _b Five pixels, ie (2, 3) and I _b (4, 3), are designated as black pixels 41. These irradiation positions where the five black pixels 41 are displayed (S(3,3), S(3,4), S(3,2), S(2,3), and S(4,3)) becomes the planned area 48. In the example shown in FIG. 10, the same black luminance (black level) is set for each of the five black pixels 41.

The comparison unit 28 extracts the black pixels 41 (planned area 48) from the second image data 40b, for example, and refers to the temperature of the data point 45 corresponding to each black pixel 41. Then, the irradiation intensity of the control light 2 is corrected so that the intensity for coloring the black luminance of each black pixel 41 is satisfied.

For example, the temperature T(3,3) of the irradiation position S(3,3), which is the planned area 48, is higher than other locations. That is, at the irradiation position S (3, 3) where the central pixel I _b (3, 3) of the next display image is displayed, it is colored black in a short time. In such a case, even if the irradiation intensity of the control light 2 is set low, for example, it is possible to color the irradiation position S(3, 3) black at an appropriate timing. Therefore, for the pixel C (3, 3) of the corrected intensity distribution 47, for example, an irradiation intensity lower than the original irradiation intensity (light gray in the figure) is calculated.

For example, the temperature T(3,4) of the irradiation position S(3,4), which is the planned area 48, is lower than the temperature T(3,3) of the irradiation position S(3,3). . Therefore, at the irradiation position S (3, 4), the response speed until black coloring is slower than at the irradiation position S (3, 3). In this case, for the pixel C(3,4) of the corrected intensity distribution 47, a higher irradiation intensity (dark gray in the figure) than the irradiation intensity set for C(3,3), for example, is calculated.

Similarly, pixels C(3,2) and C(2 , 3), and C(4,3), the irradiation intensity is calculated to be higher than that of C(3,3). By setting the irradiation intensity of the control light 2 to be high in this manner, it is possible to color the desired black color in a short time even in a region where the temperature is low. That is, it becomes possible to shorten the response time of black luminance display.

As a result, five irradiation positions (S (3, 3), S (3, 4), S (3, 2), S (2, 3), and S (4, 3)), which will become the planned area 48, are set. On the other hand, it becomes possible to display the black area 3 with the same black luminance at appropriate timing. In this manner, in this embodiment, the irradiation intensity of the control light 2 is controlled according to the temperature distribution 44 of the screen 10 that is photographed.

Note that the irradiation intensity (correction value) of each pixel in the corrected intensity distribution 47 can be calculated as appropriate according to the characteristics of the light control layer 13 and the like. For example, using the response speed of the light control layer 13 at each temperature, etc., the irradiation intensity of each pixel included in the planned area 48 is calculated so that coloring is completed at a desired timing. In addition, the method of calculating the irradiation intensity of the corrected intensity distribution 47 is not limited.

Furthermore, the comparison unit 28 regulates the irradiation of the control light 2 to areas other than the planned area 48 on the screen 10 . Specifically, the correction intensity distribution 47 is calculated so that the irradiation intensity of the control light 2 is zero for areas other than the planned area 48 designated as the black area 3. In the corrected intensity distribution 47 shown in FIG. 10, pixels for which the irradiation intensity of the control light 2 is set to zero are shown in white.

For example, when the irradiation of the control light 2 to the light control layer 13 is cut off, the displayed black color is erased. That is, even if it is an area where black has been displayed up to that point, if it is an area where black will not be displayed next, it is possible to erase the black by not irradiating the control light 2. In this way, it can be said that in the corrected intensity distribution 47, the irradiation intensity of the control light 2 is corrected so that it becomes the intensity for erasing the black luminance of the currently displayed image.

Note that in this embodiment, the intensity distribution that specifies the intensity of the image light 1 (red light R, green light G, and blue light B) is calculated using the RGB values specified by the second image data 40b. Ru. This intensity distribution for the image light 1 and the corrected intensity distribution for the control light 2 are output to the intensity adjustment section 22.

Returning to FIG. 4, the intensity adjustment unit 22 controls the output of the first light source 30 based on the corrected intensity distribution 47 (step 103). For example, based on the corrected intensity distribution 47, a control value specifying the intensity of the control light 2 (first emitted light) irradiated to each irradiation position S (x, y) is set at a time relative to the first light source 30. Output in parts. Further, in step 103, the second light source 31 (red light source 31R, green light source 31G, and blue light source 31B) is appropriately controlled by the intensity adjustment unit 22 based on the intensity distribution for the image light 1.

The light source device 21 and the image generation optical system 23 emit control light 2 according to the corrected intensity distribution 47 and the next image light 1 (step 104). The emitted control light 2 and image light 1 pass through the beam branching section 25 and are irradiated from the projection optical system 24 toward the screen 10 . As a result, the image represented by the second image data 40 is displayed on the screen 10. In the next loop process, the screen 10 on which this image is displayed is photographed, and the processes from steps 101 to 104 are executed again.

In this way, by controlling the intensity of the irradiation intensity of the control light 2 in accordance with the temperature distribution 44 of the screen 10, it is possible to shorten the response time of black luminance display, for example. As a result, it becomes possible to perform black luminance display, etc. at appropriate timing, and it becomes possible to realize a display image with no afterimage and high contrast. This makes it possible to display high-quality images with excellent visibility.

As described above, in the image display device 100 according to the present embodiment, the optical characteristics of the display member 11 of the screen 10 are changed by the control light 2. The screen 10 is irradiated with control light 2 and image light 1, and the state of the screen 10 is photographed. By controlling the irradiation intensity of the control light 2 according to the state of the screen, it is possible to appropriately control, for example, the optical characteristics of the screen. As a result, it becomes possible to display a high-quality image with excellent visibility on a screen or the like.

In video display using a general projector, the brightness of the screen in the non-lighted state is black luminance. Therefore, in a bright environment where the amount of light reflected from the screen is large, the contrast of the displayed image decreases and visibility deteriorates. Particularly, in the case of a transparent screen made of a transparent glass substrate containing a scattering agent, visibility is significantly deteriorated.

For example, a method of controlling the transmittance of the screen using a screen including a TFT liquid crystal and a PDL element may be considered. In this method, the image is displayed with a pixel size defined by the TFT liquid crystal or PDL element, which may make it difficult to take advantage of the projector's characteristics of enlarging or reducing the image before projecting it. Furthermore, providing each element may increase the manufacturing cost of the screen.

Further, as a method of detecting the temperature of the screen, a method using a contact type thermometer such as a thermoelectric wire may be considered. Such temperature sensing using wiring requires multi-point measurement in order to obtain the temperature distribution on the screen. As a result, the design of the screen may be impaired by the wiring for multi-point measurement.

In this embodiment, a screen 10 whose reflectance or transmittance changes by irradiating the control light 2 is used. This makes it possible to arbitrarily change the brightness of the area that is in the non-lit state and is not irradiated with the image light 1 or the like. As a result, it becomes possible to suppress the level of black luminance, and it becomes possible to improve the contrast of the image.

The irradiation intensity of the control light 2 is controlled based on the temperature distribution of the screen 10. With this, for example, even if the temperature distribution 44 of the screen 10 is uneven due to previous image display, changes in outside temperature, user contact, etc., the display speed of black luminance, etc. can be appropriately controlled. Is possible. As a result, it becomes possible to display an image that eliminates uneven black brightness, afterimages, etc., and it becomes possible to display video content with high contrast and excellent visibility.

Further, when a transparent screen 10 is used, by displaying the black area 3, it is possible to avoid a situation where the background is seen through. This makes it possible to display images with high contrast and excellent visibility even on the transparent screen 10.

The light control layer 13, whose optical properties (transmittance and reflectance) change according to the irradiation of the control light 2, is made of a photochromic material, a leuco dye, or the like. Thereby, it is possible to display an appropriate image regardless of the irradiation range of the image light 1 and the control light 2, and it is possible to easily realize enlargement/reduction of the image. Further, since there is no need to provide wiring or the like on the screen 10, it is possible to easily configure screens 10 of various shapes and sizes while suppressing the manufacturing cost of the screen 10.

In this embodiment, the temperature distribution 44 is photographed as the state of the screen 10 using the imaging device 26. In this way, by using optical means, it is possible to detect the temperature distribution 44 of the screen 10 in detail without impairing the design of the screen 10.

Further, the imaging device 26 photographs the screen 10 through a projection optical system common to the control light 2 and the image light 1. This makes it possible to suppress misalignment between the temperature distribution 44 and the image data 40, etc., and to realize the correspondence between the data points of the temperature distribution 44 and the pixels of the image data 40 with high precision. As a result, it becomes possible to sufficiently improve the control accuracy of the control light 2. Moreover, by using such an arrangement, it becomes possible to configure the image projection section 20 in a small size.

<Second embodiment>
An image display device according to a second embodiment of the present technology will be described. In the description that follows, the description of parts similar to the configuration and operation of the image display device 100 described in the above embodiment will be omitted or simplified.

FIG. 11 is a schematic diagram showing a configuration example of an image display device according to the second embodiment. Image display device 200 includes a screen 210 and an image projection section 220. Screen 210 is configured similarly to screen 10 shown in FIG. 1, for example. That is, the screen 210 has a characteristic that its transmittance or reflectance changes depending on the irradiation of the control light 2.

The image projection section 220 includes a light source device 221 , an intensity adjustment section 222 , an image generation optical system 223 , a projection optical system 224 , a light branching section 225 , an imaging device 226 , and a controller 227 . The intensity adjustment section 222, the image generation optical system 223, and the projection optical system 224 are configured in the same manner as the intensity adjustment section 22, the image generation optical system 23, and the projection optical system 24 shown in FIG. 1, for example.

In this embodiment, the light source device 221 includes a second light source 31 including a red light source 31R, a green light source 31G, and a blue light source 31B. Therefore, it can be said that the light source device 221 has a configuration in which the first light source 30 is removed from the light source device 21 shown in FIG. 1, for example. In this embodiment, the RGB light emitted from the light sources 31R to 31B becomes the second emitted light (image light). Note that the light source device 221 may include a light source (first light source) that emits control light. Furthermore, for example, a light source that emits control light or the like may be used separately from the light source device 221.

The light branching unit 225 is arranged on the common optical path 32 between the image generation optical system 223 and the projection optical system 224, and branches the light from the screen 210 that has passed through the projection optical system 224. As the beam branching section 225, for example, an optical element such as a half mirror, a beam splitter, or a dichroic mirror is used.

In this embodiment, visible light (RGB light) of the light from the screen 210 is branched by the light branching unit 225 . The transmittance of the beam branching section 225 is set, for example, so that the brightness of the displayed image by the image light 1 does not decrease significantly. Further, the intensity of the branched visible light is set to an arbitrary transmittance so that the intensity of the branched visible light is such that the luminance distribution can be photographed by the subsequent visible light camera (imaging device 226). The specific configuration of the light beam splitter 225 is not limited, and may be appropriately configured using, for example, a multilayer reflective film, an antireflection film, or the like.

The imaging device 226 photographs the state of the screen 210 based on the light from the screen 210 that is branched by the beam branching section 225 . In this embodiment, the brightness distribution of the screen 210 is photographed as the state of the screen 210. The brightness distribution 50 is, for example, a distribution of brightness of visible light emitted from the screen 210, and is an image of the screen 210 when the screen 210 is photographed using visible light.

As the imaging device 226, for example, a visible light camera equipped with an image sensor such as CMOS or CCD is used. A visible light camera is capable of capturing color images, for example. Therefore, the brightness distribution 50 is the intensity distribution of the red light R, green light G, and blue light B emitted from the screen 210. Note that the present technology is applicable even when a visible light camera or the like that takes monochrome images is used.

FIG. 12 is a schematic diagram showing an example of the brightness distribution of the screen 210. In FIG. 12, the brightness distribution 50 of the screen 210 on which an image using the first image data 40a shown in FIG. 6 is displayed is schematically illustrated using gray scale. In reality, the brightness distribution 50 becomes a color image including brightness values of each color of RGB light.

As shown in FIG. 12, the brightness distribution 50 includes the currently displayed image. This is an image caused by return light generated when, for example, light diffusely reflected by the display layer of the screen 210 enters the projection optical system 224.

Furthermore, the brightness distribution 50 includes other images (such as reflections) that are different from the image caused by the returned light. For example, when a transparent screen 210 or the like is used, background light transmitted through the screen 210 is detected as the brightness distribution 50. Further, illumination light around the environment in which the screen 210 is installed, other external light, etc. may be reflected by the screen 210 and detected. In this way, by photographing the brightness distribution 50 of the screen 210, it is possible to obtain information regarding the actual image displayed on the screen 210.

Returning to FIG. 11, the controller 227 is a computer that controls the operation of the image projection section 220, and has a comparison section 228 as a functional block. In this embodiment, the comparison unit 228 controls the irradiation intensity of the image light 1 according to the state of the screen 210 that is photographed. Specifically, the irradiation intensity of the image light 1 is controlled by comparing the brightness distribution 50 of the screen 210 and the image data of the next displayed image (second image data 40a).

The comparison unit 228 calculates a corrected intensity distribution of the image light 1 by correcting the irradiation intensity of the image light 1 specified by the second image data 40a based on the brightness distribution 50. Note that the corrected intensity distribution of the image light 1 includes a corrected intensity distribution for red light R, a corrected intensity distribution for green light G, and a corrected intensity distribution for blue light B. In the following, the corrected intensity distribution of each color light of RGB will be collectively referred to as a corrected color distribution.

The corrected color distribution is data specifying the irradiation intensity of the image light 1 for displaying the next image (next frame). From another perspective, it can be said that the corrected color distribution is a control value for controlling the irradiation intensity of each RGB color light included in the image light 1.

The calculated corrected color distribution is input to the intensity adjustment section 222. Then, the intensity adjustment unit 222 modulates the output of the second light source 31 (red light source 31R, green light source 31G, blue light source 31B) based on the corrected color distribution. This makes it possible to irradiate the image light 1 toward the screen 210 with an irradiation intensity that corresponds to the brightness distribution of the screen 210. In this way, the comparison unit 228 controls the irradiation intensity of the image light 1 according to the luminance distribution of the photographed image.

FIG. 13 is a block diagram showing a processing flow of display control by the image display device 200. Display control by the image display device 200 is a loop process executed by feeding back the output of the imaging device 226 to the comparison unit 228, as shown in FIG.

First, the imaging device 226 photographs the brightness distribution 50 of the screen 210 on which the current display image represented by the first image data 40a is displayed. The photographed luminance distribution 50 of the screen 210 is input to the comparison unit 228 as a three-dimensional measurement value. At this time, the second image data 40, which is the image data 40 of the next display image, is input to the comparison unit 228.

In the present embodiment, the comparison unit 228 determines whether the image data 40 next to the first image data 40a is selected based on the state of the screen 210 irradiated with the image light 1 generated based on the first image data 40a. The irradiation intensity of the image light 1 specified by a certain second image data 40b is corrected. That is, the comparator 228 calculates a corrected color distribution in which the irradiation intensity of the image light 1 is corrected. In calculating the corrected color distribution, for example, the RGB values of each pixel included in the second image data 40b are corrected.

For example, white light (ceiling lighting, etc.) may be reflected on the screen 210. In the area where white light is reflected, the brightness of the white light is added to the brightness of the displayed image, which may make it difficult to properly represent the color, brightness, etc. of the displayed image.

In this case, the comparison unit 228 increases, for example, the brightness of the pixels displayed in the area where the white light is reflected (reflection area). That is, among the pixels included in the second image data 40b, the intensity of each RGB color light is increased at the same rate for the pixels included in the reflection area. For example, such a corrected color distribution is calculated. This makes it possible to precisely express the colors of the next display image even in bright areas where white light is reflected.

For example, it is conceivable that the color of the irradiated image light 1 and the color of the reflected image may be mixed. In this case, a corrected color distribution is calculated in which the RGB values of each pixel are corrected so that the color of the pixel displayed in the reflection area is properly displayed. This makes it possible to appropriately display the color of the next display image even in a region where other colors are superimposed.

In addition, the method of calculating the corrected color distribution based on the luminance distribution 50 is not limited. For example, by comparing the first image data 40a and the brightness distribution 50, it is possible to extract the reflected image. A corrected color distribution may be calculated based on this extracted image. Further, for example, reflection within the brightness distribution 50 is determined using machine learning or the like, and a corrected color distribution is calculated based on the determination result. For example, such processing may be executed.

The calculated corrected color distribution of the image light 1 is output to the intensity adjustment section 222. The intensity adjustment unit 222 controls the output of each of the second light sources 31, such as the red light source 31R, green light source 31G, and blue light source 31B, based on the corrected color distribution. Image light 1 corresponding to the corrected color distribution is emitted from the light source device 221 and the image generation optical system 223.

In this way, the intensity of the irradiation intensity of the image light 1, the ratio of each color of RGB, etc. are controlled in accordance with the brightness distribution 50 of the screen 210. As a result, even if the brightness of the display image is uneven within the screen 210 due to the background transmitted through the projection screen or the surrounding illumination of the installation environment, the colors of the display image can be displayed appropriately. becomes possible. This makes it possible to display a high-quality image with excellent visibility on the screen 210.

Note that when the light source device 221 is provided with a first light source, the intensity of the control light is adjusted according to the flowchart described with reference to FIG. 4 and the like. For example, the comparison unit 228 calculates an intensity distribution specifying the intensity of the control light based on the second image data 40b. The output of the first light source is controlled based on this intensity distribution for control light. Thereby, it is possible to display an image with high contrast while appropriately displaying the colors of the displayed image.

<Third embodiment>
FIG. 14 is a schematic diagram showing a configuration example of an image display device according to the third embodiment. In this embodiment, the irradiation intensity of the control light 2 and the image light 1 to the screen 310 is controlled according to the temperature distribution and brightness distribution of the screen 310.

The image display device 300 includes a screen 310 whose optical characteristics change depending on the control light 2 and an image projection section 320. The image projection section 320 includes a light source device 321, an intensity adjustment section 322, an image generation optical system 323, and a projection optical system 324. The light source device 321, the intensity adjustment section 322, the image generation optical system 323, and the projection optical system 324 are similar to the light source device 21, the intensity adjustment section 22, the image generation optical system 23, and the projection optical system 24 shown in FIG. 1, for example. configured.

The image projection unit 320 also includes an infrared branching unit 325a, a first imaging device 326a, a visible light branching unit 325b, a second imaging device 326b, and a controller 327 (comparison unit 328). As shown in FIG. 14, the infrared branching section 325a and the visible light branching section 325b are arranged in the optical path (common optical path 32 of the control light 2 and the image light 1) between the image generation optical system 323 and the projection optical system 324, respectively. be done. Note that the order in which the infrared branching section 325a and the visible light branching section 325b are arranged is not limited.

The infrared branching section 325a branches infrared light out of the light from the screen 310 that has passed through the projection optical system 324. The first imaging device 326a is, for example, an infrared camera, and photographs the temperature distribution of the screen 310 by photographing the infrared rays branched by the infrared branching section 325a. The infrared branching section 325a and the first imaging device 326a are configured similarly to the beam branching section 25 and the imaging device 26 shown in FIG. 1, for example.

The visible light branching section 325b branches visible light out of the light from the screen 310 that has passed through the projection optical system 324. The second imaging device 326b is, for example, a visible light camera, and photographs the brightness distribution of the screen 310 by photographing the infrared rays branched by the visible light branching section 325b. The visible light branching unit 325b and the second imaging device 326b are configured in the same manner as the light branching unit 225 and the imaging device 226 shown in FIG. 11, for example.

The comparison unit 328 controls the irradiation intensity of the control light 2 according to the temperature distribution of the screen 310 that is photographed. For example, a corrected intensity distribution is calculated by correcting the irradiation intensity of the control light 2 specified by the image data 40 (second image data 40b) of the next display image (see FIGS. 4, 5, etc.). Furthermore, the comparison unit 328 controls the irradiation intensity of the image light 1 according to the luminance distribution of the screen 310 that is photographed. For example, a corrected color distribution is calculated by correcting the irradiation intensity of the image light 1 specified by the second image data 40b (see FIG. 13, etc.).

In this manner, in this embodiment, the irradiation intensities of the control light 2 and the image light 1 are controlled using the corrected intensity distribution of the control light 2 and the corrected color distribution of the image light 1. Thereby, even if there is temperature unevenness, brightness unevenness, etc. within the plane of the screen 310, it is possible to display a uniform image on the screen 310, and the display quality can be improved. Moreover, it becomes possible to display a high-contrast image in appropriate colors, and it becomes possible to sufficiently improve the visibility of the image.

<Fourth embodiment>
FIG. 15 is a schematic diagram showing a configuration example of an image display device according to the fourth embodiment. In the above embodiments, front-type screens 10, 210, and 310 were used. In this embodiment, a rear type screen 410 is used. The image display device 400 includes a rear-type screen 410 and an image projection section 420.

In the rear type screen 410, as shown in FIG. 15, an image is displayed on the surface (rear surface S2) opposite to the surface (front surface S1) to which the control light 2 and the image light 1 are irradiated. Therefore, the user views the image from the opposite side of the image projection unit 420 across the screen 410.

The image projection section 420 is configured similarly to any of the image projection sections 20, 220, and 320 shown in, for example, FIGS. 1, 11, and 14. That is, the image projection unit 420 is configured to be able to control the irradiation intensity of at least one of the control light 2 and the image light 1 according to the temperature distribution and brightness distribution of the screen 410.

FIG. 16 is a schematic diagram showing an example of image projection onto a rear-type screen 410. The rear type screen 410 includes a light control layer 413, a protective layer 414, and a display layer 412 in this order from the front surface S1 side facing the image projection unit 420. The light control layer 413 and the protective layer 414 are configured in the same manner as the light control layer 13 and the protective layer 14 described with reference to, for example, FIG. 2 and the like.

The display layer 412 functions as a rear screen that displays an image by diffracting or refracting the incident image light 1 and emitting it to the side opposite to the side on which the image light 1 is incident. As the display layer 412, for example, a thin screen that can transmit image light, a transparent screen, a transmission hologram, or the like is used. The specific configuration of the display layer 412 is not limited, and any screen that functions as a rear screen may be used as the display layer 412.

As shown in FIG. 16, the image light 1 incident on the front surface S1 of the screen 410 passes through the light control layer 413 and the protective layer 414 and reaches the display layer 412. In the display layer 412, the image light 1, which is visible light, for example, is diffusely transmitted and emitted to the rear surface S2 side. This makes it possible to display a color image or the like on the rear surface S2 side of the screen 410.

Note that on the screen 410, a black area 3 is displayed by the control light 2 that has entered the light control layer 413 on the front side S1. This black area 3 reduces the black luminance of the screen 410 when viewed from the rear surface S2 side. Note that a configuration may be adopted in which the light control layer 413 is arranged on the rear surface S2 side of the screen 410. In this case, the control light 2 that has passed through the display layer 412 enters the light control layer 413 and the black area 3 is displayed.

Even when the rear-type screen 410 is used in this way, by appropriately controlling the irradiation intensities of the control light 2 and the image light 1 according to the temperature distribution and brightness distribution of the screen 410, it is possible to achieve high contrast and visibility. It is possible to realize high-quality image display with excellent performance.

<Fifth embodiment>
FIG. 17 is a schematic diagram showing a configuration example of an image display device according to the fifth embodiment. In this embodiment, a cylindrical screen 510 is used instead of a flat screen. The image display device 500 includes a pedestal 501, an image projection section 520, a screen 510, and a top mirror 502.

The pedestal 501 has a cylindrical shape and is provided in a lower portion of the image display device 500. As shown in FIG. 17, an image projection section 520 is provided inside the pedestal 501. Furthermore, the pedestal 501 holds the screen 510 and the top mirror 502 by an arbitrary holding mechanism (not shown). Note that the shape of the pedestal 501 is not limited, and any shape such as a rectangular parallelepiped may be used.

The image projection unit 520 is configured to fit inside the pedestal 501. The projection optical system 524 of the image projection unit 520 is arranged at the center of the pedestal 501 facing upward. The control light 2 and the image light 1 are emitted from the projection optical system 524 toward the upper side of the image display device 500 along the optical axis O. The image projection section 520 has a configuration similar to that of the image projection section 20 shown in FIG. 1, for example. Note that the specific configuration of the image projection section 520 is not limited, and for example, the image projection sections 220 and 320 shown in FIGS. 11 and 14 may be used.

The screen 510 has a cylindrical shape and is arranged all around the optical axis O. In this embodiment, the screen 510 is arranged so that the central axis of the screen 510 (cylindrical) and the optical axis O of the projection optical system 524 coincide. That is, it can be said that the screen 510 has a cylindrical shape with the optical axis O as the substantially central axis.

Note that the shape of the screen 510 is not limited. For example, a rectangular parallelepiped-shaped screen 510, a polygonal column-shaped screen 510, etc. may be used. Further, for example, the screen 510 is not limited to being arranged all around the optical axis O, and for example, a semi-cylindrical screen 510 or the like may be used. That is, the present technology is applicable to the screen 510 disposed at least partially around the optical axis O.

The screen 510 has a laminated structure in which a light control layer, a protective layer, and a display layer are laminated. For example, the cylindrical screen 510 is configured by bonding a laminated structure to a cylindrical transparent substrate or the like. The light control layer and the protective layer of the screen 510 are configured in the same manner as the light control layer 13 and the protective layer 14 described with reference to FIG. 2, for example.

The display layer of the screen 510 is configured using, for example, a diffractive optical element. A diffractive optical element (DOE) is an optical element that diffracts light. By using a diffractive optical element, it is possible to construct, for example, a transparent screen with high transparency. This makes it possible to display a full-circle image with a floating feeling, and it becomes possible to provide a highly entertaining viewing experience.

As the diffractive optical element, for example, a holographic optical element (HOE) that diffracts light using interference fringes recorded in a hologram is used. For example, it is possible to use a transmission type HOE that diffracts and transmits incident light, or a reflection type HOE that diffracts and reflects incident light (see FIG. 18).

Furthermore, the diffraction efficiency of the HOE changes depending on the angle of incidence of incident light. Therefore, by appropriately designing the HOE, it becomes possible to selectively diffract light at a predetermined angle of incidence and efficiently transmit light at other angles of incidence. This makes it possible to transmit, for example, light incident from the line of sight direction (direct view, etc.) with high efficiency, and to exhibit excellent transparency.

The specific configuration of the diffractive optical element is not limited. For example, a volume type HOE in which interference fringes are recorded inside the element, a relief type (embossed type) HOE in which interference fringes are recorded due to irregularities on the element surface, etc. may be used. In addition to diffraction using interference fringes, a diffractive optical element that diffracts light using a predetermined pattern of diffraction gratings or the like may be used.

In addition, the structure of the display layer is not limited. For example, any transparent screen may be used as the display layer. Further, for example, the present technology is applicable even when a translucent screen, a non-transparent screen, or the like is used.

The top mirror 502 has a reflective surface 503 that reflects the control light 2 and the image light 1. The top mirror 502 is arranged facing the projection optical system 524 with the optical axis O as a reference so that the reflective surface 503 faces the projection optical system 524. Therefore, the top plate mirror 502 is arranged on the optical axis O above the projection optical system 524.

The control light 2 and image light 1 reflected by the reflective surface 503 are irradiated onto a cylindrical screen 510. In other words, the top mirror 502 can be said to be an optical element that allows the control light 2 and the image light 1 emitted by the projection optical system 524 to enter the screen 510. In this embodiment, the top plate mirror 502 corresponds to an optical section.

In this embodiment, the reflective surface 503 has a shape that is rotationally symmetrical with respect to the optical axis O. Specifically, the reflective surface 503 is configured to include a rotating surface (paraboloid) obtained by rotating a curved line obtained by cutting out a portion of a parabola with the optical axis O as a reference. This paraboloid is configured such that the concave side of the parabola (the focal point side of the parabola) is the side that reflects light, and the axis of the parabola is different from the optical axis O.

For example, by appropriately setting the position, inclination, etc. of the parabola constituting the reflective surface 503, it is possible to make the angle of incidence of the reflected light (the control light 2 and the image light 1) on the screen 510 substantially constant. For example, when the screen 510 is configured using an HOE or the like, the reflective surface 503 is configured such that the incident angle of reflected light with respect to the screen 510 is an angle at which the HOE has high diffraction efficiency. This allows high-brightness image display on a transparent screen. Further, by making the incident angles the same, it is possible to sufficiently suppress uneven brightness of the image.

Note that the specific configuration of the reflective surface 503 is not limited, and for example, a reflective surface 503 that controls the incident angle of reflected light with respect to the screen 510 may be used as appropriate. For example, the reflective surface 503 may be configured using a free-form surface or the like designed using optical path simulation or the like. Furthermore, the shape of the reflective surface 503 may be designed as appropriate, for example, in accordance with the shape of the screen 510. In addition, any reflective surface 503 capable of reflecting the control light 2 and the image light 1 toward the screen 510 may be used.

FIG. 18 is a schematic diagram showing an example of image projection onto a cylindrical screen 510. On the left side of FIG. 18, an example of an optical path when a transmissive screen 510 (for example, a transmissive HOE, etc.) is used is schematically illustrated. Further, on the right side of FIG. 18, an example of an optical path when a reflective screen 510 (for example, a reflective HOE, etc.) is used is schematically illustrated.

As shown in FIG. 18, for example, the control light 2 and the image light 1 emitted from the projection optical system 524 enter the reflective surface 503 of the top mirror 502 along the optical axis O. The control light 2 and image light 1 reflected by the reflective surface 503 are irradiated onto the inside of a cylindrical screen 510.

The control light 2 irradiated onto the screen 510 is absorbed by the light control layer of the screen 510, and a black area 3 with low black luminance is displayed at the irradiation position. Further, the image light 1 irradiated onto the screen 510 is diffusely transmitted (left-hand diagram) or diffusely reflected (right-hand diagram) by the display layer 12 and emitted toward the outside of the screen 510 . This allows a user viewing the screen 510 from the outside to visually recognize the all-around image and the like.

FIG. 19 is a schematic diagram showing an example of image data 60 for the cylindrical screen 510. FIG. 20 is a schematic diagram showing an example of the temperature distribution 61 of the cylindrical screen 510. FIG. 21 is a schematic diagram showing another example of the image data 60 for the cylindrical screen 510.

When displaying an image on the cylindrical screen 510, as shown in FIGS. 19 and 21, image data 60 of an image transformed to match the shape of the screen 510 is used. In the following, the image data 60 shown in FIG. 19 will be referred to as the image data 60 of the currently displayed image (first image data 60a), and the image data 60 shown in FIG. 21 will be referred to as the image data 60 of the next displayed image ( This will be explained as second image data 60b).

For example, control light 2 and image light 1 are generated based on image data 60 shown in FIG. 19. The generated control light 2 and image light 1 are irradiated toward the screen 510 via the top mirror 502. As a result, the face image shown in FIG. 17 is displayed on one side of the cylindrical screen 510 along the curved surface of the screen 510.

With the image represented by the first image data 60a (currently displayed image) being displayed on the screen 510, the imaging device 526 executes imaging. The light from the screen 510 that enters the imaging device 526 is, for example, light that has traveled the same optical path as the light that is irradiated onto the screen 510 in the opposite direction to the irradiated light. That is, light that travels inward from each position of the screen 510 to the top mirror 502, is reflected by the top mirror 502, and enters the projection optical system 524, and enters the imaging device 526 via the beam splitter 525. do.

FIG. 20 schematically shows a temperature distribution 61 of the screen 510 on which the current display image (first image data 60a) shown in FIG. 19 is displayed. As described above, the temperature distribution 61 is photographed based on light that travels in opposite directions along the optical paths of the control light 2 and the image light 1 that are irradiated onto the screen 510. Therefore, for example, the temperature distribution on the screen 510 caused by the irradiation of the control light 2 and the image light 1 is detected as a distribution that reflects the transformed image of the first image data 60a.

In this way, by irradiating light onto the screen 510 and photographing the light from the screen 510 using a common optical system, it is possible to easily and accurately associate the image data 60 with the temperature distribution 61. It becomes possible to realize this. This makes it possible, for example, to make each pixel of the image data 60 correspond to each data point of the temperature distribution 61 on a one-to-one basis, making it possible to sufficiently improve processing speed and control accuracy.

The comparator 528 corrects the intensity specified by the second image data 60b shown in FIG. 21 based on the photographed temperature distribution 61 of the screen 510, and calculates the corrected intensity distribution of the control light 2. Based on this corrected intensity distribution, the next display image is displayed.

Note that even when the brightness distribution is photographed instead of the temperature distribution 61 (see FIG. 11), or when both the temperature distribution 61 and the brightness distribution are photographed (see FIG. 14), each photographed data and image Highly accurate correspondence with the data 60 is possible.

In this way, even when a cylindrical screen 510 or the like is used, it is possible to control the irradiation intensity of the control light 2 and the image light 1 according to the state of the screen 510 (temperature distribution 61 and brightness distribution). It is possible. This makes it possible to display high-quality all-around images with high contrast and excellent visibility, making it possible to provide high entertainment quality.

FIG. 22 is a schematic diagram showing a configuration example of a cylindrical screen 530 as a comparative example. In FIG. 22, an infrared camera 531 is provided to photograph the cylindrical screen 530 from the outside. In the configuration in which the infrared cameras 531 are installed around the outer periphery of the cylindrical screen 530, a plurality of infrared cameras 531 must be installed so as to surround the entire periphery of the cylindrical screen 530, which may increase the size of the device. Furthermore, since the members are arranged outside the main body, the design may be impaired. Further, since it is not possible to share a projection optical system for photographing, there is a possibility that a shift occurs in the positional relationship between the video signal and the screen.

In this embodiment, as shown in FIG. 17, a configuration is used in which light from the screen 510 that has passed through the projection optical system 524 is split and photographed. Thereby, it is possible to install the imaging device 526 inside the image projection unit 520 and obtain the temperature or brightness distribution of the cylindrical screen 510 with high precision. As a result, the image display device 500 can be configured compactly. Moreover, since there is no need to arrange members etc. on the outside of the device, it is possible to exhibit a high design quality.

In addition, by photographing the screen 510 through the projection optical system 524 that is common to the projected light (control light 2 and image light 1), the image data 60 and the photographed data (temperature distribution 61 and brightness distribution) can be combined. This makes it possible to achieve highly accurate positioning. This makes it possible to detect with high precision the conditions such as temperature and brightness at the position where the control light 2 and the image light 1 are irradiated, and it becomes possible to appropriately feed back the detection results. As a result, it becomes possible to significantly improve the image quality of the all-round image and the like.

<Sixth embodiment>
In this embodiment, the process of detecting the touch position of the user who has touched the screen is executed by sensing the temperature distribution of the screen in real time. Information on the detected contact position (touch data) is used, for example, as information on an operation input by the user.

In this embodiment, an image display device (see FIGS. 1, 14, 17, etc.) equipped with an imaging device (such as an infrared camera) that photographs the temperature distribution of the screen is used. Further, the controller of the image display device is provided with a contact detection section as a functional block.

The contact detection unit detects the contact position on the screen that the user has touched based on the temperature distribution of the screen photographed by the imaging device. For example, an imaging device photographs the temperature distribution at a predetermined frame rate. The contact detection unit appropriately acquires the photographed temperature distribution and detects the position on the screen where the user is touching (contact position) based on changes in the temperature distribution and the like.

FIG. 23 is a schematic diagram illustrating an example of a process for detecting a contact position on a screen. FIG. 23A is a schematic diagram showing the temperature distribution 44a of the screen 610 before the user touches it. FIG. 23B is a schematic diagram showing the screen 610 that the user's hand 5 touches. FIG. 23C is a schematic diagram showing the temperature distribution 44b of the screen 610 after being touched by the user.

As shown in FIG. 23A, when the screen 610 is photographed before being touched by the user, a state in which the temperature distribution due to the irradiation of the control light 2 and the image light 1 and the temperature distribution due to the outside air of the installation environment are overlapped is detected. Assume that the user's hand 5 contacts the screen 610 in this state as shown in FIG. 23B. In this case, it is conceivable that the temperature distribution of the screen 610 changes locally as the temperature of the user's hand 5 is transmitted.

On the screen 610 after the user has touched it, an area where the temperature of the screen 610 has suddenly increased is detected, for example, as shown in FIG. 23C. In the example shown in FIG. 23C, five areas whose temperature is higher than the surrounding area are detected. These five areas are, for example, contact areas 70 generated when the user touches the screen 610 with five fingertips.

The contact detection unit detects the occurrence of a region where the temperature locally changes (contact region 70) as shown in FIG. 23C, for example, by monitoring the temperature distribution of the screen 610. For example, an area where the change from the previous temperature distribution is larger than a predetermined threshold is detected as the contact area 70. Further, for example, the contact area 70 may be detected based on image processing using machine learning or the like. The method of detecting the contact area 70 is not limited, and any process for detecting areas where the temperature has changed may be used.

The position of this contact area 70 becomes the contact position on the screen that the user touched. For example, a position with the highest temperature within the contact area 70, a position at the center of the contact area 70, etc. are detected as the contact position. This makes it possible to detect which position on the screen 610 the user touched, that is, which part of the displayed image the user touched.

By monitoring the temperature distribution in this way, it becomes possible to easily detect the contact position (touch data) on the screen 610. By using the contact data, it becomes possible to display an image according to the user's touch action (for example, directing the user's line of sight to the touch position), and it becomes possible to configure a display device that provides interaction. This makes it possible to provide a highly entertaining viewing experience.

Furthermore, it is possible to accept operations by the user based on the contact data. For example, various operational inputs such as icon selection, keyboard input, finger gestures, etc. can be easily detected. This makes it possible to perform various operations on the screen, greatly improving operability.

<Other embodiments>
The present technology is not limited to the embodiments described above, and various other embodiments can be realized.

In the above embodiment, the irradiation intensity of the control light was controlled according to the temperature distribution of the screen. The invention is not limited to this, and the irradiation intensity of the control light may be controlled according to the brightness distribution of the screen, for example. For example, in a region where white light is strongly reflected, the irradiation intensity of the control light may be controlled so that the black luminance becomes low (the black region becomes dark). This makes it possible to maintain a low brightness level even in bright areas, and it is possible to display images with high contrast.

Further, in the above description, the irradiation intensity of the image light is controlled according to the brightness distribution of the screen, but the present invention is not limited to this, and the irradiation intensity of the image light may be controlled according to the temperature distribution of the screen, for example. By using the temperature distribution of the screen, it is possible, for example, to adjust the image light according to the degree of decolorization of the black area. For example, such processing may be executed.

In the example shown in FIG. 11, a light source device equipped with only an RGB light source (second light source) has been described. For example, a light source device equipped with only a first light source that emits ultraviolet rays, infrared rays, etc. may be used. That is, a configuration may be adopted in which only the control light is emitted from the image projection section. In this case, it is possible to display, for example, a grayscale image on the screen. Furthermore, for example, by providing another projector or the like that emits image light, it is possible to display a color image or the like. Even with such a configuration, it is possible to realize image display with high contrast and excellent visibility by controlling the intensity of the control light based on, for example, the temperature distribution of the screen. For example, such a configuration may be used.

The method for setting the area to be irradiated with control light is not limited. For example, in a gray scale, a pixel whose luminance is lower than a predetermined threshold value is defined as a black pixel, and control light is irradiated onto an area where the black pixel is displayed. This makes it possible, for example, to display a gray scale on the low luminance side using the light control layer. Furthermore, control light may be used to display pixels and the like that are designated as dark colors with low RGB values. That is, a dark color may be expressed by overlapping irradiation with image light and control light.

In the above, a scanning type projector (image projection unit) that displays an image by scanning a beam containing control light and image light has been described. The present invention is not limited to this, and for example, a projector that modulates light using a transmissive or reflective liquid crystal panel (LCD) may be used.

For example, a 3LCD type (three-panel type) projector may be used, which includes three liquid crystal panels that modulate RGB color lights, respectively, and generates image light by combining the modulated color lights. In such a projector, control light can be generated by providing another liquid crystal panel that modulates the output of the first light source. In this case, four liquid crystal panels that generate image light and control light function as a generation unit according to the present technology.

In a 3LCD projector, the irradiation intensity of control light and image light to the screen can be adjusted by each liquid crystal panel. Therefore, by controlling each liquid crystal panel using, for example, the corrected intensity distribution of the control light and the corrected color distribution of the image light, it is possible to irradiate the control light and the image light with an irradiation intensity that corresponds to the state of the screen.

In the above embodiment, the screen was photographed by the imaging device using the same optical system (projection optical system, etc.) as the light irradiated onto the screen. The configuration for photographing the screen is not limited. For example, the screen may be photographed using an imaging device placed outside the image projection unit. Even in such a case, by appropriately associating the temperature distribution and brightness distribution of the screen with the image data 40, it is possible to control the display according to the state of the screen. For example, such a configuration may be adopted.

In FIG. 17, a top mirror was used that reflects control light and image light toward a cylindrical screen. The method of projecting an image onto a cylindrical screen is not limited. For example, instead of the top mirror, an optical lens or the like may be used that refracts the light emitted from the projection optical system and causes it to enter the cylindrical screen. As the optical lens, for example, a Fresnel lens or the like is used. The present technology is applicable even to such a configuration.

It is also possible to combine at least two of the characteristic parts according to the present technology described above. That is, the various characteristic portions described in each embodiment may be arbitrarily combined without distinction between each embodiment. Further, the various effects described above are merely examples and are not limited, and other effects may also be exhibited.

Note that the present technology can also adopt the following configuration.
(1) A screen having a display member whose optical characteristics change according to irradiation with a predetermined light;
an irradiation unit capable of irradiating the screen with at least one of the predetermined light and the image light;
a photographing unit that photographs a state of the screen irradiated with at least one of the predetermined light and the image light;
An image display device comprising: a control unit that controls the intensity of at least one of the predetermined light and the image light irradiated onto the screen according to the state of the screen in which the image is taken.
(2) The image display device according to (1),
The display member has transmittance or reflectance that changes depending on irradiation with the predetermined light.
(3) The image display device according to (1) or (2),
The photographing unit photographs the temperature distribution of the screen as the state of the screen.
(4) The image display device according to (3),
The said control part controls the irradiation intensity of the said predetermined light according to the said photographed temperature distribution. Image display apparatus.
(5) The image display device according to any one of (1) to (4),
The image display device is configured such that the photographing unit photographs a luminance distribution of the screen as a state of the screen.
(6) The image display device according to (5),
The control unit controls the irradiation intensity of the image light according to the photographed luminance distribution.
(7) The image display device according to any one of (1) to (6),
The predetermined light is light in a wavelength range different from that of the image light. The image display device.
(8) The image display device according to any one of (1) to (7),
The irradiation section includes a light source section that emits at least one of a first emitted light that becomes the predetermined light and a second emitted light that becomes the image light; An image display device, comprising: a generating section that modulates the emitted light to generate the predetermined light, and modulates the second emitted light to generate the image light.
(9) The image display device according to (8),
The control unit is configured to display image information next to the first image information according to a state of the screen irradiated with at least one of the predetermined light and the image light generated based on the first image information. An image display device that corrects the irradiation intensity of at least one of the predetermined light and the image light specified by second image information.
(10) The image display device according to (9),
The display member displays a black area in an area irradiated with the predetermined light,
The control unit corrects the irradiation intensity of the predetermined light applied to the predetermined area according to the temperature of the predetermined area on the screen designated as the black area by the second image information. Image display Device.
(11) The image display device according to (10),
The control unit regulates irradiation of the predetermined light to an area other than the scheduled area on the screen.
(12) The image display device according to any one of (1) to (11),
The photographing unit photographs the temperature distribution of the screen as the state of the screen,
The image display device further includes a contact detection unit that detects a contact position on the screen that a user has touched based on the temperature distribution of the screen.
(13) The image display device according to any one of (1) to (12),
The irradiation unit includes an output optical system that guides the predetermined light and the image light along a common optical path and emits the guided predetermined light and the image light along a predetermined axis. Has an image display device.
(14) The image display device according to (13), further comprising:
comprising a branching part disposed on the common optical path and branching light from the screen that has passed through the output optical system;
The photographing unit photographs the state of the screen based on the branched light.
(15) The image display device according to (13) or (14),
the screen is arranged at least partially around the predetermined axis;
The irradiation unit includes an optical unit that allows the predetermined light and the image light emitted by the output optical system to enter the screen.
(16) The image display device according to any one of (13) to (15),
The screen is configured to have a cylindrical shape with the predetermined axis substantially as the central axis.
(17) The image display device according to any one of (1) to (16),
The display member has optical transparency for wavelengths in the visible range when viewed from the front. An image display device.
(18) The image display device according to any one of (1) to (17),
The display member includes a display layer that displays an image formed by the image light, and a light control layer whose optical characteristics change according to irradiation with the predetermined light.
(19) The image display device according to (18),
The light control layer includes a leuco dye or a photochromic material. The image display device.
(20) irradiating at least one of the predetermined light and image light onto a screen having a display member whose optical characteristics change in response to irradiation with the predetermined light;
photographing the state of the screen irradiated with at least one of the predetermined light and the image light;
An image display method in which a computer system performs the following: controlling the intensity of at least one of the predetermined light and the image light irradiated onto the screen according to the state of the screen in which the image was taken.

1... Image light 2... Control light 3... Black area 10, 210, 310, 410, 510, 610... Screen 12, 412... Display layer 13, 413... Light control layer 21... Light source device 22, 222, 322... Intensity adjustment Parts 23, 223, 323,... Image generation optical system 24, 224, 324, 524... Projection optical system 25, 225, 525... Light branching unit 325a... Infrared branching unit 325b... Visible light branching unit 26, 226, 526... Imaging Apparatus 326a...First imaging device 326b...Second imaging device 27, 227, 327...Controller 28, 228, 328, 528...Comparison unit 32...Common optical path 40, 60...Image data 40a, 60a...First Image data 40b, 60b...Second image data 44, 44a, 44b, 61...Temperature distribution 47...Corrected intensity distribution 48...Planned area 50...Brightness distribution 70...Contact area 502...Top plate mirror 100, 200, 300, 400 , 500...image display device

Claims (17)

a screen having a display member whose optical characteristics change according to irradiation with a predetermined light;
an irradiation unit that generates the predetermined light and image light and irradiates the screen based on input image information ;
a photographing unit that photographs the state of the screen irradiated with the predetermined light and the image light ;
a control unit that controls the irradiation intensity of at least one of the predetermined light and the image light to the screen according to the state of the screen in which the image was taken ;
The control unit is configured to control the predetermined light generated based on the first image information and the state of the screen to which the image light is irradiated to generate the first image information that is the next image information of the first image information. correcting the irradiation intensity of at least one of the predetermined light and the image light specified by the image information of No. 2;
The photographing unit photographs the temperature distribution of the screen as the state of the screen,
The display member displays a black area in an area irradiated with the predetermined light,
The control unit corrects the irradiation intensity of the predetermined light applied to the predetermined area according to the temperature of the predetermined area on the screen designated as the black area by the second image information.
Image display device. The image display device according to claim 1,
The display member has transmittance or reflectance that changes depending on irradiation with the predetermined light. The image display device according to claim 1 ,
The said control part controls the irradiation intensity of the said predetermined light according to the said photographed temperature distribution. Image display apparatus. The image display device according to claim 1,
The image display device is configured such that the photographing unit photographs a luminance distribution of the screen as a state of the screen. The image display device according to claim 4 ,
The control unit controls the irradiation intensity of the image light according to the photographed luminance distribution. The image display device according to claim 1,
The predetermined light is light in a wavelength range different from that of the image light. The image display device. The image display device according to claim 1,
The irradiation section includes a light source section that emits at least one of a first emitted light that becomes the predetermined light and a second emitted light that becomes the image light; an image display device, comprising: a generating section that modulates the second emitted light to generate the predetermined light, and modulates the second emitted light to generate the image light. The image display device according to claim 1 ,
The control unit regulates irradiation of the predetermined light to an area other than the scheduled area on the screen. The image display device according to claim 1, further comprising:
An image display device comprising: a contact detection unit that detects a contact position on the screen that a user has touched based on a temperature distribution of the screen. The image display device according to claim 1,
The irradiation unit includes an output optical system that guides the predetermined light and the image light along a common optical path and emits the guided predetermined light and the image light along a predetermined axis. Has an image display device. The image display device according to claim 10 , further comprising:
comprising a branching part disposed on the common optical path and branching light from the screen that has passed through the output optical system;
The photographing unit photographs the state of the screen based on the branched light. The image display device according to claim 10 ,
the screen is arranged at least partially around the predetermined axis;
The irradiation unit includes an optical unit that allows the predetermined light and the image light emitted by the output optical system to enter the screen. The image display device according to claim 10 ,
The screen is configured to have a cylindrical shape with the predetermined axis substantially as the central axis. The image display device according to claim 1,
The display member has optical transparency for wavelengths in the visible range when viewed from the front. An image display device. The image display device according to claim 1,
The display member includes a display layer that displays an image formed by the image light, and a light control layer whose optical characteristics change according to irradiation with the predetermined light. The image display device according to claim 15 ,
The light control layer is configured to include a leuco dye or a photochromic material. The image display device. a step of generating and irradiating the predetermined light and image light based on input image information to a screen having a display member whose optical characteristics change in response to irradiation with the predetermined light;
a step of photographing the state of the screen irradiated with the predetermined light and the image light ;
controlling the irradiation intensity of at least one of the predetermined light and the image light to the screen according to the state of the screen in which the image was taken;
An image display method executed by a computer system ,
In the step of controlling the irradiation intensity, the predetermined light generated based on the first image information and the state of the screen to which the image light is irradiated determine whether the next image of the first image information is correcting the irradiation intensity of at least one of the predetermined light and the image light specified by second image information that is information;
The step of photographing the state of the screen includes photographing the temperature distribution of the screen as the state of the screen;
The display member displays a black area in an area irradiated with the predetermined light,
The step of controlling the irradiation intensity includes controlling the irradiation intensity of the predetermined light applied to the predetermined area according to the temperature of the predetermined area on the screen designated as the black area by the second image information. to correct
Image display method .

Images