CN112400136A

CN112400136A - Image display apparatus and image display method

Info

Publication number: CN112400136A
Application number: CN201980047124.6A
Authority: CN
Inventors: 田中章
Original assignee: Sony Corp
Current assignee: Sony Corp
Priority date: 2018-07-20
Filing date: 2019-07-10
Publication date: 2021-02-23
Anticipated expiration: 2039-07-10
Also published as: JPWO2020017403A1; CN112400136B; JP7371627B2; WO2020017403A1

Abstract

An image display device according to an embodiment of the present technology is provided with a screen, an illumination unit, an image capturing unit, and a control unit. The screen has a display member whose optical characteristics are changed according to irradiation of predetermined light. The irradiation unit is capable of irradiating the screen with at least one of predetermined light and image light. The image capturing unit captures an image of a screen state when irradiated with at least one of predetermined light and image light. The control unit controls an irradiation intensity of at least one of predetermined light and image light on the screen according to the captured screen state.

Description

Image display apparatus and image display method

Technical Field

The present technology relates to an image display apparatus and an image display method for displaying an image on a screen or the like.

Background

Conventionally, a technique of displaying an image by irradiating a screen or the like with light has been developed. For example, patent document 1 describes an image display apparatus that illuminates a screen with backlight. In the image display apparatus, a Polymer Dispersed Liquid Crystal (PDLC) panel that diffuses backlight and a liquid crystal panel that controls backlight transmittance are used as panels (screens) that contribute to image display. Image display capable of transparent or black background display or the like is realized by controlling diffusion and transmission of backlight (paragraphs [0027], [0051], [0054], [0055], and [0055], fig. 1 and 10, and the like in the specification of patent document 1).

Reference list

Patent document

Patent document 1: WO2014/017344

Disclosure of Invention

Technical problem

Therefore, a technique of controlling image display on a screen or the like has been developed, and it is desirable to provide a technique capable of displaying a high-quality image with excellent visibility on a screen or the like.

In view of the above circumstances, an object of the present technology is to provide an image display apparatus and an image display method capable of displaying a high-quality image with excellent visibility on a screen or the like.

Solution to the problem

In order to achieve the above object, an image display apparatus according to an embodiment of the present technology includes a screen, an irradiation unit, an imaging unit, and a control unit.

The screen includes a display member that changes optical characteristics according to irradiation of predetermined light.

The illumination unit is capable of illuminating the screen with at least one of predetermined light or image light.

The imaging unit images a state of a screen irradiated with at least one of predetermined light or image light.

The control unit controls an irradiation intensity of at least one of the predetermined light or the image light to the screen according to a state of the imaged screen.

In the image display apparatus, optical characteristics of a display member of a screen are changed according to predetermined light. The screen is irradiated with predetermined light and image light, and the state of the screen is imaged. For example, by controlling the irradiation intensities of the predetermined light and the image light in accordance with such a state of the screen, the optical characteristics of the screen and the like can be appropriately controlled. As a result, a high-quality image with excellent visibility can be displayed on a screen or the like.

The display member may change transmittance or reflectance according to irradiation of predetermined light.

With this configuration, transmission or reflection of light can be controlled to change the black illuminance of the screen, and for example, image display with high contrast and excellent visibility can be achieved.

The imaging unit may image the temperature distribution on the screen as a state of the screen.

With this configuration, for example, the temperature or the like of the display member at each position can be easily detected at the same time, and image display or the like can be easily performed in accordance with the state of the display member.

The control unit may control the irradiation intensity of the predetermined light according to the temperature distribution of the imaging.

With this configuration, the optical characteristics of the display member can be controlled with high accuracy according to the temperature at each coordinate position of the video signal projected onto the screen, and high-accuracy image display using black illuminance can be achieved.

The imaging unit may image the illuminance distribution on the screen as a state of the screen.

With this configuration, the actual luminance or the like on the screen in the observation environment can be easily detected, and image display or the like can be easily performed according to the luminance at the same time.

The control unit may control the irradiation intensity of the image light according to the imaged illuminance distribution.

With this configuration, the illuminance of image light can be adjusted according to the luminance of the screen, and a decrease in image visibility due to the background of the observation environment, external light, or the like can be sufficiently suppressed.

The predetermined light may include light having a wavelength region different from that of the image light.

With this configuration, display can be performed with desired black illuminance without affecting color representation of an image to be displayed on a screen, and a high-quality image with excellent visibility can be displayed.

The irradiation unit may include: a light source unit that emits at least one of first emission light as predetermined light or second emission light as image light; and a generation unit that generates predetermined light by modulating the first emission light and generates image light by modulating the second emission light, based on the input image information.

With this configuration, the predetermined light and the image light can be generated with high accuracy. Further, by controlling the light source unit and the generation unit, the irradiation intensities of the predetermined light and the image light and the like can be controlled with high accuracy.

The control unit may correct an irradiation intensity of at least one of the predetermined light or the image light according to a state of a screen irradiated with the at least one of the predetermined light or the image light, the state of the screen being generated based on the first image information, the irradiation intensity being specified by the second image information that is the image information subsequent to the first image information.

With this configuration, the irradiation intensities of the predetermined light and the image light can be controlled so that an image to be displayed next is appropriately displayed according to the state of the screen, and sufficiently high-quality image display can be realized.

The display member may display a black region in a region to be irradiated with predetermined light. In this case, the control unit may correct the irradiation intensity of the predetermined light irradiating the planned area specified as the black area by the second image information, according to the temperature of the planned area on the screen.

With this configuration, for example, a black region of an image to be displayed next can be displayed at an appropriate timing, and a moving image or the like having high contrast and excellent visibility can be displayed with high accuracy.

The control unit may adjust the irradiation of the predetermined light to another area on the screen, which is different from the planned area.

With this configuration, for example, a black area of a previously displayed image can be quickly made colorless. As a result, an image to be displayed next can be displayed with high accuracy.

The imaging unit may image the temperature distribution on the screen as a state of the screen. In this case, the image display apparatus may further include a touch detection unit that detects a touch position on the screen touched by the user based on the temperature distribution on the screen.

With this configuration, an operation input or the like performed by the user touching the screen can be easily detected, and an intuitive interface can be easily realized.

The illumination unit may include an emission optical system that guides the predetermined light and the image light along a common optical path and emits the guided predetermined light and the guided image light along a predetermined axis.

With this configuration, the optical paths for the predetermined light and the image light, the emission optical system, and the like are made common, and the irradiation accuracy of each light can be improved. Further, the apparatus size, manufacturing cost, and the like can be reduced.

The image display apparatus may further include a branching unit that is disposed on the common light path and branches light from the screen, the light passing through the emission optical system. In this case, the imaging unit may image the state of the screen based on the branched light.

With this configuration, an image screen can be formed by using a common optical system that guides predetermined light and image light, and the apparatus size and the like can be reduced.

The screen may be disposed at least partially around the predetermined axis. In this case, the irradiation unit may include an optical unit that causes the predetermined light and the image light emitted from the emission optical system to enter the screen.

With this configuration, for example, a full-week image or the like with high visibility can be displayed on a full-week screen or the like.

The screen may be formed of a cylindrical shape having a predetermined axis as a substantially central axis.

With this configuration, for example, a full-circumference image or the like having excellent visibility can be displayed on a cylindrical full-circumference screen or the like.

The display member may transmit light having a wavelength in a visible region when viewed from the front surface of the display member.

With this configuration, a transparent screen can be configured, and high-quality image display with high contrast and excellent visibility can be realized on the transparent screen.

The display member may include: a display layer that displays an image configured by the image light; and a light control layer that changes optical characteristics according to irradiation of predetermined light.

With this configuration, for example, a screen that realizes image display with high contrast can be easily configured.

The light control layer may include a leuco dye or a photochromic material.

For example, by using these materials, a screen or the like capable of changing optical characteristics at low cost can be realized.

An image display method according to an embodiment of the present technology is an image display method executed by a computer system, the image display method including: a screen including a display member that changes optical characteristics according to irradiation of predetermined light is irradiated with at least one of the predetermined light or image light.

The state of the screen illuminated with at least one of the predetermined light or the image light is imaged.

The irradiation intensity of at least one of the predetermined light or the image light to the screen is controlled according to the state of the imaging screen.

Advantageous effects of the invention

As described above, according to the present technology, a high-quality image with excellent visibility can be displayed on a screen or the like. It should be noted that the effects described herein are not necessarily limiting, and any of the effects described in the present disclosure may be provided.

Drawings

Fig. 1 shows a schematic diagram of a configuration example of an image display device according to a first embodiment of the present technology.

Fig. 2 shows a schematic cross-sectional view of a configuration example of a screen.

Fig. 3 shows a schematic diagram of an example of an image projected onto a screen.

Fig. 4 shows a flowchart of an example of display control of the image display apparatus.

Fig. 5 is a block diagram showing a processing flow of display control of the image display apparatus.

Fig. 6 shows a schematic diagram of an example of image data.

Fig. 7 shows a schematic diagram of an example of the temperature distribution on the screen.

Fig. 8 shows a schematic diagram of another example of image data.

Fig. 9 shows a schematic diagram of a configuration example of three-dimensional data representing a temperature distribution on a screen.

Fig. 10 is a schematic diagram for describing a calculation process of the corrected intensity distribution.

Fig. 11 shows a schematic diagram of a configuration example of an image display device according to the second embodiment.

Fig. 12 shows a schematic diagram of an example of illuminance distribution on a screen.

Fig. 13 is a block diagram showing a processing flow of display control of the image display apparatus.

Fig. 14 is a schematic diagram showing a configuration example of an image display device according to the third embodiment.

Fig. 15 shows a schematic diagram of a configuration example of an image display device according to the fourth embodiment.

Fig. 16 shows a schematic diagram of an example of an image projected onto a rear-mounted screen.

Fig. 17 is a schematic diagram showing a configuration example of an image display apparatus according to the fifth embodiment.

Fig. 18 shows a schematic diagram of an example of an image projected onto a cylindrical screen.

Fig. 19 shows a schematic diagram of an example of image data for a cylindrical screen.

Fig. 20 shows a schematic diagram of an example of temperature distribution on a cylindrical screen.

Fig. 21 shows a schematic diagram of another example of image data for a cylindrical screen.

Fig. 22 shows a schematic diagram of a configuration example of a cylindrical screen shown as a comparative example.

Fig. 23 is a schematic diagram showing an example of processing of detecting a touch position on a screen.

Detailed Description

Hereinafter, embodiments according to the present technology will be described with reference to the drawings.

< first embodiment >

[ configuration of image display apparatus ]

Fig. 1 is a schematic diagram showing a configuration example of an image display device according to a first embodiment of the present technology. The image display apparatus 100 includes a screen 10 and an image projection unit 20. The image display apparatus 100 is a projection type display apparatus in which an image is displayed on the screen 10 in such a manner that light is projected from the image projection unit 20 to the screen 10. It should be noted that in the present disclosure, "image" includes a still image and a moving image.

In the image display apparatus 100, the image projection unit 20 emits image light 1 and control light 2, the image light 1 being light in a wavelength region of visible light, and the control light 2 being light in a wavelength region different from the wavelength region of the image light 1, which will be described later. Here, the image light 1 is light constituting an image, and generally includes red light R, green light G, and blue light B. The wavelength region of the control light 2 is set to have a wavelength different from the RGB light wavelength region. In this embodiment, the control light 2 corresponds to a predetermined light.

Fig. 2 is a schematic sectional view showing a configuration example of the screen 10. Fig. 3 is a schematic diagram showing an example in which an image is projected onto the screen 10. The screen 10 has a display member 11 that displays an image, and functions as a projection screen that displays an image by projecting light thereto. The display member 11 is supported at a predetermined position by a pedestal or frame (not shown) or the like so that the display member 11 is appropriately irradiated with, for example, light (image light 1 and control light 2) emitted from the image projection unit 20.

The display member 11 comprises a display layer 12, a light control layer 13 and a protective layer 14. As shown in fig. 2, the display member 11 (screen 10) has a structure in which the light control layer 13, the protective layer 14, and the display layer 12 are stacked in this order from the side on which light from the image projection unit 20 is projected.

The display layer 12 displays an image composed of the image light 1. In this embodiment, the display layer 12 functions as a front screen that displays an image by reflecting or diffracting the image light 1 that has entered the display layer 12, thereby emitting the image light 1 on the side where the image light 1 has entered the display layer 12 (see fig. 3). The display layer 12 is a commonly used screen, and examples of the display layer 12 may include a matte screen, a pearl screen, a silver screen, a microbead screen, a transmissive screen, and the like.

Matte screens are so-called diffusion screens which are composed of a fabric or a resin sheet whose surface is coated with a coating material containing, for example, a scattering agent. Pearl screens and silver screens are so-called reflection type screens, the surfaces of which are coated with pearl-based resin or coating materials based on metal powder. A microbead screen is a screen with glass spheres coated with optical lenses on the surface. The transmission screen is a screen that transmits light of a wavelength in the visible light region when viewed from the front side of the transmission screen, for example, and is a translucent screen composed of a vinyl resin, an acryl resin, glass, or the like.

Alternatively, the display layer 12 may be formed of a diffractive optical element (hologram or the like), a half mirror, surface plasmon particles, cholesteric liquid crystal, a fresnel lens, or the like. The specific configuration of the display layer 12 is not limited. For example, the display layer 12 may be any layer that reflects RGB light (image light) projected from the image projection unit 20, and the display layer 12 may be constituted by a wall surface or the like, for example.

The optical control layer 13 changes optical characteristics according to irradiation of the control light 2. Specifically, the optical control layer 13 is configured such that the reflectance or transmittance is changed in accordance with the irradiation of the control light 2. For example, the optical control layer 13 absorbs light (control light 2) having a wavelength different from the wavelength (RGB) used as the image light 1, and changes (reduces) the transmittance or reflectance.

Therefore, it can also be said that the control light 2 is light for controlling the optical characteristics of the optical control layer 13. For example, light having a wavelength of 350nm or more and 420nm or less or a wavelength of 700nm or more and 2.5 μm or less is preferably used as the control light 2. Specific examples thereof may include Ultraviolet (UV) light and Infrared (IR) light. Thus, the transmittance or reflectance of the optical control layer 13 may be changed without affecting the color representation of the image. Here, "light control" is defined to change the transmittance or reflectance of the screen in order to improve image contrast.

The light control layer 13 comprises a photochromic material. The photochromic material is a material having two states of different colors (absorption spectra) reversibly changed due to the influence of light (control light 2). For example, in the region irradiated with the control light 2, the transmittance or reflectance may be reduced. As a result, for example, the portion irradiated with the control light 2 may become black or the like. It should be noted that other colors than black can be changed, for example, blue, purple, brown and red.

Examples of the photochromic material may include a photochromic dye composed of an organic material. For example, photochromic dyes are classified into two types. One of them is a T-type photochromic dye which returns to a transparent state when the irradiation of the control light 2 is stopped, and the other is a P-type photochromic dye which returns to a transparent state due to a wavelength different from that of the colored light. Examples of the T-type photochromic dye may include spiropyran, hexaallyldiimidazole, oxazine, naphthopyran, azobenzene, and the like. Examples of the P-type photochromic dye may include fulgide, diarylethene, and the like.

Alternatively, an inorganic material (for example, barium magnesium silicate or silver halide) may be used as the photochromic material in addition to the photochromic dye as the organic material. In addition, the kind, type, and the like of the photochromic material are not limited, and for example, any photochromic material whose reflectance and the like can be controlled by the control light 2 may be used.

For example, the light control layer 13 is formed by dispersing the above photochromic material in a base material (e.g., polymer) and forming it as a thin film on the display layer 12 (protective layer 14). It is advantageous that the substrate does not absorb light in the visible light region so as not to affect the display. Therefore, the image light 1 can be passed without changing its quality. Furthermore, it is also advantageous that the substrate does not absorb the control light 2.

Therefore, the photochromic material can be efficiently irradiated with the control light 2.

The material for the substrate is not limited, and examples thereof may include polymers such as nylon, polylactic acid, polyamide, polyimide, polyethylene terephthalate, polyacrylonitrile, polyethylene oxide, polyvinylcarbazole, polyvinyl chloride, polyurethane, polystyrene, polyvinyl alcohol, polysulfone, polyvinylpyrrolidone, polyvinylidene fluoride, polyhexafluoropropylene, cellulose acetate, collagen, gelatin, chitosan and polysiloxane, copolymers thereof, and the like. Further, these examples may include organic-inorganic hybrid materials obtained by combining the above-described organic materials with inorganic materials (e.g., silica, alumina, titania, zirconia), and the like.

Further, the optical control layer 13 may include a leuco dye. For example, a leuco dye is a substance that changes color by light or heat. The light control layer 13 is composed of a leuco dye that changes reflectance or transmittance to a desired degree by, for example, being irradiated with light (control light 2). Examples of the leuco dye may include a fluoran compound used for general thermal paper. Leuco dyes are reversibly colored or colorless by use with an acidic compound known as a developer. Also in the case where the leuco dye is used as described above, a black region or the like can be generated in accordance with the irradiation of the control light 2.

Further, the specific configuration of the optical control layer 13 is not limited, and for example, any material whose optical characteristics are changed by irradiation with the control light 2 may be suitably used. Further, for example, a material whose optical characteristics (for example, absorption rate (extinction coefficient, etc.) of light and refractive index) are changed so that a desired image can be displayed in accordance with irradiation of the control light 2 may be used as the light control layer 13.

The protective layer 14 cuts off irradiation of the control light 2 to the display layer 12, and suppresses deterioration (yellowing) of the display layer 12 due to the irradiation of the control light 2. The protective layer 14 is formed of, for example, a material that selectively absorbs or reflects Ultraviolet (UV) or Infrared (IR) light used as the control light 2. Examples of such materials may include scattering agents (e.g., zinc oxide and titanium oxide) and absorbing agents, such as octyl methoxycinnamate (or ethylhexyl methoxycinnamate), tert-butyl methoxydibenzoylmethane, oxybenzo-3, cyanine dyes, phthalocyanine dyes, and squaraine dyes.

The thickness of the protective layer 14 is set to, for example, 1 μm or more and 200 μm or less. The thickness of the protective layer 14 may be appropriately set according to the intensity of the control light 2 to be used, or the like, so that deterioration or the like of the display layer 12 can be sufficiently suppressed. It should be noted that the present technique can be applied also to a configuration in which the protective layer 14 is not provided, that is, a configuration in which the display layer 12 and the optical control layer 13 are directly stacked.

In fig. 3, an example of optical paths of the control light 2 and the image light 1 radiated from the image projection unit 20 to the screen 10 is schematically shown. Hereinafter, a surface of the screen 10 directed to the image projection unit 20 will be referred to as a front surface S1 of the screen 10, and a surface opposite to the front surface S1 will be referred to as a rear surface S2 of the screen 10.

For example, the control light 2 entering the front surface S1 of the screen 10 is absorbed by the photochromic material or the like of the optical control layer 13. As a result, the reflectance or transmittance of the region irradiated with the control light 2 is lowered, and the region becomes black or the like. On the other hand, by irradiation with the control light 2, a black region or the like can be generated at an arbitrary position on the screen 10.

In this way, the display member 11 (screen 10) displays the black region 3 in the region irradiated with the control light 2. It should be noted that the black region 3 is not limited to the case where it is actually black, and may be, for example, a region that is another color according to the properties of a photochromic material, a leuco dye, or the like. Further, a region where black having a different chromaticity (gray scale) appears is also included in the black region 3. It should be noted that, for example, gray scales can be displayed by controlling the irradiation intensity of the control light 2.

Further, the image light 1 entering the front surface S1 of the screen 10 passes through the optical control layer 13 and the protective layer 14 and reaches the display layer 12. For example, in the display layer 12, the image light 1 as visible light is diffusely reflected and emitted to the front surface S1 side. Therefore, a color image or the like can be displayed on the front surface S1 side of the screen 10.

For example, assume that a face image is displayed on the screen 10 as shown in fig. 1. In this case, for example, a region (iris, eyebrow, or the like) where black display or the like is designated is irradiated with the control light 2. Accordingly, the iris, the eyebrow, or the like with the black illuminance reduced can be displayed in the black region 3. Further, for example, a region (lips, skin, or the like) where color display is designated is irradiated with the image light 1, and a color image is displayed. Accordingly, an image including the black region 3 displayed by the control light 2 and a color image displayed by the image light 1 are displayed on the screen 10. Therefore, color display or the like having a wide illumination range and high contrast can be realized.

As shown in fig. 1, the image projection unit 20 includes a light source device 21, an intensity adjustment unit 22, an image generation optical system 23, a projection optical system 24, a light beam branching unit 25, an imaging device 26, and a controller 27. In this embodiment, the image projection unit 20 is configured as a scanning type projector that performs image display by scanning a modulated light beam (light beam).

The light source device 21 is a light source that emits light that becomes the control light 2 and the image light 1, and has a first light source 30 and a second light source 31. In this embodiment, the light source device 21 corresponds to a light source unit.

The first light source 30 emits first emission light that becomes the control light 2. As described above, the control light 2 is light having a wavelength region different from the image light 1(RGB light), and is, for example, light such as Ultraviolet (UV) light and Infrared (IR) light. Thus, the first light source 30 is configured to emit light other than RGB light as first emission light.

For example, a solid-state light source such as a semiconductor Laser (LD) and a Light Emitting Diode (LED) is used as the first light source 30. Alternatively, for example, a halogen lamp, a metal halide lamp, a xenon lamp, a krypton lamp, a metal halide lamp, a sodium vapor lamp, an HID lamp, or the like may be used as the first light source 30.

The second light source 31 emits second emission light which becomes the image light 1. In the example shown in fig. 1, a red light source 31R that emits red light R, a green light source 31G that emits green light G, and a blue light source 31B that emits blue light B are used as the second light source 31. The RGB light emitted from these light sources 31R to 31B becomes second emission light.

For example, the red light source 31R, the green light source 31G, and the blue light source 31B (second light source 31) are each constituted by a solid-state light source such as a semiconductor Laser (LD) and a Light Emitting Diode (LED). The specific configuration of the second light source 31 is not limited, and any light source capable of emitting RGB light may be used.

The intensity adjustment unit 22 adjusts each output of the respective light sources included in the light source device 21. For example, the intensity adjustment unit 22 is constituted by a power supply unit (light source driver) connected to each of the first light source 30, the red light source 31R, the green light source 31G, the blue light source 31B, and the like. Therefore, it can also be said that the intensity adjusting unit 22 adjusts the intensities of the first emission light, the red light R, the green light G, and the blue light B.

The image generating optical system 23 is an optical system that generates the control light 2 and the image light 1 from the first emission light and the second emission light, respectively. In this embodiment, the image generation optical system 23 functions as a scanning mechanism that scans the first emission light and the second emission light emitted from the light source device 21. For example, a scanning mechanism such as a Micro Electro Mechanical System (MEMS), a Digital Mirror Device (DMD), and a galvano mirror is used as the image generating optical system 23.

In the present embodiment, the control light 2 and the image light 1 are generated based on information (hereinafter, referred to as image data) about an image displayed on the screen 10. The image data is data specifying, for example, an RGB value or the like of each pixel included in the image. The format and the like of the image data are not limited, and arbitrary image data of a still image or a moving image may be used. In this embodiment, the image data corresponds to image information.

For example, the intensity adjustment unit 22 adjusts the output of the first light source 30 according to a black level (illuminance value or the like) indicating black luminance of each pixel, and modulates the intensity of the first emission light in a time-division manner. Further, the output of each light source 31R to 31B (second light source 31) for RGB light is adjusted in accordance with the RGB value or the like of each pixel, and the intensity of each RGB light (second emitted light) is modulated in a time-division manner. For example, the first emission light whose intensity has been modulated in a time-division manner and the respective RGB light rays are emitted along a single optical path as a single light beam.

The scanning mechanism of the image generating optical system 23 scans a light beam including the first emission light and the respective RGB light rays so that light corresponding to each pixel is emitted to an appropriate position. As a result, the image generating optical system 23 emits the control light 2 and the image light 1 for displaying the image represented by the image data. As shown in fig. 1, the control light 2 and the image light 1 emitted from the image generation optical system 23 are guided along a common optical path 32, and enter the projection optical system 24 at a subsequent stage.

In this way, the intensity adjustment unit 22 and the image generation optical system 23 generate the control light 2 by modulating the first emission light based on the input image data, and generate the image light 1 by modulating the second emission light. For example, by using the control light 2 and the image light 1, image display or the like can be realized at a predetermined frame rate. In this embodiment, the intensity adjustment unit 22 and the image generation optical system 23 cooperate to realize a generation unit.

The projection optical system 24 emits the control light 2 and the image light 1, which have been guided along the common optical path 32, along the optical axis O. As shown in fig. 1, in this embodiment, the screen 10 and the image projection unit 20 are disposed such that the optical axis O of the projection optical system 24 intersects the screen 10. In this embodiment, the optical axis O corresponds to a predetermined axis, and the projection optical system 24 corresponds to an emission optical system.

The projection optical system 24 is, for example, an optical system constituted by a predetermined lens system for projecting the control light 2 and the image light 1, and magnifies and projects the control light 2 and the image light 1 to match the screen 10. The specific configuration of the projection optical system 24 is not limited, and may be appropriately configured according to the size of the screen 10, the position where the image projection unit 20 is set, and the like. Alternatively, an optical system having a focus position adjustment mechanism, a zoom function, or the like may be used.

Accordingly, the projection optical system 24 illuminates the screen 10 with the control light 2 and the image light 1 generated by the light source device 21, the intensity adjustment unit 22, and the image generation optical system 23. In this embodiment, the light source device 21, the intensity adjustment unit 22, the image generation optical system 23, and the projection optical system 24 constitute an irradiation unit capable of irradiating a screen with predetermined light and image light.

The light beam branching unit 25 is provided on a common optical path 32 between the image generation optical system 23 and the projection optical system 24, and branches light from the screen 10 that has passed through the projection optical system 24. For example, optical elements such as a half mirror, a beam splitter, and a dichroic mirror are used as the beam branching unit 25. It should be noted that the light from the screen 10 includes, for example, the control light 2 and the image light 1 reflected by the screen 10, the external light incident through the screen 10, the infrared light (radiation light) emitted from the screen 10, and the like. In this embodiment, the light beam branching unit 25 corresponds to a branching unit.

This embodiment refers to radiated light of light from the screen 10, which is in the infrared region, which will be described later. For example, the beam branching unit 25 is configured to selectively branch desired radiation light in the infrared region. Further, the light beam branching unit 25 is configured to allow the control light 2 and the image light 1 to pass therethrough, for example. Therefore, it is possible to accurately extract the radiation light of the infrared region radiated from the screen 10 or the like while suppressing the influence on the control light 2 and the image light 1.

The imaging device 26 images the state of the screen 10 illuminated with the control light 2 and the image light 1. That is, it can also be said that the imaging device 26 images the screen 10 displaying an image and detects the state of the screen 10. As shown in fig. 1, light entering the imaging device 26 from the screen 10 is branched by the beam branching unit 25. The imaging device 26 images the state of the screen 10 based on the light branched by the light beam branching unit 25. In this embodiment, the imaging device 26 corresponds to an imaging unit.

In this embodiment, the imaging device 26 images the temperature distribution on the screen 10 as the state of the screen 10. The temperature distribution on the screen 10 is imaged by detecting, for example, infrared light (radiation light) radiated from the screen 10. Thus, the temperature distribution on the screen 10 is obtained as a three-dimensional measurement value representing the temperature at each coordinate position on the screen 10, which corresponds to each coordinate position of the video signal projected on the screen 10. Here, the three-dimensional measurement value is, for example, data represented by three components including an (X, Y) two-dimensional coordinate and the intensity of infrared light (Z component) at each coordinate position.

Each data point included in the temperature distribution may be associated with each pixel of the image displayed on the screen 10. Thus, for example, the temperature of the screen 10 at the display position of a specific pixel may be referred to.

Further, in this embodiment, the light illuminating the screen 10 and the light from the screen 10 pass through the same optical system (projection optical system 24). Thus, for example, the optical axis of the light illuminating the screen 10 and the optical axis of the light from the screen 10 may be the same. As a result, the positional deviation between the irradiation areas of the control light 2 and the image light 1 and the imaging area of the imaging device 26 or the like can be sufficiently avoided. Therefore, each data point of the temperature distribution can be accurately associated with each pixel on the screen 10, and the temperature of the display position of each pixel on the screen 10 can be accurately detected.

For example, the radiated light of the screen 10 may be detected by using a filter (IR filter) or the like that absorbs visible light and transmits infrared light. For example, an infrared camera or the like including an image sensor such as a Complementary Metal Oxide Semiconductor (CMOS) sensor, a Charge Coupled Device (CCD) sensor, and an IR filter is used in combination as the imaging device 26.

The controller 27 controls the operation of each block of the image projection unit 20. The controller 27 has a hardware configuration required for a computer, for example, a CPU and memories (RAM and ROM). The CPU loads a program stored in advance in the ROM or the like into the RAM, and executes the program for executing the image display method according to the present technology.

For example, a Programmable Logic Device (PLD) such as a Field Programmable Gate Array (FPGA) and other devices such as an Application Specific Integrated Circuit (ASIC) may be used as the controller 27.

In this embodiment, the CPU executes a predetermined program for configuring the comparator 28 as a functional block. In addition, functional blocks or the like that perform various types of processing for operating the image projection unit 20 are configured to be suitable for the controller 27. The program is installed in the controller 27 via various recording media, for example. Alternatively, the program may be installed via the internet or the like.

The comparator 28 compares the temperature distribution on the screen 10 with image data on an image to be displayed next, and controls the irradiation intensity of the control light 2. Here, the image to be displayed next is, for example, an image to be displayed in a frame subsequent to the current frame in image display performed at a predetermined frame rate or the like.

In this embodiment, the comparator 28 calculates a correction intensity distribution in which the irradiation intensity of the control light 2 specified by the image data on the image to be displayed next is corrected. Therefore, the corrected intensity distribution is data specifying the irradiation intensity of the control light 2 for displaying the next image (next frame). On the other hand, it can also be said that the corrected intensity distribution is a control value for controlling the irradiation intensity of the control light 2.

The calculated corrected intensity distribution is input to the intensity adjustment unit 22. Then, the intensity adjustment unit 22 modulates the output of the first light source 30 (the intensity of the first emission light) based on the corrected intensity distribution. Therefore, the control light 2 can be irradiated to the screen 10 with the irradiation intensity according to the temperature distribution on the screen 10.

In this way, the comparator 28 controls the irradiation intensity of the control light 2 to the screen 10 according to the imaging state of the screen 10. In this embodiment, the comparator 28 corresponds to a control unit. The operation of the comparator 28 will be described in detail later with reference to fig. 10 and the like.

[ display control of image display apparatus ]

Fig. 4 is a flowchart illustrating an example of display control of the image display apparatus 100. Fig. 5 is a block diagram showing a processing flow of display control of the image display apparatus 100. In fig. 5, illustration of the image generation optical system 23 and the projection optical system 24 shown in fig. 1 is omitted.

The display control shown in fig. 4 and 5 is, for example, a cyclic process repeatedly performed during the operation of the image projection unit 20. The loop process is performed, for example, in accordance with the start and end of image display. Alternatively, a mode or the like for performing display control may be selected, and whether to perform a loop process or the like may be switched.

In this embodiment, as shown in fig. 5, the output of the imaging device 26 is fed back to the comparator 28, and the irradiation intensity of the control light 2 is controlled. Therefore, the display control shown in fig. 4 and 5 can be said to be feedback control of the control light 2. Further, for example, the feedback control is performed for each frame displayed at a predetermined frame rate. Therefore, the repetition frequency of the loop process is similar to the frame rate of image display.

It should be noted that the first cyclic process is started, for example, in a state where feedback of the control light 2 is not performed. Further, in a state where the feedback of the control light 2 by the loop process performed immediately before has been performed, the second and subsequent loop processes are started. In either case, the feedback control can be appropriately realized.

First, the imaging device 26 images the temperature distribution on the screen 10 (step 101). For example, light entering the image projection unit 20 from the screen 10 through the projection optical system 24 is branched by the light beam branching unit 25 and enters the imaging device 26 (infrared camera). In the imaging device 26, infrared light contained in light from the screen 10 is detected by an image sensor or the like, and a temperature distribution on the screen 10 is imaged. In fig. 5, light from the screen 10 branched by the light beam branching unit 25 and entering the imaging device 26 is schematically shown as a broken line.

The imaging of the screen 10 is performed in a state where an image is displayed on the screen 10. That is, in a state where the screen 10 is irradiated with the control light 2 and the image light 1, the temperature distribution on the screen 10 is imaged. Hereinafter, image data regarding an image displayed at the moment when the temperature distribution on the screen 10 is imaged will be referred to as first image data.

Fig. 6 is a schematic diagram showing an example of image data. In fig. 6, image data 40 for displaying a face image in the center of a rectangular display area is schematically shown. The image data 40 is data on a face image displayed on the screen 10 shown in fig. 1.

Hereinafter, description is given assuming that the image data 40 shown in fig. 6 is the first image data 40a used when the screen 10 is imaged. It should be noted that in the case where the screen 10 is imaged at another time, another image data 40 different from the image data 40 shown in fig. 6 becomes the first image data 40 a.

For example, the first image data 40a includes pixels designated as black (black pixels 41). For example, a pixel representing an iris, an eyebrow, or the like is an example of the black pixel 41. The control light 2 for displaying the black pixel 41 is generated based on the information (black level and pixel position) about the black pixel 41. As a result, the black region 3 (see fig. 1) is displayed in the region irradiated with the control light 2 on the screen 10 (i.e., the region where the black pixels 41 are projected).

Further, for example, the first image data 40a includes pixels (color pixels 42) in which colors other than black are specified. For example, pixels representing lips, skin, etc. are examples of color pixels 42. Based on the information (RGB values or pixel positions) of the color pixels 42, image light 1 for displaying the color pixels 42 is generated and radiated toward the screen 10. As a result, for example, the face image can be displayed in full color.

It should be noted that, in the first image data 40a, the region shown in hatching indicates a region (hereinafter referred to as a transparent region 43) where a specific color is not specified. For example, the transparent area 43 is an area where black-and-white and other display colors are not specified, and is an area where the control light 2 and the image light 1 are hardly irradiated.

Fig. 7 is a schematic diagram showing an example of the temperature distribution on the screen 10. In fig. 7, a temperature distribution 44 of the screen 10 on which an image using the first image data 40 shown in fig. 6 is displayed is schematically shown using gray scale. It should be noted that as the grayscale concentration becomes higher, it indicates a higher temperature.

As described above, the black area 3 on the screen 10, which displays the iris, eyebrow, etc., is irradiated with the control light 2, and the control light 2 is ultraviolet light UV or infrared light IR. For example, when part of the light energy supplied to the black region 3 is absorbed by the screen 10 as thermal energy, the temperature of the black region 3 increases. As a result, as shown in the temperature distribution 44, it is conceivable that a relatively high temperature is detected in the pixels corresponding to the black region 3.

Further, also in the region irradiated with the image light 1 as visible light on the screen 10, the energy of the image light 1 may be absorbed as thermal energy, and the temperature may be raised in some cases. Further, for example, heat associated with previous image displays may be stored, resulting in a temperature distribution across the screen 10.

Further, for example, there is a possibility that temperature unevenness occurs due to an outside air temperature (for example, air blown out from an air conditioner or the like) of a position where the screen 10 is placed. Further, it is also conceivable that the temperature of the screen 10 changes when the user or the like touches the screen 10. Accordingly, the temperature distribution 44 of the screen 10 includes information on the temperature due to the currently displayed display image (the control light 2 and the image light 1), the temperature of the outside air environment, the temperature due to the touch of the hand, the finger, or the like, and the like.

Referring back to fig. 4, when the temperature distribution on the screen 10 is imaged, the comparator 28 calculates a corrected intensity distribution of the control light 2 (step 102). As shown in fig. 5, the three-dimensional measurement value as the temperature distribution 44 of the screen 10 and the second image data as the next image data 40 of the first image data 40a are input to the comparator 28.

Fig. 8 is a schematic diagram showing another example of the image data 40. Hereinafter, description is given assuming that the image data 40 shown in fig. 8 is the second image data 40b used next to the first image data 40a shown in fig. 6. In the second image data 40b, the position of the iris and the shape of the eyebrow are different from the first image data 40 a. Therefore, in an image to be displayed next, the irradiation position and the irradiation intensity and the like of the control light 2 are changed.

In this embodiment, the irradiation intensity of the control light 2 specified by the second image data 40b, which is the next image data 40 of the first image data 40a, is corrected in accordance with the state of the screen 10 to which the control light 2 and the image light 1 generated based on the first image data 40a are irradiated. Specifically, from the temperature distribution 44 of the screen 10 imaged in step 101, a corrected intensity distribution in which the irradiation intensity of the control light 2 specified by the second image data 40b is corrected is calculated.

Fig. 9 is a diagram showing a configuration example of three-dimensional data representing the temperature distribution 44 of the screen 10. Fig. 10 is a schematic diagram for describing a calculation process of correcting the intensity distribution. Hereinafter, the calculation process of the corrected intensity distribution 47 will be described with reference to fig. 9 and 10.

In fig. 9, three-dimensional data representing the temperature distribution 44 is shown. The three-dimensional data includes a plurality of data points 45 arranged in vertical and horizontal directions, and a temperature measurement value (the magnitude of temperature corresponds to a measurement value) at each point corresponding to each data point 45 (pixel) on the screen 10, and the like are stored. That is, the temperature distribution 44 may be regarded as three-dimensional image data in which the temperature of each point on the screen 10 is recorded.

For example, the point on the screen 10 corresponding to the data point 45 (pixel of data depth) where a high value is recorded is a point where the temperature is high. In contrast, the point on the screen 10 corresponding to the data point 45 (pixel with light data) where a low value is recorded is a point where the temperature is low.

Each data point 45 included in the temperature distribution 44 is associated with each pixel of the image displayed on the screen 10. In the following, it is assumed that pixel I (x, y) of the image data 40 corresponds to a data point T (x, y) of the temperature distribution 44. That is, it is assumed that the temperature recorded at the data point T (x, y) represents the temperature at the position of the display pixel I (x, y). It should be noted that x indicates an index representing the horizontal position of a data point in the graph and y indicates an index representing the vertical position of a data point in the graph.

This association may be achieved by appropriately positioning imaging device 26, for example, by using imaging device 26 with a resolution similar to image data 40. It should be noted that the present technique is not limited to the case where each pixel and each data point are associated with each other in a one-to-one manner, and the association may be performed using any method. For example, a plurality of pixels adjacent to each other may be associated with one data point. Alternatively, the association of the pixels with the data points, i.e., the association of the image data 40 with the temperature distribution 44, may be performed, for example, by using convolution, filtering, or the like.

The upper left diagram of fig. 10 is a schematic diagram showing the temperature distribution 44 of the screen 10 in the partial region 46 shown in fig. 9, and a denser gray scale indicates a higher temperature. The partial area 46 is composed of a block of 5 × 5 data points 45. Hereinafter, the lower left data point 45 of the temperature distribution 44 is denoted as T (1, 1). Thus, for example, the upper left data point 45 of the temperature profile 44 is represented as T (1, 5).

The upper right diagram of fig. 10 is a schematic diagram showing data (first image data 40a) of a currently displayed image displayed in the partial area 46 when the temperature distribution 44 is imaged. In the first image data 40a, a more dense gray scale represents a lower black illuminance, i.e., a darker color. Further, pixel I of first image data 40a_a(x, y) is associated with data point T (x, y) of temperature profile 44. I.e. the lower left pixel I of the first image data 40a_a(1, 1) corresponds to data point T (1, 1) of the temperature profile 44.

The lower right diagram of fig. 10 is a schematic diagram showing data (second image data 40b) on the next display image displayed in the partial area 46, and a darker gray level indicates a lower black illuminance. Pixel I of second image data 40b_b(x, y) is associated with data point T (x, y) of temperature profile 44.

The lower left diagram of fig. 10 is a schematic diagram showing an example of the corrected intensity distribution 47 in the partial region 46. Correcting the pixels C (x, y) of the intensity distribution 47 and the pixels I of the second image data 40b_b(x, y) (i.e., data points T (x, y) of temperature profile 44). The color of each pixel C of the corrected intensity distribution 47 represents the irradiation intensity of the control light 2 (emission intensity of the first emission light), and darker gray scales indicate higher irradiation intensities.

Hereinafter, the pixel I of the first image data 40a is displayed on the screen 10_aThe image position of (x, y) is denoted as S (x, y). For example, T (x, y) represents the temperature of the irradiation position S (x, y) on the screen 10. Further, pixel I of second image data 40b_b(x, y) represents a color planned to be displayed at the irradiation position S (x, y) at the next time. Further, the pixel C (x, y) of the corrected intensity distribution 47 represents a correction value of the irradiation intensity of the control light 2 irradiated to the irradiation position S (x, y).

For example,in the first image data 40a, black is specified as the pixel I at the center of the partial area 46_aAnd (3, 3) a display color. Thus, the display I is illuminated with the control light 2_a(3, 3) irradiation position S (3, 3). As a result, the black region 3 is displayed at the irradiation position S (3, 3). The temperature of the irradiation position S (3, 3) is detected as a measurement value of the data point T (3, 3) of the temperature distribution 44. As shown in fig. 10, the data point T (3, 3) has a higher temperature than other portions due to the irradiation of the control light 2.

In addition, in the first image data 40, the center pixel I is also referred to as a "pixel" and_a(3, 3) display colors are specified for the adjacent eight pixels. And I_a(3, 3) the display color has a higher luminance, brighter color (e.g., gray, another color, etc.) than the display color. Therefore, eight irradiation positions adjacent to the irradiation position S (3, 3) are irradiated with the control light 2, the image light 1, and the like having lower intensities. Therefore, as shown in the temperature distribution 44, temperatures lower than T (3, 3) and higher than other areas are detected at eight data points adjacent to the data point T (3, 3).

Generally, on the screen 10 (optical control layer 13) using a photochromic material or a leuco dye, the response speed of coloring and decoloring becomes faster at a higher temperature. That is, when the portion is irradiated with the control light 2, since the portion irradiated with the control light 2 has a higher temperature, the portion becomes black in a shorter time. Here, the time until the color becomes black is, for example, the time until the desired black appears.

As described above, in the case of displaying an image on the screen 10 including the optical control layer 13, the light energy, the ambient temperature, and the like of the currently displayed image form a temperature distribution on the projection screen, so that the reaction rates in the surfaces may be different.

For example, it is assumed that each irradiation position of the screen 10 is irradiated with the same intensity of the control light 2. In this case, the time until the same black color (black illuminance) appears is longer at the irradiation position having a lower temperature, and the time until the same black color (black illuminance) appears is shorter at the irradiation position having a higher temperature. Therefore, when the screen 10 having the temperature distribution 44 is irradiated with the control light 2 of a single intensity, unevenness of black illuminance or the like depending on the temperature distribution 44 may occur.

In this embodiment, the comparator 28 calculates a correction value (correction intensity distribution 47) of the irradiation intensity of the control light 2 so that the black color or the like of the next display image can be appropriately obtained based on the current temperature distribution 44 of the screen 10. Specifically, the irradiation intensity of the control light 2 with which the planned area 48 is irradiated is corrected in accordance with the temperature of the planned area 48 on the screen 10 designated to the black area 3 by the second image data 40 b.

The planned area 48 is, for example, an irradiation position on the screen 10 at which black pixels 41 for which black is designated in the second image data 40b are to be displayed. For example, in the second image data 40b, the position of the iris of the face image is shifted from the position in the immediately preceding image. These positions of the iris after movement on the screen 10 become planning regions (see fig. 1). It should be noted that, in fig. 10, the black pixels 41 of the second image data 40b are denoted by the same reference numerals as the planned area 48.

For example, in the second image data 40b shown in fig. 10, five pixels (i.e., the center pixel I)_b(3, 3) a pixel I vertically and horizontally adjacent to the center pixel_b(3，4)、I_b(3，2)、I_b(2, 3) and I_b(4, 3)) is designated as the black pixel 41. The irradiation positions (S (3, 3), S (3, 4), S (3, 2), S (2, 3), and S (4, 3)) at which the five black pixels 41 are to be displayed become the planned area 48. It should be noted that in the example shown in fig. 10, similar black luminance (black level) is set for each of the five black pixels 41.

For example, the comparator 28 extracts the black pixels 41 (planned area 48) from the second image data 40b and references the temperature of the data point 45 corresponding to each black pixel 41. Then, the irradiation intensity of the control light 2 is corrected so as to satisfy the intensity at which each black pixel 41 is colored with black illuminance.

For example, the temperature T (3, 3) of the irradiation position S (3, 3) as the planned region 48 is higher than the other temperatures. I.e. the pixel I in the center of the next display image (3, 3) to be displayed_bThe irradiation position S (3,3) it is colored black in a short time. In this case, for example, even if the irradiation intensity of the control light 2 is set to be low, the irradiation position S (3, 3) may be colored black at an appropriate time. For this reason, for the pixel C (3, 3) of the corrected intensity distribution 47, for example, an irradiation intensity (light gray in the figure) lower than the original irradiation intensity is calculated.

Further, for example, the temperature T (3, 4) of the irradiation position S (3, 4) as the planned region 48 is lower than the temperature T (3, 3) of the irradiation position S (3, 3). Therefore, at the irradiation position S (3, 4), the response rate until it is colored black is lower than that at the irradiation position S (3, 3).

In this case, for the pixel C (3, 4) of the corrected intensity distribution 47, for example, an irradiation intensity (dark gray in the figure) higher than the irradiation intensity set for C (3, 3) is calculated.

Similarly, for the pixels C (3, 2), C (2, 3), and C (4, 3) corresponding to the corrected intensity distribution 47 as the irradiation positions S (3, 2), S (2, 3), and S (4, 3) of the planned area 48, the irradiation intensity higher than that of C (3, 3) is calculated. By setting the irradiation intensity of the control light 2 higher in this way, coloring with a desired black color can be performed in a short time even in a region where the temperature is low. That is, the response time of black luminance display can be shortened.

Therefore, the black region 3 having the same black illuminance can be displayed at an appropriate timing with respect to the five irradiation positions (S (3, 3), S (3, 4), S (3, 2), S (2, 3), and S (4, 3)) as the planned region 48. Therefore, in this embodiment, the irradiation intensity of the control light 2 is controlled in accordance with the temperature distribution 44 of the imaging screen 10.

It should be noted that the irradiation intensity (correction value) of each pixel in the correction intensity distribution 47 may be appropriately calculated in accordance with the characteristics of the optical control layer 13 or the like. For example, the irradiation intensity of each pixel included in the planned area 48 is calculated so that coloring is completed at a desired timing by using the response ratio of the optical control layer 13 at each temperature or the like. In addition, the method of calculating the irradiation intensity of the corrected intensity distribution 47 is not limited.

Furthermore, the comparator 28 adjusts the illumination of the control light 2 on other areas of the screen 10 than the planned area 48. Specifically, for the regions other than the planned region 48 designated as the black region 3, the corrected intensity distribution 47 is calculated so that the irradiation intensity of the control light 2 is zero. In the corrected intensity distribution 47 shown in fig. 10, pixels for which the irradiation intensity of the control light 2 is set to zero are shown in white.

For example, when the irradiation of the light control layer 13 with the control light 2 is turned off, the displayed black disappears. That is, even in the region where black is displayed until then, in the case where the region is a region where black is not displayed next, black can be eliminated by not irradiating with the control light 2. Therefore, in correcting the intensity distribution 47, it can also be said that the irradiation intensity of the control light 2 is corrected to an intensity for eliminating the black illuminance of the currently displayed image.

It should be noted that, in this embodiment, the RGB values specified by the second image data 40B are used to calculate the intensity distribution of the intensities of the specified image light 1 (red light R, green light G, and blue light B). The intensity distribution of the image light 1 and the corrected intensity distribution of the control light 2 are output to the intensity adjustment unit 22.

Referring back to fig. 4, the intensity adjustment unit 22 controls the output of the first light source 30 based on the corrected intensity distribution 47 (step 103). For example, based on the corrected intensity distribution 47, a control value specifying the intensity of the control light 2 (first emission light) illuminating each of the illumination positions S (x, y) is output to the first light source 30 in a time-division manner. Further, in step 103, the intensity adjustment unit 22 appropriately controls the second light sources 31 (the red light source 31R, the green light source 31G, and the blue light source 31B) based on the intensity distribution of the image light 1.

The light source device 21 and the image generation optical system 23 emit control light 2 in accordance with the corrected intensity distribution 47 and the next image light 1 (step 104). The emitted control light 2 and image light 1 pass through the beam branching unit 25 and are radiated from the projection optical system 24 toward the screen 10. Accordingly, an image represented by the second image data 40 is displayed on the screen 10. It should be noted that during the next cycle, the screen 10 on which the image is displayed is imaged, and the processes of steps 101 to 104 are performed again.

Therefore, for example, by controlling the irradiation intensity of the control light 2 or the like in accordance with the temperature distribution 44 of the screen 10, the response time of black illuminance display can be shortened. Therefore, black luminance display or the like can be performed at an appropriate timing without an afterimage, and a high-contrast display image can be realized. Therefore, a high-quality image with excellent visibility can be displayed.

As described above, in the image display apparatus 100 according to this embodiment, the optical characteristics of the display member 11 of the screen 10 are changed due to the control light 2. The screen 10 is illuminated with the control light 2 and the image light 1, and the state of the screen 10 is imaged. For example, by controlling the irradiation intensity of the light 2 in accordance with the state of the screen, the optical characteristics of the screen and the like can be appropriately controlled. Therefore, a high-quality image with excellent visibility can be displayed on a screen or the like.

In image display using a general projector, the brightness when the screen is off is black illuminance. Therefore, in a bright environment where a large amount of light is reflected on the screen, the contrast of the displayed image is reduced, and visibility is deteriorated. In particular, with a transparent screen composed of a transparent glass substrate or the like containing a scattering agent, visibility deterioration becomes significant.

For example, a method of controlling the transmittance of a screen or the like by using a screen having TFT liquid crystal and PDL elements is conceivable. In this method, an image is displayed in a pixel size defined by a TFT liquid crystal or a PDL element, and it may be difficult to utilize the characteristics of a projector, for example, to project an image in an enlarged or reduced state. In addition, providing each element increases the manufacturing cost of the screen.

Further, a method using a contact thermometer (for example, a heating wire) is conceivable as a method of detecting the screen temperature. In such temperature sensing using wires, multipoint measurement is required to obtain a temperature distribution on a screen. Therefore, the wires used for the multipoint measurement may affect the design of the screen.

In this embodiment, a screen 10 that changes the reflectance or transmittance by being irradiated with the control light 2 is used. Therefore, the brightness of the extinguished region not irradiated with the image light 1 or the like can be arbitrarily changed. As a result, the level of black illuminance can be reduced, and the contrast of the image can be improved.

The irradiation intensity of the control light 2 is controlled based on the temperature distribution on the screen 10. Therefore, for example, even in a case where the temperature distribution 44 of the screen 10 is not uniform due to the previous image display, the change in the outside air temperature, the touch of the user, or the like, the display speed of the black illuminance, or the like can be appropriately controlled. As a result, image display can be performed without unevenness of black illuminance, afterimage, or the like, and video content or the like having high contrast and excellent visibility can be displayed.

Further, in the case of using the transparent screen 10, it is possible to avoid a situation of seeing through the background by displaying the black region 3. Therefore, even if the transparent screen 10 is used, image display with high contrast and excellent visibility can be realized.

The light control layer 13, which changes optical characteristics (transmittance and reflectance) according to irradiation of the control light 2, is composed of a photochromic material, a leuco dye, or the like. Therefore, appropriate image display can be performed regardless of the irradiation area of the image light 1 or the control light 2, and the image can be easily enlarged or reduced, for example. Further, since it is not necessary to provide a power line or the like on the screen 10, it is possible to easily configure the screen 10 in various shapes and sizes while reducing the manufacturing cost of the screen 10.

In this embodiment, the temperature distribution 44 is imaged into the state of the screen 10 by using the imaging device 26. By using the optical device in this way, the temperature distribution 44 of the screen 10 can be detected specifically without affecting the design of the screen 10.

Further, the imaging device 26 images the screen 10 via a projection optical system common to the control light 2 and the image light 1. Therefore, positional deviation between the temperature distribution 44 and the image data 40 and the like can be suppressed, and association of the data points of the temperature distribution 44 with the pixels of the image data 40 can be achieved with high accuracy. Therefore, the control accuracy of the control light 2 can be sufficiently improved. Further, with this arrangement, the image projection unit 20 can be configured in a small size.

< second embodiment >

An image display apparatus according to a second embodiment of the present technology will be described. In the following description, description of configurations and effects similar to those in the image display apparatus 100 described in the above-described embodiment will be omitted or simplified.

Fig. 11 is a schematic diagram showing a configuration example of an image display device according to the second embodiment. The image display apparatus 200 includes a screen 210 and an image projection unit 220. For example, the screen 210 is configured in a manner similar to the screen 10 shown in fig. 1. That is, the screen 210 has a characteristic of changing transmittance or reflectance according to the irradiation of the control light 2.

The image projection unit 220 includes a light source device 221, an intensity adjustment unit 222, an image generation optical system 223, a projection optical system 224, a light beam branching unit 225, an imaging device 226, and a controller 227. The intensity adjustment unit 222, the image generation optical system 223, and the projection optical system 224 are configured in a manner similar to, for example, the intensity adjustment unit 22, the image generation optical system 23, and the projection optical system 24 shown in fig. 1.

In this embodiment, the light source device 221 includes the second light source 31, and the second light source 31 includes a red light source 31R, a green light source 31G, and a blue light source 31B. Therefore, it can also be said that the light source device 221 has a configuration obtained by, for example, removing the first light source 30 from the light source device 21 shown in fig. 1. In this embodiment, the RGB light emitted from the light sources 31R to 31B becomes the second emission light (image light). It should be noted that the light source device 221 may be provided with a light source (first light source) that emits control light. Further, for example, a light source that emits control light or the like may be used separately from the light source device 221.

The light beam branching unit 225 is disposed in the common optical path 32 between the image generation optical system 223 and the projection optical system 224, and branches the light from the screen 210 that has passed through the projection optical system 224. For example, optical elements such as a half mirror, a beam splitter, and a dichroic mirror are used as the beam branching unit 225.

In this embodiment, visible light (RGB light) of light from the screen 210 is branched by the beam branching unit 225. For example, the transmittance of the light beam branching unit 225 is set so that the illuminance of the display image of the image light 1 is not significantly reduced. Further, the transmittance of the light beam branching unit 225 is set to an arbitrary transmittance so that the intensity of the branched visible light becomes an intensity that enables a visible light camera (imaging device 226) at a subsequent stage to image the illuminance distribution. The specific configuration of the beam branching unit 225 is not limited, and for example, a multilayer reflection film, an antireflection film, or the like is suitably used.

The imaging device 226 images the state of the screen 210 based on the light from the screen 210 branched by the light beam branching unit 225. In this embodiment, the illuminance distribution on the screen 210 is imaged as the state of the screen 210. The illuminance distribution 50 is, for example, an illuminance distribution of visible light emitted from the screen 210, and is an image of the screen 210 when the screen 210 is imaged using the visible light.

For example, a visible light camera having an image sensor such as a CMOS and a CCD is used as the imaging device 226. For example, a visible light camera can image a color image. Accordingly, the illuminance distribution 50 is an intensity distribution of red light R, green light G, and blue light B emitted from the screen 210. It should be noted that the present technology can also be applied to a case where a visible light camera that images a monochrome image or the like is used.

Fig. 12 is a schematic diagram showing an example of illuminance distribution on the screen 210. In fig. 12, the illuminance distribution 50 on the screen 210 is schematically shown using grayscale, in which an image using the first image data 40a shown in fig. 6 is displayed. In effect, the luminance distribution 50 becomes a color image including luminance values of the respective RGB color lights.

As shown in fig. 12, the illuminance distribution 50 includes the currently displayed image. This is an image due to, for example, returning light generated in such a manner that light diffusely reflected in the display layer of the screen 210 enters the projection optical system 224.

Further, the illuminance distribution 50 includes other images than the image by returning light (reflection or the like). For example, in the case of using the transmissive screen 210 or the like, the background light transmitted through the screen 210 is detected as the illuminance distribution 50. In addition, illumination light around the installation environment of the screen 210, other external light, and the like may be detected, reflected, and the like by the screen 210. Therefore, by imaging the illuminance distribution 50 on the screen 210, information on the actual image projected on the screen 210 can be obtained.

Referring back to fig. 11, the controller 227 is a computer that controls the operation of the image projection unit 220, and includes a comparator 228 as a functional block. In this embodiment, the comparator 228 controls the irradiation intensity of the image light 1 according to the imaging state of the screen 210. Specifically, the irradiation intensity of the image light 1 is controlled by comparing the illuminance distribution 50 on the screen 210 with the image data (second image data 40a) regarding the image to be displayed next.

The comparator 228 corrects the irradiation intensity of the image light 1 specified by the second image data 40a based on the illuminance distribution 50, and calculates a corrected intensity distribution of the image light 1. It should be noted that the corrected intensity distribution of the image light 1 includes the corrected intensity distribution of the red light R, the corrected intensity distribution of the green light G, and the corrected intensity distribution of the blue light B. Hereinafter, the corrected intensity distribution of the respective RGB color lights will be collectively described as a corrected color distribution.

The correction color distribution is data specifying the irradiation intensity of the image light 1 for displaying the next image (next frame). On the other hand, it can also be said that the corrected color distribution is a control value for controlling the irradiation intensity of the respective RGB color lights included in the image light 1.

The calculated corrected color distribution is input to the intensity adjustment unit 222. Then, the intensity adjustment unit 222 modulates the outputs of the second light sources 31 (the red light source 31R, the green light source 31G, and the blue light source 31B) based on the corrected color distribution. Therefore, the image light 1 can be irradiated to the screen 210 with the irradiation intensity according to the illuminance distribution on the screen 210. Accordingly, the comparator 228 controls the irradiation intensity of the image light 1 according to the imaged illuminance distribution.

Fig. 13 is a block diagram showing a processing flow of display control of the image display apparatus 200. As shown in fig. 13, the display control of the image display device 200 is a cyclic process performed by feeding back the output of the imaging device 226 to the comparator 228.

First, the imaging device 226 images the illuminance distribution 50 on the screen 210 on which the currently displayed image represented by the first image data 40a is displayed. The imaged illuminance distribution 50 on the screen 210 is input to the comparator 228 as a three-dimensional measurement. At this time, the second image data 40 (the image data 40 as the next display image) is input to the comparator 228.

In this embodiment, the comparator 228 corrects the irradiation intensity of the image light 1 specified by the second image data 40b, which is the next image data 40 of the first image data 40a, according to the state of the screen 210 irradiated with the image light 1 generated based on the first image data 40 a. That is, the comparator 228 calculates a corrected color distribution obtained by correcting the irradiation intensity of the image light 1. In the calculation of the correction color distribution, for example, the RGB values of each pixel included in the second image data 40b are corrected.

For example, white light (ceiling lighting, etc.) may be reflected on the screen 210. The illuminance of white light and the illuminance of a display image are added to an area on which the white light is reflected, and it may be difficult to appropriately represent the color, illuminance, and the like of the display image.

In this case, for example, the comparator 228 increases the illuminance of the pixel to be displayed in an area (reflection area) on which white light is reflected. That is, for the pixels of the pixels included in the second image data 40b included in the reflective area, the intensities of the respective RGB color lights increase at the same rate. For example, such a corrected color distribution is calculated. Therefore, even a bright area on which white light is reflected can finely represent the color of the next display image.

Further, for example, it is conceivable that the color of the irradiated image light 1 and the color of the reflected image are mixed with each other. In this case, a correction color distribution in which the RGB values of each pixel have been corrected is calculated so that the colors of the pixels displayed in the reflective area are appropriately displayed. Therefore, even in a region where other colors overlap, the color of the next display image can be appropriately displayed.

Further, the method of calculating the correction color distribution based on the illuminance distribution 50 is not limited. For example, by comparing the first image data 40a with the illuminance distribution 50, a reflection image can be extracted. A corrected color distribution may be calculated based on the extracted image. Further, for example, reflection within the illuminance distribution 50 is determined by machine learning or the like, and a correction color distribution is calculated based on the determination result. For example, such processing may be performed.

The calculated corrected color distribution of the image light 1 is output to the intensity adjustment unit 222. The intensity adjustment unit 222 controls each output of the red light source 31R, the green light source 31G, and the blue light source 31B as the second light source 31 based on the corrected color distribution. Image light 1 depending on the correction color distribution is emitted from the light source device 221 and the image generation optical system 223.

Accordingly, the intensity of the irradiation intensity of the image light 1, the ratio of the respective RGB color light rays, and the like are controlled according to the illuminance distribution 50 on the screen 210. Therefore, even in a state where the brightness of the display image is not uniform in the surface of the screen 210 due to the peripheral lamp in the installation environment or the background viewed through the projection screen, the color of the display image can be appropriately displayed. Accordingly, a high quality image having excellent visibility can be displayed on the screen 210.

It should be noted that in the case where the first light source is provided in the light source device 221 or the like, the intensity of the control light is adjusted according to the flowchart described above with reference to fig. 4 or the like. For example, the comparator 228 calculates an intensity distribution specifying the intensity of the control light based on the second image data 40 b. The output of the first light source is controlled based on the intensity distribution of the control light. Therefore, it is possible to realize image display with high contrast while appropriately displaying the colors of the display image.

< third embodiment >

Fig. 14 is a schematic diagram showing a configuration example of an image display device according to the third embodiment. In this embodiment, the irradiation intensity of the control light 2 and the image light 1 to the screen 310 is controlled according to the temperature distribution and the illuminance distribution on the screen 310.

The image display device 300 includes a screen 310 that changes optical characteristics according to the control light 2, and an image projection unit 320. The image projection unit 320 includes a light source device 321, an intensity adjustment unit 322, an image generation optical system 323, and a projection optical system 324. The light source device 321, the intensity adjustment unit 322, the image generation optical system 323, and the projection optical system 324 are configured in a manner similar to, for example, the light source device 21, the intensity adjustment unit 22, the image generation optical system 23, and the projection optical system 24 shown in fig. 1.

Further, the image projection unit 320 includes an infrared light branching unit 325a, a first imaging device 326a, a visible light beam branching unit 325b, a second imaging device 326b, and a controller 327 (comparator 328). As shown in fig. 14, the infrared light branching unit 325a and the visible light beam branching unit 325b are each disposed in the optical path between the image generating optical system 323 and the projection optical system 324 (optical path 32 common to the control light 2 and the image light 1). It should be noted that the order of arrangement of the infrared light branching unit 325a and the visible light beam branching unit 325b, and the like, are not limited.

The infrared light branching unit 325a branches infrared light of light that has passed through the projection optical system 324 from the screen 310. The first imaging device 326a is, for example, an infrared camera, and images the infrared light branched by the infrared light branching unit 325a to image the temperature distribution on the screen 310. The infrared light branching unit 325a and the first imaging device 326a are configured in a manner similar to, for example, the light beam branching unit 25 and the imaging device 26 shown in fig. 1.

The visible light beam branching unit 325b branches visible light of light from the screen 310 that has passed through the projection optical system 324. The second imaging device 326b is, for example, a visible light camera, and images the infrared light branched by the visible light beam branching unit 325b to image the illuminance distribution on the screen 310. The visible light beam branching unit 325b and the second imaging device 326b are configured in a similar manner to the light beam branching unit 225 and the imaging device 226 shown in fig. 11, for example.

The comparator 328 controls the irradiation intensity of the control light 2 according to the temperature distribution on the imaged screen 310. For example, a corrected intensity distribution in which the irradiation intensity of the control light 2 specified by the image data 40 of the next display image (second image data 40b) is corrected is calculated (see fig. 4, 5, and the like). Further, the comparator 328 controls the irradiation intensity of the image light 1 according to the illuminance distribution on the imaged screen 310. For example, a corrected color distribution in which the irradiation intensity of the image light 1 specified by the second image data 40b is corrected is calculated (see fig. 13 and the like).

Therefore, in this embodiment, the irradiation intensities of the control light 2 and the image light 1 are controlled using the corrected intensity distribution of the control light 2 and the corrected color distribution of the image light 1. Therefore, even in the case where there is temperature unevenness, illuminance unevenness, or the like in the surface of the screen 310, uniform image display can be performed on the screen 310, and display quality can be improved. Further, an image with high contrast can be displayed in an appropriate color, and the visibility of the image or the like can be sufficiently improved.

< fourth embodiment >

Fig. 15 is a schematic diagram showing a configuration example of an image display device according to the fourth embodiment. In the above-described embodiment, the front type screens 10, 210, and 310 are used. In this embodiment, a rear-mounted screen 410 is used. The image display apparatus 400 includes a rear-mounted screen 410 and an image projection unit 420.

On the rear-type screen 410, as shown in fig. 15, an image is displayed on a surface (rear surface S2) opposite to a surface (front surface S1) to which the control light 2 and the image light 1 are irradiated. Accordingly, the user views the image from the side opposite to the image projection unit 420 with the screen 410 interposed therebetween.

The image projection unit 420 is configured in a manner similar to any of the

image projection units

20, 220, and 320 shown in, for example, fig. 1, 11, and 14. That is, the image projection unit 420 is configured to be able to control the irradiation intensity of at least one of the control light 2 or the image light 1 according to the temperature distribution or the illuminance distribution on the screen 410.

Fig. 16 is a schematic diagram showing an example in which an image is projected onto the rear-mounted screen 410. The rear-mounted screen 410 includes a light control layer 413, a protective layer 414, and a display layer 412 in this order from the side of the front surface S1 facing the image projection unit 420. For example, the optical control layer 413 and the protective layer 414 are configured in a manner similar to the optical control layer 13 and the protective layer 14 described above with reference to fig. 2 and the like.

The display layer 412 functions as a rear-mounted screen that displays an image by diffracting or refracting the image light 1 that has entered the display layer 412, thereby emitting the image light 1 on the side opposite to the side on which the image light 1 has entered the display layer 412. For example, a thin screen, a transparent screen, a transmission hologram, or the like capable of transmitting image light is used as the display layer 412. The specific configuration of the display layer 412 is not limited, and any screen serving as a rear-mounted screen may be used as the display layer 412.

As shown in fig. 16, the image light 1 entering the front surface S1 of the screen 410 passes through the optical control layer 413 and the protective layer 414 and reaches the display layer 412. In the display layer 412, for example, the image light 1 as visible light is diffusely reflected, and is emitted to the rear surface S2 side. Accordingly, a color image or the like can be displayed on the rear surface S2 side of the screen 410.

It should be noted that by controlling the light 2 to enter the optical control layer 413 on the front surface S1 side, the black area 3 is displayed on the screen 410. The black region 3 reduces the black illuminance of the screen 410 as viewed from the rear surface S2 side. It should be noted that a configuration may be adopted in which the optical control layer 413 is provided on the rear surface S2 side of the screen 410. In this case, the control light 2 passing through the display layer 412 enters the optical control layer 413, and the black region 3 is displayed.

Even in the case of using the rear-mounted screen 410 as described above, by appropriately controlling the irradiation intensities of the control light 2 and the image light 1 in accordance with the temperature distribution or the illuminance distribution on the screen 410, high-quality image display with high contrast and excellent visibility can be achieved.

< fifth embodiment >

Fig. 17 is a schematic diagram showing a configuration example of an image display apparatus according to the fifth embodiment. In this embodiment, a cylindrical screen 510 is used instead of a flat screen. The image display apparatus 500 includes a stage 501, an image projection unit 520, a screen 510, and a top plate reflecting mirror 502.

The stage 501 has a cylindrical shape and is disposed at a lower portion of the image display apparatus 500. As shown in fig. 17, the image projection unit 520 is disposed inside the pedestal 501. Further, the pedestal 501 holds the screen 510 and the ceiling mirror 502 by an arbitrary holding mechanism (not shown). It should be noted that the shape and the like of the pedestal 501 are not limited, and for example, an arbitrary shape, for example, a rectangular parallelepiped shape, may be used.

The image projection unit 520 is configured to be accommodated inside the pedestal 501. The projection optical system 524 of the image projection unit 520 is disposed at the center of the stage 501, pointing upward. The control light 2 and the image light 1 are emitted from the projection optical system 524 along the optical axis O toward the upper portion of the image display apparatus 500. For example, the image projection unit 520 has a configuration similar to that of the image projection unit 20 shown in fig. 1. It should be noted that the specific configuration of the image projection unit 520 is not limited, and for example, the

image projection units

220 and 320 shown in fig. 11 and 14 may be used.

The screen 510 has a cylindrical shape and is disposed all around the optical axis O. In this embodiment, the screen 510 is disposed such that the central axis of the screen 510 (cylindrical shape) and the optical axis O of the projection optical system 524 coincide with each other. That is, the screen 510 may be said to be formed of a cylindrical shape having the optical axis O as a substantial center axis.

It should be noted that the shape of the screen 510 is not limited. For example, the screen 510 having a rectangular parallelepiped shape, the screen 510 having a polygonal prism shape, or the like may be used. Further, for example, the present technology is not limited to the case where the screen 510 is disposed all around the optical axis O, and for example, a semicylindrical screen 510 or the like may be used. That is, the present technique can be applied to the screen 510 disposed at least partially around the optical axis O.

The screen 510 has a stacked structure in which an optical control layer, a protective layer, and a display layer are stacked. For example, the cylindrical screen 510 is configured by bonding a stacked structure to a transparent cylindrical substrate or the like. For example, the optical control layer and the protective layer of the screen 510 are configured in a manner similar to the optical control layer 13 and the protective layer 14 described above with reference to fig. 2.

For example, the display layer of the screen 510 is constituted by a diffractive optical element. A Diffractive Optical Element (DOE) is an optical element that diffracts light. By using the diffractive optical element, for example, a highly transmissive, transparent screen or the like can be configured. Therefore, a full-circle image giving a feeling of floating or the like can be displayed, and a viewing experience with excellent entertainment characteristics can be provided.

For example, a Hologram Optical Element (HOE) that diffracts light using interference fringes recorded on a hologram is used as the diffractive optical element. For example, a transmissive HOE that diffracts and transmits incident light or a reflective HOE that diffracts and reflects incident light may be used (see fig. 18).

In addition, HOE changes diffraction efficiency according to an incident angle of incident light. Therefore, by properly designing the HOE, it is possible to selectively diffract light having a predetermined incident angle and efficiently transmit light having other incident angles. Therefore, for example, light or the like incident in the gazing direction (viewed from the front or the like) can be transmitted with high efficiency, and excellent transmittance can be exhibited.

The specific configuration of the diffractive optical element is not limited. For example, a volume HOE in which interference fringes are recorded inside the element, a relief (embossing) HOE in which interference fringes are recorded as irregularities of the surface of the element, or the like may be used. Alternatively, a type of diffractive optical element that diffracts light by a diffraction grating or the like using a predetermined pattern or the like may be used in addition to diffraction by interference fringes.

Further, the configuration of the display layer is not limited. For example, any transmissive screen may be used as the display layer. Further, for example, even in the case of using a translucent screen, a non-transmissive screen, or the like, the present technology can be applied.

The top plate mirror 502 has a reflection surface 503 that reflects the control light 2 and the image light 1. The top plate mirror 502 is disposed to face the projection optical system 524 by using the optical axis O as a reference so that the reflection surface 503 faces the projection optical system 524. Therefore, the top plate reflecting mirror 502 is disposed on the optical axis O above the projection optical system 524.

The cylindrical screen 510 is illuminated with control light 2 and image light 1 reflected by the reflective surface 503. That is, it can also be said that the top plate mirror 502 is an optical element that causes the control light 2 and the image light 1 emitted by the projection optical system 524 to enter the screen 510. In this embodiment, the top plate reflecting mirror 502 corresponds to an optical unit.

In this embodiment, the reflecting surface 503 has a shape rotationally symmetric with respect to the optical axis O. Specifically, the reflection surface 503 includes a rotation surface (parabolic surface) obtained by rotating a curve cut out from a part of a parabola using the optical axis O as a reference. The parabolic surface is configured such that the concave side of the parabola (the focal side of the parabola) is the side that reflects light (the reflective surface 41), and likewise, the axis of the parabola is different from the optical axis O.

For example, by appropriately setting the position, inclination, and the like of a parabola constituting the reflection surface 503, the reflected light (control light 2 and image light 1) and the incident angle with respect to the screen 510 can be made substantially constant. For example, in the case where the screen 510 is constituted by an HOE or the like, the reflection surface 503 is configured such that the incident angle of the reflected light with respect to the screen 510 becomes an angle that provides high diffraction efficiency of the HOE. Therefore, high-illuminance image display is realized on the transparent screen. Further, by making the incident angle the same, it is possible to sufficiently reduce illuminance unevenness and the like of an image.

It should be noted that the specific configuration of the reflection surface 503 is not limited, and for example, a reflection surface 503 that controls the incident angle of reflected light with respect to the screen 510 may be suitably used. For example, the reflecting surface 503 may be formed using a free-form surface designed using optical path simulation or the like. Further, for example, the shape of the reflecting surface 503 may be appropriately designed according to the shape of the screen 510. In addition, any reflective surface 503 capable of reflecting the control light 2 and the image light 1 toward the screen 510 may be used.

Fig. 18 is a schematic diagram showing an example in which an image is projected onto a cylindrical screen 510. On the left side of fig. 18, an example of an optical path in the case of using a transmissive screen 510 (e.g., a transmissive HOE, etc.) is schematically shown. Further, on the right side of fig. 18, an example of an optical path in the case of using a reflective screen 510 (e.g., a reflective HOE, etc.) is schematically shown.

As shown in fig. 18, for example, the control light 2 and the image light 1 emitted from the projection optical system 524 enter the reflection surface 503 of the top plate mirror 502 along the optical axis O. The control light 2 and the image light 1 reflected by the reflection surface 503 are radiated to the inside of the cylindrical screen 510.

The control light 2 radiated to the screen 510 is absorbed by the optical control layer of the screen 510, and the black region 3 having low black illuminance is displayed at the irradiation position. Further, the image light 1 radiated to the screen 510 is diffusely projected (left drawing) or diffusely reflected (right drawing) by the display layer 12 and emitted to the outside of the screen 510. Accordingly, a user viewing the screen 510 from the outside can visually recognize the whole-week image or the like.

Fig. 19 is a schematic diagram showing an example of image data 60 for the cylindrical screen 510. Fig. 20 is a schematic diagram showing an example of the temperature distribution 61 of the cylindrical screen 510. Fig. 21 is a schematic diagram showing another example of the image data 60 for the cylindrical screen 510.

When an image is displayed on the cylindrical screen 510, as shown in fig. 19 and 21, the image data 60 of the image deformed to match the shape of the screen 510 or the like is used. In the following description, it is assumed that the image data 60 shown in fig. 19 is the image data 60 (first image data 60a) of the currently displayed image, and that the image data 60 shown in fig. 21 is the image data 60 (second image data 60b) of the next displayed image.

For example, the control light 2 and the image light 1 are generated based on the image data 60 shown in fig. 19. The generated control light 2 and image light 1 are radiated toward the screen 510 through the top plate reflecting mirror 502. As a result, the face image shown in fig. 17 is displayed along the curved surface of the screen 510 at one side of the cylindrical screen 510.

Imaging by the imaging device 526 is performed in a state where an image represented by the first image data 60a (currently displayed image) is displayed on the screen 510. For example, light entering the imaging device 526 from the screen 510 is light traveling in a direction opposite to the light to be radiated on an optical path similar to the light to be radiated to the screen 510. That is, light that travels inward to the top plate reflecting mirror 502 from each position of the screen 510, is reflected by the top plate reflecting mirror 502, and enters the projection optical system 524 enters the imaging device 526 via the light beam branching unit 525.

In fig. 20, a temperature distribution 61 on a screen 510 on which the currently displayed image (first image data 60a) shown in fig. 19 is displayed is schematically shown. As described above, the temperature distribution 61 is imaged based on light traveling in the opposite direction to the optical path of the control light 2 and the image light 1 radiated to the screen 510. Thus, for example, the temperature distribution on the screen 510 associated with the irradiation of the control light 2 and the image light 1 is detected as the distribution of the deformed image reflecting the first image data 60 a.

Therefore, by illuminating the screen 510 with light using a common optical system and imaging the light from the screen 510, the association between the image data 60 and the temperature distribution 61 can be achieved easily and accurately. Thus, for example, each pixel of the image data 60 can be associated with each data point of the temperature distribution 61 in a one-to-one manner, and the processing speed and the control accuracy can be sufficiently improved.

The comparator 528 corrects the intensity specified by the second image data 60b shown in fig. 21 based on the temperature distribution 61 of the imaging screen 510, and calculates a corrected intensity distribution of the control light 2. The next display image is displayed based on the corrected intensity distribution.

It should be noted that also in the case where the temperature distribution 61 is imaged instead of the illuminance distribution (see fig. 11), and in the case where both the temperature distribution 61 and the illuminance distribution are imaged (see fig. 14), each piece of captured data can be accurately associated with the image data 60.

Therefore, even in the case of using the cylindrical screen 510 or the like, the irradiation intensities of the control light 2 and the image light 1 can be controlled according to the state of the screen 510 (the temperature distribution 61 or the illuminance distribution). Therefore, a high-quality all-round image or the like having high contrast and excellent visibility can be displayed, and excellent entertainment characteristics can be exhibited.

Fig. 22 is a schematic diagram showing a configuration example of a cylindrical screen 530 as a comparative example. In fig. 22, an infrared camera 531 for imaging a cylindrical screen 530 from the outside is provided. In the configuration in which the infrared camera 531 is mounted in the outer circumference of the cylindrical screen 530, a plurality of infrared cameras 531 need to be mounted to completely surround the outer circumference of the cylindrical screen 530, and there is a possibility that the size of the apparatus increases. Further, since a member outside the main body is provided, the design may be affected. Further, since it is impossible to perform imaging by sharing the projection optical system, there is a possibility that a deviation occurs in the positional relationship between the video signal and the screen.

In this embodiment, a configuration is used in which imaging is performed by branching light from the screen 510 that has passed through the projection optical system 524 as shown in fig. 17. Accordingly, it is possible to mount the imaging device 526 inside the image projection unit 520 and obtain the temperature or illuminance distribution of the cylindrical screen 510 with high accuracy. Therefore, the image display apparatus 500 can be compactly configured. Further, since it is not necessary to provide a member or the like outside the apparatus, an excellent design can be achieved.

Further, by imaging the screen 510 by the projection optical system 524 common to the lights to be projected (the control light 2 and the image light 1), positioning between the image data 60 and the captured data (the temperature distribution 61 or the illuminance distribution) can be performed with high accuracy. Therefore, the state at the position irradiated with the control light 2 and the image light 1, for example, the temperature and the illuminance can be detected with high accuracy, and the detection result can be fed back appropriately. As a result, the image quality of the full-circle image or the like can be significantly improved.

< sixth embodiment >

In this embodiment, the process of detecting the touch position where the user touches the screen is performed by sensing the temperature distribution on the screen in real time. For example, information (touch data) on the detected touch position is used as information on an operation input by the user.

In this embodiment, an image display device (see fig. 1, 14, 17, and the like) provided with an imaging device (an infrared camera or the like) that images a temperature distribution on a screen is used. Further, the controller of the image display apparatus is provided with a touch detection unit as a functional block.

The touch detection unit detects a touch position on the screen touched by the user based on a temperature distribution on the screen imaged by the imaging device. For example, the imaging apparatus images the temperature distribution at a predetermined frame rate. The touch detection unit appropriately obtains the imaged temperature distribution, and detects a position on the screen touched by the user (touch position) based on a change in the temperature distribution or the like.

Fig. 23 is a schematic diagram showing an example of processing of detecting a touch position on a screen. A of fig. 23 is a schematic diagram showing the temperature distribution 44a on the screen before the user touches the screen 610. B of fig. 23 is a schematic diagram showing the screen 610 touched by the hand 5 of the user. C of fig. 23 is a schematic diagram showing the temperature distribution 44b of the screen 610 after the user touches.

When the screen 610 before the user touches is imaged as shown in a of fig. 23, a state is detected in which the temperature distribution due to the irradiation of the control light 2 and the image light 1 and the temperature distribution due to the outside air or the like in the installation environment overlap. It is assumed that the user's hand 5 touches the screen 610 in this state, as shown in B of fig. 23. In this case, it is conceivable that the temperature of the hand 5 of the user is transmitted, and the temperature distribution on the screen 610 is locally changed.

In the screen 610 after the user touches, for example, as shown in C of fig. 23, a region where the temperature of the screen 610 rapidly increases is detected. In the example shown in C of fig. 23, five regions having a temperature higher than the periphery are detected. These five regions are, for example, touch regions 70 generated when the user touches the screen 610 with five fingertips.

For example, the touch detection unit detects generation of an area (touch area 70) in which the temperature locally changes by monitoring the temperature distribution on the screen 610, or the like, as shown in C of fig. 23. For example, an area in which the change in the temperature distribution from immediately before is larger than a predetermined threshold is detected as the touch area 70. Further, for example, the touch area 70 may be detected based on image processing using machine learning or the like. The method of detecting the touch area 70 is not limited, and any process for detecting an area in which a temperature change has occurred or the like may be used.

The location of the touch area 70 is the touch location on the screen that the user touches. For example, a position where the temperature is highest in the touch area 70, a center position of the touch area 70, and the like are detected as the touch position. Accordingly, it is possible to detect which position on the screen 610 the user touches, that is, which position of the display image the user touches.

Therefore, monitoring the temperature distribution enables easy detection of the touch position (touch data) on the screen 610. By using the touch data, image display (e.g., viewing of touch position, etc.) can be performed according to a touch operation of the user, and a display device given interaction can be configured. Thus, a viewing experience with excellent entertainment attributes may be provided.

Further, an operation by the user may be received based on the touch data. For example, various operation inputs such as icon selection, keyboard input, and finger gesture can be easily detected. Therefore, various operations can be performed on the screen, and operability is greatly improved.

< other examples >

The present technology is not limited to the above-described embodiments, and various other embodiments may be implemented.

In the above-described embodiment, the irradiation intensity of the control light is controlled in accordance with the temperature distribution on the screen. For example, the irradiation intensity of the control light may be controlled according to the illuminance distribution on the screen. For example, in an area that strongly reflects white light, the irradiation intensity of the control light may be controlled such that the black illuminance decreases (as the black area becomes darker). Therefore, even in a bright area, a low illumination level can be maintained, and a high-contrast image can be displayed.

Further, in the above, the irradiation intensity of the image light is controlled according to the illuminance distribution on the screen, but is not limited thereto. For example, the irradiation intensity of the image light may be controlled according to the temperature distribution on the screen. For example, by using the temperature distribution on the screen, the image light can be adjusted according to the degree of decoloring in the black region. For example, such processing may be performed.

In the example shown in fig. 11, the light source apparatus including only the RGB light sources (second light sources) has been described. For example, a light source device including only the first light source that emits ultraviolet light, infrared light, or the like may be used. That is, a configuration may be adopted in which only the control light is emitted from the image projection unit. In this case, for example, a grayscale image or the like may be displayed on the screen. Alternatively, by providing another projector or the like that emits image light, for example, a color image or the like can be displayed. With this configuration as well, for example, by controlling the intensity of light based on the temperature distribution on the screen or the like, image display with high contrast and excellent visibility can be achieved. For example, such a configuration may be used.

The method of setting the region irradiated with the control light is not limited. For example, in the gray scale, a pixel whose illuminance is lower than a predetermined threshold is set as a black pixel, and an area where the black pixel is displayed is irradiated with control light. Therefore, for example, a gray scale can be displayed on the low illuminance side by using the optical control layer. Further, pixels or the like designated to have a low RGB value and to be dark color may be displayed using the control light. In other words, a dark color can be expressed by overlapping and irradiating the image light and the control light.

In the above, a scanning type projector (image projection unit) that performs image display by scanning a light beam including control light and image light has been described. The present technology is not limited thereto, and for example, a projector of a type that performs light modulation using a transmissive or reflective liquid crystal panel (LCD: liquid crystal display) may be used.

For example, a 3LCD (three panel type) projector may be used, which includes three liquid crystal panels that respectively modulate respective RGB color lights, and combines the respective modulated color lights to generate image light. With such a projector, the control light may be generated by providing another liquid crystal panel that modulates the output of the first light source. In this case, according to the present technology, four liquid crystal panels that generate image light and control light are used as the generation unit.

In the 3LCD projector, the illuminance intensities of the control light and the image light to the screen can be adjusted by the respective liquid crystal panels. Therefore, for example, by controlling each liquid crystal panel using the corrected intensity distribution of the control light and the corrected color distribution of the image light, the control light and the image light can be irradiated with the irradiation intensity corresponding to the screen state.

In the above-described embodiments, the imaging apparatus images the screen by using the common optical system (projection optical system or the like) common to the lights radiated to the screen. There is no limitation on the configuration of the screen imaging. For example, the screen may be imaged using an imaging device provided outside the image projection unit. Also in this case, by appropriately associating the temperature distribution and the illuminance distribution on the screen with the image data 40, display control can be performed according to the state of the screen. For example, such a configuration may be adopted.

In fig. 17, a top plate mirror that reflects the control light and the image light toward the cylindrical screen is used. The method of projecting the image onto the cylindrical screen is not limited. For example, an optical lens or the like that refracts light emitted from the projection optical system to enter a cylindrical screen may be used instead of the top plate mirror. For example, a fresnel lens or the like is used as the optical lens. Also with this configuration, the present technology can be applied.

At least two features according to the present technology described above may be combined. In other words, various features described in the respective embodiments may be arbitrarily combined in the embodiments. In addition, the various effects described above are merely illustrative, not restrictive, and other effects may be provided.

It should be noted that the present technology may also take the following configuration.

(1) An image display apparatus comprising:

a screen including a display member that changes optical characteristics according to irradiation of predetermined light;

an illumination unit capable of illuminating the screen with at least one of the predetermined light or image light;

an imaging unit that images a state of the screen illuminated with at least one of the predetermined light or the image light; and

a control unit controlling an irradiation intensity of the screen by at least one of the predetermined light or the image light according to the imaged state of the screen.

(2) The image display apparatus according to (1), wherein,

the display member changes transmittance or reflectance according to the irradiation of the predetermined light.

(3) The image display apparatus according to (1) or (2), wherein,

the imaging unit images a temperature distribution on the screen as a state of the screen.

(4) The image display apparatus according to (3), wherein,

the control unit controls the irradiation intensity of the predetermined light according to the imaged temperature distribution.

(5) The image display apparatus according to any one of (1) to (4),

the imaging unit images an illuminance distribution on the screen as a state of the screen.

(6) The image display apparatus according to (5), wherein,

the control unit controls the irradiation intensity of the image light according to the imaged illuminance distribution.

(7) The image display apparatus according to any one of (1) to (6),

the predetermined light includes light having a wavelength region different from that of the image light.

(8) The image display apparatus according to any one of (1) to (7), wherein,

the irradiation unit comprises

A light source unit that emits at least one of first emission light as the predetermined light or second emission light as the image light, and

a generating unit that generates the predetermined light by modulating the first emission light and generates the image light by modulating the second emission light based on input image information.

(9) The image display apparatus according to (8), wherein,

the control unit corrects an irradiation intensity of at least one of the predetermined light or the image light in accordance with a state of the screen irradiated with the at least one of the predetermined light or the image light, the state of the screen being generated based on first image information, the irradiation intensity being specified by second image information that is image information subsequent to the first image information.

(10) The image display apparatus according to (9), wherein,

the display member displays a black region in a region to be irradiated with the predetermined light, and

the control unit corrects the irradiation intensity of the predetermined light irradiating a planned area on the screen, the planned area being specified as the black area by the second image information, according to a temperature of the planned area.

(11) The image display apparatus according to (10), wherein,

the control unit adjusts irradiation of another area on the screen by the predetermined light, the another area being different from the planned area.

(12) The image display apparatus according to any one of (1) to (11), wherein,

the imaging unit images a temperature distribution on the screen as a state of the screen, further comprising

A touch detection unit that detects a touch position on the screen that a user touches based on the temperature distribution on the screen.

(13) The image display apparatus according to any one of (1) to (12), wherein,

the illumination unit includes an emission optical system that guides the predetermined light and the image light along a common optical path, and emits the guided predetermined light and the guided image light along a predetermined axis.

(14) The image display apparatus according to (13), further comprising

A branching unit that is disposed on the common light path and branches light from the screen, the light passing through the emission optical system,

the imaging unit images a state of the screen based on the branched light.

(15) The image display device according to (13) or (14), wherein,

the screen is disposed at a part of a circumference of the predetermined axis, and

the illumination unit includes an optical unit that causes the predetermined light and the image light emitted from the emission optical system to enter the screen.

(16) The image display apparatus according to any one of (13) to (15), wherein,

the screen is configured in a cylindrical shape having the predetermined axis as a substantially central axis.

(17) The image display apparatus according to any one of (1) to (16),

the display member is transmissive to light having a wavelength in a visible region, as viewed from the front of the display member.

(18) The image display apparatus according to any one of (1) to (17), wherein,

the display member comprises

A display layer displaying an image configured by the image light, and

and a light control layer which changes optical characteristics according to the irradiation of the predetermined light.

(19) The image display apparatus according to (18), wherein,

the light control layer includes a leuco dye or a photochromic material.

(20) An image display method comprising:

by computer systems

Illuminating a screen with at least one of predetermined light or image light, the screen including a display member that changes optical characteristics according to the illumination of the predetermined light;

imaging a state of the screen illuminated with at least one of the predetermined light or the image light; and is

Controlling an illumination intensity of the screen by at least one of the predetermined light or the image light according to the imaged state of the screen.

List of reference numerals

1 image light

2 control light

3 black region

10. 210, 310, 410, 510, 610 screens

12. 412 display layer

13. 413 optical control layer

21 light source device

22. 222, 322 strength adjusting unit

23. 223, 323 image generating optical system

24. 224, 324, 524 projection optical system

25. 225, 525 light beam branching unit

325a infrared light branching unit

325b visible light beam branching unit

26. 226, 526 imaging device

326a first imaging device

326b second imaging device

27. 227, 327 controller

28. 228, 328, 528 comparators

32 common light path

40. 60 image data

40a, 60a first image data

40b, 60b second image data

44. 44a, 44b, 61 temperature distribution

47 corrected intensity distribution

48 planning region

50 illuminance distribution

70 touch area

502 roof mirror

100. 200, 300, 400, 500 image display apparatus.

Claims

1. An image display apparatus comprising:

2. The image display apparatus according to claim 1,

3. The image display apparatus according to claim 1,

4. The image display apparatus according to claim 3,

5. The image display apparatus according to claim 1,

6. The image display apparatus according to claim 5,

7. The image display apparatus according to claim 1,

8. The image display apparatus according to claim 1,

the irradiation unit comprises

9. The image display apparatus according to claim 8,

the control unit corrects an irradiation intensity of at least one of the predetermined light or the image light in accordance with a state of the screen irradiated with the at least one of the predetermined light or the image light, wherein the state of the screen is generated based on first image information, and the irradiation intensity is specified by second image information that is image information subsequent to the first image information.

10. The image display apparatus according to claim 9,

11. The image display apparatus according to claim 10,

12. The image display apparatus according to claim 1,

13. The image display apparatus according to claim 1,

14. The image display device of claim 13, further comprising

the imaging unit images a state of the screen based on the branched light.

15. The image display apparatus according to claim 13,

16. The image display apparatus according to claim 13,

17. The image display apparatus according to claim 1,

the display member is transmissive to light having a wavelength in a visible region as viewed from a front surface of the display member.

18. The image display apparatus according to claim 1,

the display member comprises

A display layer displaying an image configured by the image light, and

and a light control layer for changing optical characteristics according to the irradiation of the predetermined light.

19. The image display apparatus according to claim 18,

the light control layer includes a leuco dye or a photochromic material.

20. An image display method comprising:

by computer systems