JP2006156416A - Lighting control method and image display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a lighting device and a lighting control method capable of obtaining high ambience feeling by controlling lighting by interlocking with an image of an image display device. <P>SOLUTION: The lighting of an appreciation space occupied by appreciators appreciating the image is controlled by interlocking with the image displayed on the image display device so that the ambient feeling of the image displayed on an image surface of the image display device is heightened. More specifically, one or more of light sources arranged in the appreciation space are controlled so as to make at least one parameter out of lighting level, color distribution, light distribution, and direction of the appreciation space nearly coincide with the parameter corresponding to a hypothetical image space imagined by the image displayed on the image display device. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

The present invention relates to an illumination control method and a video display device that change various indoor illumination conditions in conjunction with images and sounds.

  In the multimedia era, the progress of technological development in the image and sound fields is remarkable. Above all, with the increase in the size of the display, it has become possible to enjoy so-called realistic images that are real and powerful at home. In the future, in order to use multimedia more effectively, it is considered that technology for enhancing the sense of reality of images displayed on an image display device will be indispensable.

  At present, increasing the size of the screen is the most effective way to enhance the sense of reality, so large, thin, and low-cost displays have been actively researched and developed.

On the other hand, since sound greatly affects the indoor atmosphere, it is considered useful for enhancing the sense of reality when viewing the image display apparatus. Conventionally, a stereo method using a pair of speakers, and recently a surround method in which speakers are also added behind the viewer have been developed. It goes without saying that increasing the number of speakers increases the sense of reality, but nowadays, technologies that increase the sense of reality with a small number of speakers are being studied in consideration of practical costs.
In addition to sound, lighting can be cited as a factor that greatly affects the indoor atmosphere. The lighting effect is supported by the fact that the lighting effect plays an important role in stage production in theater stage lighting. Thus, it is considered that the realism when viewing the image display device can be enhanced by appropriately linking the illumination that has a great influence on the indoor atmosphere with the screen of the image display device. For example, when a scene of a sunset in the Mediterranean Sea is broadcast on a large high-definition television screen, the color temperature of the indoor lighting gradually decreases as the screen fades and fades away. However, as the illuminance decreases, you can feel as if you are in the scene of the image.
In addition, the technology for improving the realism of the image display device by illumination can improve the realism of an image without using a large image. The resources and costs required for manufacturing a small illuminating device are far less than in the case of a large image display device. For this reason, lighting-enhancing technology can contribute significantly to energy savings and global environmental conservation, including cost reduction.

  At present, there is no attempt to put such an idea into practical use, but there are some related prior arts.

  As a first conventional technique, a “light color variable illumination device” (Japanese Patent Laid-Open No. 3-184203) disclosed in Japanese Patent Laid-Open No. 2-158094 (Japanese Patent Publication No. 8-12793), and a second conventional technique. As disclosed in Japanese Patent Application Laid-Open No. 3-184203 (Japanese Patent Publication No. 8-15004), the “light color variable illumination device” is controlled by linking illumination with an image on an image display device. The present invention relates to a lighting device that improves a sense of reality when viewing a display device.

  The illumination device of the first prior art is composed of an RGB signal output unit, a Y (luminance) signal output unit, a light mixture ratio control unit, and a color light output unit, and by connecting this illumination device to an image display device, The average chromaticity and average luminance of the entire screen are obtained from the RGB signal and luminance signal for each pixel of the screen of the image display device, and appropriate chromaticity and illuminance of the room lighting are obtained based on these. In order to achieve the appropriate chromaticity and illuminance, the output of each RGB single color fluorescent lamp built in the illumination output unit is controlled.

  The second conventional technique has substantially the same features as the first conventional technique, but does not simply determine the average chromaticity and average luminance of the entire screen of the image display device, but rather the image displayed on the screen of the image display device. It is different in that the remaining part of the skin color part such as the human face is considered as the background part, and only the RGB signal and the luminance signal of each pixel in the background part are extracted to obtain the average chromaticity and the average luminance. ing.

  As for a specific lighting control method, lighting is performed so that the chromaticity and luminance of the wall surface on the back of the image display device are the same as the average chromaticity and average luminance of the entire screen or the background portion excluding human skin color. A method of controlling is disclosed.

  The “video effect lighting device” disclosed in Japanese Patent Application Laid-Open No. 2-253503 as the third conventional technology is similar to the above two conventional technologies in that the indoor lighting is linked to the image on the screen of the image display device. Control. However, this prior art is different from the above two prior arts in that a plurality of light sources are used. As a specific illumination control method, the screen of the image display device is divided, the average hue of each division unit is detected, and the illumination is controlled so that the hue of the illumination light source corresponding to each division unit is the same Is disclosed.

  In the “image reproduction method and apparatus” disclosed in Japanese Patent Laid-Open No. 7-264620 as the fourth conventional technique, the indoor lighting is linked to the image on the screen of the image display apparatus, as in the above three conventional techniques. Control. However, this prior art differs from the above three prior arts in that the space in which an image reproduction device such as an image display device exists is faithful to the illumination conditions of the space in which the subject that captures the image to be broadcast on the image display device exists. It is a point which changes the illumination conditions.

  In the “TV lighting system” disclosed in Japanese Patent Laid-Open No. 6-267664 as the fifth prior art, the lighting in the room is controlled in conjunction with the image on the screen of the image display device, as in the four prior arts. To do. However, this prior art is different from the above four prior arts in that the R · G · B incorporated in the illumination output unit for each pixel of the image of the image display device according to the magnitude of the R · G · B signal. It is characterized in that each output of the G / B single-color fluorescent lamps is adjusted to increase the color purity of the screen.

For example, in the above publication, when a red rose is projected on the screen of the image display device, the purity of the red of the screen of the image display device is reduced by external light or the like by increasing the output of the R (red) fluorescent lamp. It is stated that it can be prevented.
JP-A-3-184203 Japanese Patent Laid-Open No. 3-184203 (Japanese Patent Publication No. 8-15004)

  The above prior arts, particularly the first to third prior arts, can be evaluated in that they disclose the idea of controlling room lighting in conjunction with the screen of the image display device. However, in any of the conventional techniques, as for the configuration of the lighting device that enhances the sense of presence, only a simple configuration is described in which the dimming level of each lamp is arbitrarily changed by combining RGB single color fluorescent lamps. , Lack of concreteness.

  That is, the idea of enhancing the sense of reality by controlling the lighting in conjunction with the image of the image display device has been proposed so far, but no concrete means for enhancing the sense of reality has been clarified. In addition, a specific configuration of the lighting device that enhances the sense of reality is not disclosed.

  The present invention has been made in consideration of the above-described problems, and an object of the present invention is to display an image displayed on the screen of the image display device by controlling the illumination of the viewing space in conjunction with the image of the image display device. It is providing the illumination control method and the illuminating device which can improve a realistic feeling.

  The illumination control method of the present invention is an illumination control method for controlling a light source in conjunction with a video display device, and the illumination control unit is configured to have an average chromaticity of all pixels of an image displayed on the image display device. The chromaticity of the light source is controlled so that the chromaticity of the peripheral visual field of the image display device is a hue that is substantially opposite to the hue on the chromaticity diagram, whereby the above object is achieved.

  The video display device of the present invention is a video display device that controls a light source in conjunction with the light source, and includes the light source, an illumination control unit that controls the light source, and an image display unit that displays an image. The control unit is configured such that the chromaticity of the peripheral visual field of the image display device is a hue that is substantially opposite to the hue on the chromaticity diagram with respect to the average chromaticity of all pixels of the image displayed on the image display device. The chromaticity of the light source is controlled to achieve the above object.

  The light source may be integrated.

  The light source may be arranged at a position where the light source is not directly visible to the viewer.

  According to the present invention, it is possible to obtain a sense of presence as if the user is in a scene of an image displayed on the screen of the image display device by simple means.

  In addition, according to the present invention, there is provided an illuminating device that provides a high sense of realism by controlling illumination in conjunction with an image on an image display device.

  Prior to the description of specific embodiments of the present invention, first, the results of an evaluation experiment conducted by the present inventors in order to examine the validity of the illumination control method according to the prior art will be described.

In particular,
(1) A method of controlling illumination so that the chromaticity and luminance of the wall on the back of the image display device are the same as the average chromaticity and average luminance of the entire screen or the background excluding human skin color, (2) The average hue of each divided portion of the image display device in which the chromaticity of the ceiling lighting, the left wall lighting, the right wall lighting, and the floor lighting is divided into four so as to correspond to each How to control the lighting to be the same,
(3) A method for controlling an illumination condition of a space where an image reproduction apparatus such as an image display apparatus exists, faithfully to an illumination condition of a space where an object to be photographed exists, and (4) Each output of the R, G, B monochromatic fluorescent lamps incorporated in the illumination output unit is adjusted in accordance with the magnitude of each R, G, B signal of each pixel of the screen of the image display device, and the image display device To increase the color purity of the screen image,
The four lighting control methods were used for evaluation.

  The experiment was conducted in a 3 m × 4 m laboratory as shown in FIG. The interior of the laboratory was achromatic on the ceiling, walls, and floor, and the respective reflectances were 90%, 50%, and 20%. An image display device (image sound output unit) 2 was installed with one wall of the laboratory on the back, and a chair 3 on which a viewer 4 sits in the center. A total of seven illumination output units (illumination devices) 1 are embedded in the ceiling behind the image display device 2, the ceilings on the left and right walls, the center of the ceiling, and the floors on the left and right walls (in FIG. 1, The central portion and the floor lighting output portion 1 on the left and right walls are omitted). Each illumination output unit 1 has an RGB single color fluorescent lamp built in, and the computer 5 can arbitrarily change each output.

  First, as an evaluation of the method corresponding to the above (1), in this state, a video image, specifically, an environmental video (forest landscape) and an entertainment video (movie “ The die hardware 3 ”) is copied, and the illumination and the illuminance are adjusted so that the luminance and chromaticity of the wall behind the image display device 2 become the average chromaticity and average luminance of the entire screen of the image display device 2 in accordance with the video images. The output of each lamp of the output unit 1 was controlled. The control signal is stored in the computer 5 connected to the illumination output unit 1, and the control signal is transmitted to each illumination output unit 1 as the video image progresses.

  In the experiment, viewers (subjects) 4 were seated one by one on the chair 3 in the center of the room, and the video images displayed on the screen of the image display device 2 were viewed while performing the illumination control as described above. After watching the video image for 15 minutes, regarding the realism of the screen, “very realistic”, “realistic”, “neither”, “no realism”, “very realistic” Subjective evaluation was made using a five-step scale. The test subjects 4 were 6 men and women (age 25 to 50 years) and 12 people in total.

  As a result of the above subjective evaluation experiment, 10 out of 12 responded “Neither”, and the remaining 2 responded “No realism”.

  From this, the method of controlling the illumination so that the luminance and chromaticity of the wall surface behind the image display device 2 become the average chromaticity and average luminance of the entire screen of the image display device 2 has the effect of enhancing the sense of reality. It seems that there is almost no. Rather, from the subject 4 after the experiment, an opinion was heard that the color of the screen of the image display device 2 was rather faded.

  Next, as an evaluation of the method corresponding to the above (2), there are four chromaticities corresponding to the ceiling lighting, the left wall lighting, the right wall lighting, and the floor lighting, respectively. The illumination was controlled so as to be the same as the average hue of each divided portion of the image display device divided into two, and the effect was evaluated.

  Specifically, the screen of the image display device 2 is divided into four parts, an upper part, a middle left part, a middle right part, and a lower part, the upper part is the illumination output part 1 at the center of the ceiling, and the middle left part is the illumination at the left wall. The output unit 1, the middle right part correspond to the illumination output part 1 near the right wall, and the lower part correspond to the illumination output part 1 on the floor near the left and right walls. Next, the average hue of each part of the divided screen is calculated in accordance with the video image displayed on the image display device 2, and the lamp of the illumination output unit 1 corresponding to each divided part is matched with them. Controlled the output. The control signal is stored in the computer 5 connected to the illumination output unit 1, and the control signal is transmitted to each illumination output unit 1 as the video image progresses.

  As a result of the subjective evaluation experiment carried out in the same manner as the previous method, most of the subjects (viewers) 4 replied that there was no sense of reality. The reason for this is that after the experiment, the interior of the viewing room becomes too bright due to the lighting in the center of the ceiling, the continuity with the wall lighting is lacking because there is no lighting in the background, and not only the hue but also the luminance Opinions were heard that the degree of realism varies depending on the situation.

  Accordingly, each of the divided portions of the image display device in which the chromaticity of each of the ceiling lighting, the left wall lighting, the right wall lighting, and the floor lighting is divided into four so as to correspond to each of them. The method of controlling the lighting so that it is the same as the average hue has a problem in the arrangement of the lighting, and it is not practical because the effect cannot be obtained unless the luminance is controlled as well as the average hue. It was confirmed that it was not appropriate.

  Next, as an evaluation of the method corresponding to the above (3), an image reproduction device (image acoustic device) such as the image display device 2 is faithfully faithful to the illumination conditions of the space where the subject that captures the image to be broadcast on the image display device 2 exists. The validity of the method of controlling the lighting conditions of the space where the output part) exists was evaluated.

  To do this, I first took a video of the scenery of the park near my workplace. At the time of shooting, the daylight illuminance level and color temperature were measured and recorded. Thereafter, the video image taken in the laboratory of FIG. 1 was reproduced and presented to the subject 4, and at the same time, the setting of the room illumination so as to obtain the illuminance level and color temperature recorded at the time of photographing was attempted. .

  However, the average color temperature of the measured values of daylight is about 6000 K, the average illuminance level is about 10000 lx, and the color temperature of about 6000 K can be easily realized, but the illuminance level of about 10000 lx cannot be realized. . Even if two additional illumination output units 1 are additionally installed in the configuration of FIG. 1, only about 3000 lx can be finally obtained.

  An attempt was made to perform an evaluation experiment under these conditions, but since the image brightness of the screen of the image display device 2 was low and the image was clearly faded when viewed in a room with an illuminance of about 3000 lx, this method was performed without performing an experiment. I got the conclusion that it is not valid. In addition, this trial proved that this method is not practical because it requires daylight measurement during shooting.

  Finally, as an evaluation of the method corresponding to the above (4), a method of increasing the color purity of the image on the screen of the image display device 2 by illumination was evaluated.

  In the evaluation, a still image in which a red rose flower was photographed was used. The output of each fluorescent lamp of the illumination output unit 1 was adjusted so as to be almost the same as the chromaticity of the rose flower, and the room was illuminated so that the illumination light hit the screen of the image display device 2. As a result, it was clarified that there is no effect of improving the sense of reality by this method without making many subjects 4 evaluate. This is because the light from the illumination output unit 1 does not illuminate only the roses of the image displayed on the screen of the image display device 2, but illuminates the entire screen. The white background of the roses is colored red), so the background color has become more red than the purity of the red color of the rose, which reduces the contrast between the background wall and the red color of the rose. Because it looked like.

  From the above evaluation experiments, it has been confirmed that none of the above-described conventional techniques can provide the effect of enhancing the sense of reality.

  In proceeding with further studies based on the above examination results, first, “what does the sense of reality mean” was examined.

In the field of image technology, several research results related to realism have been reported. Among them, Toshihiko Hiroaki et al. (Information Processing Society of Japan Research Report, Vol.94, No.29, pp.9-14, 1994) systematically discusses the sense of reality. In the following, based on the research of Hiroaki et al., We will describe the definition of the sense of reality and the concept of technology for improving the sense of reality by lighting.
As shown in FIG. 2, Hiroaki et al. Referred to a space represented by an image displayed on an image display device as a “virtual space”, and “a space that is not physically present in front of an observer (prototype space). When the observer expresses using a receptive means (stimulation, physical phenomenon, etc.), if the expression results have an effective effect on the observer, the expression is defined as a virtual space. It has said. In addition, Hiroaki et al., “I felt that the viewer expressed the space expressed in the virtual space as if it existed in front of the viewer ’s eyes. The sense that I saw is a sense of realism, ”and added the following explanation:“ The observer perceives and recognizes the virtual space and builds the perceptual space inside. The purpose of is to create a perceived space with a high presence based on virtual space, in other words, “how to deceive the brain”. As long as the presence in the perceptual space can be enhanced, any means should be used, so that not only the improvement of fidelity but also the characteristics of spatial cognition Techniques that have been successfully used are also considered to be a category of presence technology. It is. "
Realistic technology using lighting is exactly one of Hiroaki's “methods that make good use of the characteristics of spatial cognition”.
Based on the above, the presence in the present invention is expressed as “the virtual image space predicted from the image displayed on the image display device is the presence that the viewer felt as if it were in front of the viewer. Is defined. In addition, the technology for improving the sense of realism by lighting is defined as "a technology that makes the viewer feel as if the virtual image space actually exists in front of the viewer by using the effect of lighting on the space perception." I will do it.
Recently, Mitsuo Ikeda (Professor at Ritsumeikan University and Professor Emeritus at Tokyo Institute of Technology) and others have proposed the concept of illumination-recognition visual space. The illumination-recognition visual space by Ikeda et al. Refers to how a person enters a room and the lighting in the space is based on the light source in the room, how the object looks, and the state of shadows This refers to the space formed by the lighting that is recognized in the human head. On the other hand, in the field of psychology, the attribute of lighting that is cognitively judged as “what kind of lighting is made in this space”, as described by Ikeda et al., Has long been called lighting impression. Therefore, in the following, according to the psychological definition described above, the above concept that Ikeda et al.

  Furthermore, Ikeda et al., Based on the idea of a lighting-recognition visual space (in this specification, lighting impression), continuity of both rooms in two spaces partitioned by windows and walls under different conditions. An evaluation experiment was conducted. As a result, it was clarified that the continuity between the two spaces is greatly different due to different lighting conditions, and that there is a specific lighting condition for the continuity of both chambers to appear to increase.

  When this experimental result is applied to the present invention, it becomes a problem whether the illumination impression of the virtual image space can be recognized from the image displayed on the image display device such as a TV. Assuming that this is possible, adjusting the lighting conditions in the viewing room allows the lighting impression in the viewing room and the lighting impression in the virtual image space to be recognized as being continuous or consistent. Lighting conditions are considered to exist.

In view of this, the inventors of the present application first performed observation and evaluation on various types of images in order to confirm whether or not the illumination impression of the virtual image space can be determined from the image displayed on the image display device. As a result, it is possible to determine the lighting impression of the virtual space from the image, and by matching the lighting conditions of the viewing room appropriately, the lighting impressions of both the virtual image space and the viewing space are matched, or It became clear that it is possible to have continuity.
Next, consider what lighting factors determine the lighting impression.

  According to Akashi's dissertation (“Brightness and energy saving in office lighting”, September 1997, Musashi Institute of Technology), one of the inventors of this application, the most reflective factor in the field of view is the factor of lighting impression. It is reported that the brightness of the high part, the brightness of the high brightness part of gloss and highlight, the average brightness of the visual field when there is not, the spatial relationship between the irradiated surface and the position of the light source and the irradiation direction are important. . In addition to these, Tatsumi et al. Stated that illuminance and light color are important (Miebayashi, Taiichiro Ishida, Mitsuo Ikeda: “Allowance of illumination light and color that gives continuity to two indoor spaces” , Journal of Lighting Society, Vol.82, No.8A, pp.523-529, 1998).

Among the above factors, the luminance is determined by both the reflection characteristics of the object and the characteristics of the illumination, and when it is limited only to the illumination factors, the illuminance, light color are the factors that determine the lighting impression. It can be concluded that three factors are important: the position of the light source and the direction of illumination.
Next, in controlling the illumination of the viewing space, when viewing an image displayed on an image display device such as a TV, it is possible to consider a light source that illuminates which range of the visual field centered around it. I examined what should be done.
According to Hatada (Tokyo Polytechnic University), the visual field of human beings is broadly divided into a discrimination visual field, an effective visual field, a guidance visual field, and an auxiliary visual field as shown in FIG. Objective measurement of the sense of realism by ", Television Institute Technical Report, VVI47-3, pp.55-60, 1981). The discrimination visual field is a range where visual functions such as visual acuity are excellent, the effective visual field is a range where information can be received instantaneously by gazing with only eye movements, and the guidance visual field is such that the presence of presentation information can be understood. Although it has only identification ability, it is a range that affects the determination of the spatial coordinate system, that is, a range in which movement is easily felt. Further, the auxiliary visual field is a range in which a light threshold is seen in the dark, that is, a range in which the presence of light cannot be recognized although the shape cannot be recognized. Therefore, by providing at least one light source for each of these fields of view and controlling them independently, it is considered that the sense of reality can be effectively enhanced by appropriately utilizing the difference in visual characteristics of each field of view. It is done. In addition, by individually controlling a plurality of light sources, it is possible to express the impression of the position of the light source and the direction of illumination, which are factors of the illumination impression.
Next, in order to improve the sense of reality of the image displayed on the image display device, an evaluation experiment on the sense of reality was conducted in order to clarify what requirements each factor of the lighting impression should satisfy. .

  For the experiment, the experimental apparatus of FIG. 4 was used. Specifically, as shown in FIG. 4, a total of five illumination output units (illumination devices) 1 are provided behind and to the left and right of the image display device (image sound output unit) 2 and to the left and right of the viewer (subject) 4. Place. The range illuminated by each illumination output unit 1 corresponds to an effective visual field, a guidance visual field, and an auxiliary visual field, respectively. Each illumination output unit 1 can be independently controlled by a computer. In addition, each illumination output unit 1 incorporates RGB single-color fluorescent lamps, and the level of each lamp can be adjusted independently.

The images to be evaluated are images of about 60 scenes selected from DVD data such as “Batman & Robin-Counterattack of Doctor Freeze” and “Virtual Trip-Bali Edition”, “Diehard 3”, “Robin Foot”, etc. It is an image of about 50 scenes selected from VHS video images, and an image of about 50 scenes selected from game software such as “Final Fantasy 7”, “GO on the train”, “Driving simulation”. From the above images, 16 representative images were carefully selected by preliminary experiments and used for actual evaluation experiments.
In the experiment, a total of 15 subjects 4 are seated one by one at a predetermined observation position, and while observing the screen of the image display device 1, the presence of the image is felt for each image displayed on the screen. Each subject 4 was requested to adjust each light source in the viewing room so as to increase the most. However, as a specific adjustment procedure, the subject 4 does not directly operate the computer, but the subject 4 is the experimenter, saying "Please make the background brightness a little higher and the light color in the front a little more red" The experimenter who instructed the (operator operator) verbally and heard the instruction controlled the lighting by operating the computer. After the experiment, each subject was asked what kind of concept the lighting was adjusted on.
As a result of the experiment, the following results were obtained.

  (1) An illumination impression also exists in the virtual image space.

  This was supported by the fact that all subjects answered that they were able to perceive the lighting impression of the virtual image space from the images in the introspection report after the experiment.

  (2) The light color, level, position, and light direction of the illumination are illumination factors for improving the sense of reality, and by appropriately controlling these conditions, the sense of reality of the image can be improved.

  (3) With respect to the illumination level, the sense of reality is enhanced by adjusting the illumination level in the viewing space to be approximately equal to the illumination level in the virtual image space. In order to best enhance the sense of reality, it is desirable to match the illumination level of the virtual image space and the illumination level of the viewing space on the chromaticity coordinates. In the above-mentioned paper, in order to increase the continuity between two adjacent rooms (target space and observation space), the relationship between the illuminance Ek of the observation space and the illuminance Et of the target space is 0.67 · Et <Ek <. Since it has been reported that the setting should be in the range of 1.25 · Et, the illumination may be controlled using this value as a guide.

  On the other hand, the illumination level generally refers to the illuminance level, but the reflection characteristics of the interior of the viewing space are not necessarily the same as that of the virtual image space, so more accurate control is based on luminance. It is thought that you can. From the results of this experiment, it is better to set the luminance L ′ (cd / m 2) of the peripheral visual field within the range of 0 <L ′ <1.25 · L with respect to the maximum luminance L (cd / m 2) of the image. Became clear. Therefore, control may be performed to satisfy this relationship.

(4) Regarding the light color of the illumination, the sense of reality is enhanced by adjusting the light color of the illumination in the viewing space to be approximately equal to the light color of the illumination in the virtual image space.
In order to best enhance the sense of reality, it is desirable to match the light colors of both the virtual image space and the viewing space on the chromaticity coordinates. In addition, the above-mentioned report that the difference in light color between the two chambers must be within the range of ± 0.04 in the x coordinate of the chromaticity diagram in order to increase the continuity between the two adjacent chambers. Therefore, the lighting may be controlled based on the data. However, from this experiment, it became clear that if the light color categories of the lighting in both rooms almost match, the sense of reality can be enhanced to some extent. For example, if the illumination in the virtual image space is red light, the illumination in the viewing space only needs to satisfy a chromaticity within a range that can be regarded as almost red. If this method is followed, simpler control can be performed.

  (5) The sense of reality is closely related to a sense of continuity, a sense of expanse, and a sense of power.

  The sense of continuity is the feeling that the virtual image space is connected to the viewing space, the sense of expanse is the feeling that the connection between the two can be felt and the space still continues, and the sense of power is In addition to feeling the connection between them, it means the feeling that the space is approaching the direction of the viewer. Moreover, these senses of continuity, sense of breadth, and sense of power are subordinate concepts of realism.

  (6) By changing the level, light color, and position of the light source arranged in the peripheral visual field of the image display device, the characteristics of the light source in the virtual image space, the light flow, the irradiation direction, and the state of the ground light (base illumination) can be changed. Can express.

(7) By adjusting the illumination weight (level) of the effective visual field, the guidance visual field, and the auxiliary visual field, various illumination states can be created, and a sense of expanse and power can be produced.
For example, by making the illuminance of the auxiliary visual field illumination higher than the illuminance of the other visual field, it is possible to express a state in which light is irradiated from the front of the viewer toward the screen. Alternatively, it is possible to express a state in which strong light is irradiated from the screen by making the illumination intensity of the effective visual field higher than that of the other visual field.

(8) By making the light source invisible to the viewer, the sense of reality is enhanced.
As shown in FIG. 4, the light shielding plate 51 is installed between the viewer 4 and the light source (illumination output unit 1) so that the light source 1 cannot be seen from the viewer 4, and such light shielding. As a result of comparing the realism with the case where the light source 1 is made visible to the viewer 4 without installing the plate 51, it became clear that the effect of improving the realism is halved when the light source 1 is visible. This can be appropriately explained based on the above-mentioned idea of illumination impression and illumination recognition visual space. That is, according to those ideas, it is considered that the realistic sensation is improved when the illumination impression in the viewing space matches that in the virtual image space. If the light source in the viewing space is visible to the viewer, each space appears to be illuminated by a separate light source, that is, there is no continuity between the lighting in the viewing space and the lighting in the virtual image space. Therefore, it is thought that the sense of reality does not improve. Therefore, it is desirable to shield the light source or the light emitting unit (illumination output unit) with a shielding plate or the like so as not to be seen by the viewer.

(First embodiment)
Based on the examination result by the inventors of the present application as described above, as a first embodiment of the present invention, first, a specific embodiment of the illumination control method will be described below.

  FIG. 5A is a diagram schematically showing a TV viewing room to which the lighting control method of the present invention can be applied. Here, a relatively large TV (for example, 36 inches) is installed with one wall as the back. Has been. It is assumed that the viewer sits at a distance of 7H from the TV screen and appreciates the TV when the vertical dimension of the TV screen is H. Based on the straight line connecting the viewer and the TV screen, the effective visual field is within ± 15 degrees, the guiding visual field is within ± 50 degrees, and the auxiliary visual field is within ± 100 degrees. A visual field part and an auxiliary visual field part are formed.

  First, it is assumed that the screen of FIG. 6A (a) is displayed on the TV screen. The screen in FIG. 6A (a) is a large museum space with columns. The entire space is illuminated with blue light. On the other hand, the window reflects the state of red light entering the hall.

  At this time, the illumination of the viewing space is adjusted so that the illumination of the auxiliary visual field and the guidance visual field is almost the same light color as the blue light in the image, so that the illumination of the virtual image space is connected to the illumination of the viewing room. Give an impression. This enhances the continuity of lighting in both spaces and improves the sense of reality. In addition, the illumination of the effective field of view is red, and the presence of red light is emitted from the window in the screen toward here, thereby enhancing the spatial connection and improving the sense of reality. .

  Alternatively, as in the screen of FIG. 6A (a), when there is no light having a uniform luminance distribution and strong directivity, the brightness of the light sources arranged in each paper shop is made uniform rather than uniform. As shown schematically in 6B by the size of the hatching range, it is easy to make the brightness of the light source arranged in the effective visual field higher than that of the light source arranged in the guidance visual field and the auxiliary visual field. Enables viewing. Thus, the above control method is effective as a lighting control method when viewing with a relaxed feeling while improving the sense of reality.

  Next, it is assumed that the screen of FIG. 6A (b) is displayed. The screen in FIG. 6A (b) is a scene in which a large astronomical telescope is irradiated with spot light with high red directivity from above. On the other hand, the light color of the base illumination is blue.

  At this time, the illumination in the viewing space is the blue light of the base illumination as the illumination of the guidance visual field. On the other hand, in order to express a state in which the highly directional red spot light in the virtual image space reaches the viewer, the illumination of the effective visual field and the illumination of the auxiliary visual field are set to red light.

  As a result, the sense of power of the effective visual field increases, and the viewer feels as if he is in the virtual image space. In addition, regarding this image, the guide visual field portion may be red light and the auxiliary visual field portion may be blue light. By doing so, it is possible to express how the red spot light reaches the viewer's feet. In this way, by appropriately using each visual field part, it is possible to variously express how the light spreads.

  Alternatively, as shown schematically in FIG. 6C by the size of the hatching range, by making the brightness of the auxiliary visual field higher than the brightness of the effective visual field, the viewer can see the red spot light. It feels as if it has reached the vicinity of the viewer.

  In the state illustrated in FIG. 6A (b), the red spot light is emitted from the top to the bottom, but as shown in FIG. 5A, the illumination of each field of view is emitted from the bottom to the top. Even if the illumination as described above is performed, there is no problem even if the illumination of each field of view is irradiated from the top to the bottom as shown in FIG. However, as shown in FIG. 5A, the viewer is more likely to feel a phenomenological atmosphere when the illumination of each field of view irradiates from the bottom to the top.

  Furthermore, as shown in FIG. 5C, by using a combination of illumination that irradiates from the bottom to the top and illumination that irradiates from the top to the bottom, the sense of reality can be further improved. For example, if the effective field of view uses illumination that illuminates from top to bottom, and the auxiliary field of view uses illumination that illuminates from bottom to top, the viewer will receive a red spot light. It feels more like it is.

  As described above, by controlling the output and light color of each light source in accordance with the luminance distribution state of the screen, it is possible to achieve an improvement in the sense of reality.

  Next, it is assumed that the screen of FIG. 6A (c) is displayed. FIG. 6A (c) is a close-up image of the girl's face illuminated by an incandescent bulb. The background of the girl's face is reflected in the dark.

  At this time, the position of the illumination in the virtual image space is in front of the girl, that is, when it is assumed that the virtual image space and the viewing space are connected, it is considered to be between the girl and the viewer. Is natural. Therefore, for this image, the illumination state described above can be expressed by changing the illumination of the guidance visual field to the light bulb color, and the continuity between the image virtual space and the viewing space is very natural. Moreover, it can raise effectively and a sense of reality improves.

  Next, it is assumed that the image of FIG. 6A (d) is displayed. FIG. 6A (d) is an image of a terraced rice field in the rainforest region. Because of the fine weather, this terraced rice field is illuminated with blue sky light and direct sunlight and shines in beautiful green. There is a shadow in front of the image, and direct light is emitted from here (the viewer side) toward the back side.

  For such an image, when the illumination of the auxiliary visual field part and the effective visual field part is made a light color close to sunlight, the direction of light from the front to the back can be expressed. At this time, if the illumination of the auxiliary visual field portion is green, the spread of the visual field can be expressed. This is because the peripheral part of the human visual field, such as the auxiliary visual field, has low visual function and the shape and color of the object cannot be clearly identified. Because. That is, even if it is not the illumination color (light source color) but the color of the object (object color), it can be expressed by appropriately utilizing the difference in visual function for each field of view. The sense of reality is improved by any of the above methods.

  Next, the case where the image of FIG. 6A (e) is projected is assumed. FIG. 6A (e) is an image of a beautiful sunset. The sun is red and the sky around the sun is also red. The sky in the lower right half of the image is cloudy and glows dark green. The sea is dark blue.

  For this image, the illumination in the effective visual field is red in the sun, the illumination in the guidance visual field is in dark green, and the illumination in the auxiliary visual field is dark blue in the sea. In this way, by using different illuminations for each field of view according to the position of light on the screen, the continuity between the virtual image space and the viewing space increases. That is, it is effective if the light existing above the image is expressed by the effective visual field, the light existing below is expressed by the auxiliary visual field, and the intermediate light is expressed by the guiding visual field. The inventors of this application call this “upper, lower, and middle law”.

  Astonishing effects can be obtained by performing fine illumination control as described above. However, in order to perform these illumination controls automatically and in real time, it is necessary to estimate the position of the light source, the light color, and the like from the image data. Many of the means have already been described as represented by the “upper, lower, and lower laws”, but here, some of the means are supplemented.

  As a result of examining many images by the present inventors, the light source often has the highest luminance in the image. Therefore, the luminance of each pixel of the image is analyzed, and the portion with the highest luminance is regarded as the light source, and there is no problem. Even if it is not a light source, the light with the highest brightness emitted or reflected there is often dominant as light in the virtual image space. For this reason, if an image processing filter for detecting the highest luminance portion is prepared in advance, the processing time is shortened.

  In addition, as described above, because the technology for improving the sense of realism using lighting uses a cognitive effect, the most sensible and skilled person can determine the lighting conditions while examining the meaning of the image. It is thought that a sense of reality can be enhanced effectively. Therefore, it is needless to say that the best method is to store the illumination data in a storage medium such as a DVD or a video tape and reproduce it together with the image. As a second best method, a large number of representative images and their appropriate lighting conditions are stored in a file as a database, and when the image is reproduced, the image data to be projected and the image data of the previously stored file are It is conceivable to extract the optimum illumination condition while collating. The time required for collation with such a database can be expected to be further shortened in the future due to advances in computer technology such as memory.

  Here, FIG. 6D (a) and (b) is a figure which shows typically the switch function which enables selection of the illumination control method according to a viewer's liking.

  When viewing images on a TV, it is important to improve the presence that can be felt as if it is present in the scene, and also to be able to enjoy it relaxedly. For this reason, in the configuration of FIG. 6D (a), the lighting control method that combines both the sense of presence and the sense of relaxation is set as, for example, “standard mode”, and further, the improvement of the optimum sense of presence is pursued. The lighting control method is `` dynamic mode '', the lighting control method pursuing the best relaxation feeling is `` relaxation mode '', and the mode that can freely set the lighting control method according to the taste of the viewer is `` favorite mode '' Each is set. On the other hand, the configuration of FIG. 6D (b) schematically shows the configuration of a switch function that enables selection from among multiple modes. Each mode can be arbitrarily set including, for example, the “standard mode” and the “dynamic mode” as described above.

  In the above example, the presence and the sense of relaxation are particularly mentioned, but there is no problem even if other psychological effects are added, and it is within the scope of the present invention. Further, the mode names and the switch arrangement order and configuration are not limited to specific ones including the illustrated examples, and the mode names or switch arrangement order and configuration are included in the present invention. .

  On the other hand, FIG. 6E (a) and (b) is a figure explaining the structure and function of a multifunctional light source which can be used as a light source which illuminates an effective visual field. The multifunctional light source that can be used for the above purpose is composed of a plurality of light sources (light source 1 to light source x: x is an arbitrary natural number of 2 or more), as schematically shown in FIG. 6E (a). The light source can perform lighting control, R / G / B light color variable control, light distribution variable control, and light direction variable control. FIG. 6E (b) schematically shows each of the above-described controls. The lighting control is a function capable of instantaneously turning on or off the light output, and the R / G / B light color variable control is the light control. Control that can change the output color freely, variable light distribution control means light distribution of light output (indicated by concentric ellipses in the figure), that is, a function that can control the light spread angle, variable light direction The control is a function that can change the direction of the light source in any direction by a rotating operation or the like.

  On the other hand, FIG. 6F (a) and (b) is a figure explaining the structure and function of a multifunctional light source which can be used as a light source which illuminates a guidance visual field. The multifunctional light source that can be used for the above purpose is composed of a plurality of light sources (light source 1 to light source x: x is an arbitrary natural number of 2 or more) as schematically shown in FIG. 6F (a). The light source can perform lighting control, R / G / B light color variable control, light distribution variable control, and light direction variable control. Each of these functions is as described above. A feature of the light source of the present invention is that, as shown in FIG. 6F (b), fine lighting control can be performed by arranging each light source at a particularly high density. FIG. 6F (b) is a diagram schematically showing how light is emitted from each light source. By arranging a plurality of light sources at a high density in this way, the characteristics of the human guidance visual field are sufficiently obtained. It is possible to realize the lighting that makes the most of it.

  The lighting control method described above may be realized with any lighting fixture or light source. As the number of light sources and the number of circuits that control the light sources increases, finer control is possible.

The above is the result of the experiment in the case where there are a plurality of light sources, but considering the practical situation, the control should be as simple as possible. Therefore, next, an experiment was conducted for the case where the light source of one circuit was controlled to enhance the presence.
The experiment was conducted in the laboratory shown in FIG. The illuminance and light color of each illumination output unit 1 in FIG. 1 can be individually adjusted by a simple operation using a computer. For evaluation, 20 characteristic evaluation scenes were extracted from various environmental videos or movie videos. Each evaluation scene was 3 minutes in length, and the scenes to be projected were selected with little change in illumination.

  In the experiment, subjects (viewers) 4 were seated one by one on the chair 3 in the center of the laboratory, and a notebook computer for lighting control was held at hand. The subject 4 was instructed to “adjust indoor lighting conditions so as to increase the presence of the screen of the image display device 2”, and the indoor lighting conditions were adjusted for each evaluation scene over 3 minutes. The test subjects 4 were 12 men, 6 men and women (age 25 to 50 years old) as in the previous experiment.

  As a result of averaging the indoor illuminance, luminance distribution, and chromaticity data obtained by the experiment for all subjects, the relationship between the set indoor chromaticity and the image chromaticity is shown in FIG. 7A. It became clear.

  FIG. 7A is a chromaticity diagram expressed in the XYZ color system. On the chromaticity diagram, standard light D65 ((0.3127, 0.3290), average white of the image display device 2 used this time is shown. The point is set to D65), the average chromaticity S (x, y) of the entire screen of the image display device 2, and the average chromaticity S ′ of the background portion excluding the main object from the entire screen of the image display device 2 ( x ′, y ′). Furthermore, the average chromaticity of the indoor lighting obtained in the experiment is indicated by a point P (Xp, Yp).

  From FIG. 7A, the average chromaticity p of the indoor lighting obtained from the experiment connects the average chromaticity S (x, y) of the entire image display device image and the standard light D65 (0.3127, 0.3290). It became clear that there was almost on the line.

On the other hand, the illuminance level obtained in the experiment was about 50 lx. Under this illuminance condition, the wall surface luminance behind the main body of the image display device 2 is about 80% of the average luminance of the entire screen of the image display device 2. Met. Further, when the average chromaticity p of the room lighting obtained from the experiment is compared with the average chromaticity S ′ (x ′, y ′) of the background portion excluding the main object from the entire screen of the image display device 2, S Although the same tendency as in the case of the point, the average chromaticity p of the indoor lighting is the average chromaticity S (x, y) of the entire image of the image display device 2 and the standard light D65 (0.3127, 0.3290). It has become clear that it is surely placed on the line connecting and, and that the S ′ coordinate is closer to the P coordinate than the S coordinate.
From the above, in order to obtain a sense of presence of the image display device image, the wall surface behind the image display device main body is compared with the average chromaticity of the background portion excluding the main object such as a human being in the image, It was found that it was necessary to control the room lighting so that the lighting conditions were almost the same and the saturation and brightness were slightly lower. Further, it has been clarified that substantially the same effect can be obtained by performing similar control on the average chromaticity of the entire image instead of the average chromaticity of the background portion excluding the main object.

Furthermore, from the above experiments, it has been clarified that it is important that the color of the main object on the screen looks vivid in order to enhance the presence. That is, 7 out of 12 subjects answered that there are two types of indoor lighting conditions that enhance the realistic sensation of the screen of the image display device.
The average of another answer is the point Q (Xq, Yq) in FIG. 7A. This point Q is on the opposite side of the point S (x, y) and the point S ′ (x ′, y ′) to the white point of D65. However, since both conditions of the P point and the Q point cannot be satisfied at the same time, a method of selecting any method from a plurality of options in a form such as “mode selection” is appropriate.
Furthermore, as a result of detailed analysis based on the opinions of the subjects, the subjects did not adjust the indoor lighting to match the average chromaticity of the background of the screen, but instead of the scene displayed on the screen of the image display device. It became clear that the indoor lighting was adjusted so that the lighting and the indoor lighting were continuous. Regarding the continuity of lighting, Mitsuo Ikeda and others are conducting an evaluation experiment on the continuity between indoor lighting and outdoor lighting separated by a glass window.

  Ikeda et al. Can specify indoor lighting conditions relative to outdoor lighting conditions (illuminance level, color temperature) so that people in the room feel that "indoor and outdoor lighting is continuous." The indoor illumination conditions at this time are not the same high illumination as the outdoors, but the conditions that match the illumination conditions of indoor lighting, which is about 1/100 of the outdoors. It was clarified that there are few individual differences in the indoor lighting conditions to feel. The theory of lighting continuity by Ikeda et al. Confirms the results of this experiment, and the results of this experiment show that the scene of the image display device and the lighting in the viewing room feel continuous. By setting the illumination, it can be interpreted that the presence of the image of the image display device is felt to be improved.

The impression of lighting (illumination impression), such as what light source is used to illuminate the interior of the room (illumination impression), is especially the appearance of a white surface such as a piece of paper or the glossiness of a metal doorknob. It is thought to be judged based on how a certain surface is seen. In order to investigate this, the subject analyzed the lighting conditions with the image display device image, and as a result, the subject was also able to match the chromaticity of the whitest one displayed on the screen. It was confirmed that was adjusted. As for the illuminance in the room, as a result of analyzing the correspondence between the obtained illuminance value and the highest brightness part of the background part excluding the main object of the image, there is a positive correlation between the two, And the relationship of the following formula (1):
Y = 1.04 · L + 20 (1)
Existed. Y is the illuminance (lx) in the room, and L is the average luminance (cd / m 2) of the screen.

  When using equation (1), it is necessary to correct according to the luminance characteristics of the display. The correction method is not complicated, and it is only necessary to multiply the illuminance value obtained by the equation (1) by the ratio of the maximum luminance of the display to the maximum luminance of 120 cd / m 2 of the actually used television. However, the correlation coefficient of the regression equation was not so high as 0.59.

For this reason, next, each subject used in the experiment was shown to the subject, and the lighting impression of the screen was reported by the illuminance value. As a result of comparing the reported value with the illuminance data previously adjusted with the keyboard, there is a certain correspondence between them, and the illuminance value in the laboratory with respect to the illuminance of the illumination impression on the screen is the following equation (2):
Y = 0.098 · E + 10.2 (2)
It became clear that it can return. Y is the illuminance (lx) in the room, and E is the illuminance (lx) reported for the lighting impression in the screen.

  Since the correlation coefficient of the regression equation of equation (2) is as high as 0.78, the room illuminance when the room is felt to be continuous with the screen is approximately 1 / of the illuminance reported as the screen lighting impression. 100 is considered. For this reason, when accurately calculating the room illuminance that is felt to be continuous with the screen, the illuminance value of the lighting impression of the screen is temporarily used rather than simply predicting and calculating from physical data such as screen brightness. It is considered that it is better to evaluate and obtain the illuminance value by multiplying by 1/100. However, this method has a demerit that it is not only impossible to analyze in real time but also the labor of the creator because it is necessary to set the illumination control condition in advance according to the image of the image display device. Therefore, practically, it is desirable to adopt an illumination control method in which the hue is substantially the same as the above-mentioned average chromaticity of the screen, and the saturation and luminance are set to be slightly lower.

  The method for determining the appropriate illumination condition for the still image has been described above.

  In general, a general image is not a still image but a moving image. Then, next, we examined whether there would be any problems when linking lighting to movies. As a result, the following problems were found.

  (1) In the case of a moving image in which the image changes drastically, flicker or discomfort may be felt if the lighting is controlled in synchronization with the image signal for each frame.

  (2) If the method of changing the illumination in real time according to the result of the image processing is taken, it takes time for the image processing, so that the illumination control may be delayed for the image, which is unnatural and uncomfortable. You may feel it.

(3) When the brightness of the image is low, the lighting control may appear to malfunction.
With respect to (1) above, as a result of image analysis, when the frequency of the change in illumination to be controlled is likely to be a frequency at which humans feel flicker of about 60 Hz or less, a method of compressing the level of change in illumination, The range of flicker frequency for humans, such as the method of processing the average value of images over a certain period, the method of omitting frames, the method of controlling (changing) lighting only when the image changes beyond a certain threshold, etc. Can be solved by avoiding. The “certain threshold” at this time is a threshold value of about ¼ of the maximum luminance.

  7B (a) and 7 (b) show flickering and discomfort that is felt when the illumination changes in synchronization with a rapidly changing image. When the illumination is changed with respect to the average value for a certain period of time, the average output signal value of a certain part of the image (see FIG. 7B (a)) and the output value of the illumination linked to it (signal value, FIG. 7B) A correlation diagram between (b) and elapsed time is shown. As shown in FIG. 7B (a), the signal value of an image often changes instantaneously when the screen is switched between images, but flickering or discomfort is caused if the signal value of the illumination is changed instantaneously in the same way. There are many cases. Therefore, in FIG. 7B (b), the signal value of illumination synchronized with the image signal value is set to a value obtained by averaging the data for each of the five images before and after the image. The period for calculating the average value is desirably a period that matches the characteristics of the visual field, and the relaxation control method of the light source corresponding to each visual field is included in the present invention not only in the same case but also in different cases. The average value data is used when only the image data before the image data to be synchronized is used, only the image data after the image data to be synchronized is used, or the data is discretely selected and used. Cases are also included in the present invention. Further, the number of image data to be averaged may be two or more.

  Regarding (2) above, the human eye can recognize even a slight time lag. For this reason, there should be no time lag between the image and the illumination. Since this permissible value is considered to be about 1 second, it is necessary to devise so as not to cause any further time difference. For example, once image data is stored in memory and the analysis of the image is completed and the lighting conditions are clarified, a method of outputting the image and lighting at the same time, and a device-dependent data format to speed up data transfer This can be solved by using a method of sending a signal, a method of saving time by analyzing every few frames instead of analyzing images of all frames.

  The above problem (3) means that when the luminance of the image displayed on the image display device is low and the chromaticity is low, the illumination may become an unexpected light color. . This occurs for the following reasons. In other words, the low luminance and low saturation colors all appear black regardless of the hue. However, when the chromaticity is analyzed, it has some hue. When the illumination is controlled so as to match this chromaticity by the highly realistic lighting control method, the appearance may be a vivid light color because of the light source color.

In order to avoid this problem, it is preferable to use a method such as turning off the lighting or changing to white with low luminance when the luminance falls below a certain luminance or saturation.
As described above, the lighting control method described in the present embodiment is referred to as a high realistic lighting control technique or a high realistic lighting control algorithm.

  In order to separate a main object such as a person from the background, an image compression technique currently being actively researched and developed in the multimedia field can be applied.

  For example, in the already standardized MPEG2 method of image compression, in order to eliminate the redundancy of moving images, an object with a lot of movement is extracted as a main object, and a thing with a little movement is determined as a background. Only the information of the main object with much movement is transmitted, and the background information with little movement is transmitted with low frequency. Therefore, in a sense, the background and the main object are already separated, and both are taken out independently before being combined by a decoder such as a DVD video deck, and only the background portion is processed, It is easy to obtain the average chromaticity and average luminance.

  The MPEG4 system, which is currently being put into practical use, employs a system in which a main object and a background part are photographed at the time of photographing, and both pieces of image information are transmitted separately. In this case, it is easier to obtain the image information of the background portion, and the transmitted background image information signal may be used as it is.

  In the future, if information on the position of the light source and the characteristics of the light source (type of light source, spectral distribution, light distribution, light color, etc.) will also be incorporated into the compressed image data, the extraction of the light source can be made easier. become.

  FIG. 7C is a diagram schematically illustrating a configuration in which data is transmitted in the form of a color / brightness signal so that data conversion according to the viewer's preference is facilitated. As the color / brightness signal, for example, a device-independent signal such as (Y, x, y) is the same regardless of which device it is converted to, and what color it is converted to It is most effective because it can be easily grasped.

  On the other hand, FIG. 7D is a diagram schematically showing a configuration for transmitting data such as a dimming signal in a device-dependent form such as a lamp output voltage value in order to increase the data transfer rate. Since a value such as a lamp output voltage is transmitted as it is, the time from when the signal is transferred to when the illumination is output is fast. However, at the time of data conversion, it becomes very difficult to convert to the target color / brightness. Therefore, when speed is required but it is not necessary to accurately convert to the target color / brightness, it is desirable to transmit data in a device-dependent form such as a lamp output voltage value.

(Second Embodiment)
8 and 9 show the configuration of the illumination device according to the second embodiment of the present invention. 8 and 9 includes an image sound reproduction unit 6, a data recording device 7, an illumination control unit 8, an illumination output unit 9, and an image sound output unit 10.

  The data recording device 7 may be a new one, but may be any recording device that is currently popular, such as a video tape, CD, or DVD, or a recording device dedicated to the present invention. In addition, in addition to image or sound data, or both, illumination control data corresponding to them is recorded. The data recording method and format (including analog / digital) are not limited.

  The image / acoustic reproduction unit 6 has a function of reproducing image data and / or sound data recorded in the data recording device 7 in advance, and illumination control data, and an image / acoustic output unit (image display device) such as a television set. 10 and the illumination control unit 8 and the like. The illumination control data at this time is data relating to the dimming level of each lamp built in the illumination output unit 9.

  The illumination control unit 8 has a function of performing illumination control based on the illumination control data sent from the image sound reproduction unit 6, and the dimming level data of each lamp built in the illumination output unit 9 is output as an illumination output. The signal is sent to the illumination output unit 9 in a signal form corresponding to the lighting method of the unit 9.

  The illumination output unit 9 includes one or a plurality of lamps and a lighting circuit, and has a function of freely changing the light intensity, light distribution, and color temperature. For example, RGB single color fluorescent lamps may be incorporated and the color temperature may be changed from white light to monochromatic light by changing the dimming ratio, or between about 3000K and about 6700K. A commercially available lamp may be built in, and the color temperature may be changed by changing the dimming ratio. Further, these fluorescent lamps may be combined with a highly directional lamp such as a halogen lamp, and the light distribution may be changed by switching between the two. Further, the light color and light distribution may be changed by combining display devices such as liquid crystal, LED, CRT, PDP, and EL.

  Of the data recorded in the data recording device 7, data relating to image sound is sent to the image sound output unit 10. An image is displayed on the display included in the image sound output unit 10, and sound flows from the speaker. At the same time, the illumination control data recorded in the data recording device 7 is sent to the illumination control unit 8. The illumination control unit 8 converts the lamps incorporated in the illumination output unit 9 into dimming signals based on the received data, and sends the received signal to the illumination output unit 9. In the illumination output unit 9, each lamp incorporated therein is turned on at a level corresponding to the dimming signal. Thereby, an indoor environment full of realism can be realized.

  What is most important here is a lighting control method that enhances the sense of presence of the viewer 4 who is viewing images and sounds, and there are several methods.

  The most effective method is a method in which a highly sensitive lighting designer performs the most effective lighting production according to image and sound data. This is because, in the above-described experiment, it is clear that it is most effective for a skilled person to find the condition of room illuminance that allows continuity of the lighting impression in the screen in order to enhance the presence of the screen. Became. Moreover, since a lighting designer generally has a high sensitivity through work of lighting production such as a theatre as a stage lighting director, it is possible to appropriately determine such lighting conditions. In addition, the more famous the lighting designer who performs the lighting effect, the more valuable the image / sound / lighting software sold and sold in the form of the data recording device 7. On the other hand, when it is desired to reduce the cost, it is also possible to mechanically create illumination control data for the image sound by using the above-described high presence illumination control technology.

  Further, as an illumination control method linked to sound, for example, a method of increasing the illuminance level when the volume is high and decreasing the illuminance level when the volume is low is effective.

  The illumination control unit 8 may control the plurality of illumination output units 9 using not only one circuit as illustrated but also a plurality of circuits. Furthermore, the illumination output unit 9 is preferably hidden so that it cannot be seen by the viewer 4.

(Third embodiment)
In FIG. 10, the structure of the illuminating device in the 3rd Embodiment of this invention is shown. 10 includes an image sound receiving unit 11, an image sound reproduction unit 6, an image sound storage unit 12, an image analysis unit 13, an image sound illumination control unit 14, an image sound output unit (image display device) 10, and an illumination. An output unit (lighting fixture) 9 is included.
The image analysis unit 13 has a function of inputting an image signal, analyzing the signal, performing arithmetic processing from the analysis result to generate various signals, and outputting the various signals. The image acoustic illumination control unit 14 has a function of inputting an image signal, an acoustic signal, and an illumination signal and outputting the acoustic signal and the illumination signal in synchronization with the timing at which the image signal is imaged. The illumination output unit 9 includes one or more lamps and a lighting circuit, and has a function of inputting an illumination signal and freely changing the intensity, light distribution, and color temperature of the illumination light based on the signal. The image signal indicates at least a color signal and a luminance signal of each pixel of each image. The signal system and signal order may be in any form.

  The image signal and the sound signal supplied from the image sound receiving unit 11 or the image sound reproducing unit 6 are temporarily stored in the image sound storage unit 12. The image signal stored in the image sound storage unit 12 is image-analyzed by the image analysis unit 13, lighting conditions that can enhance the realistic sensation of the image are calculated, and an illumination signal necessary for controlling the lighting fixture is generated. The

The image signal, the sound signal, and the illumination signal are input to the image sound illumination control unit 14, and the image signal and the sound signal are transmitted to the image sound output unit 10 so as to be synchronized with the timing at which the image is projected. Is transmitted to the illumination output unit 9. As a result, the occupant viewing the image has a high sense of realism due to the image, sound, and illumination output synchronously from the image sound output unit (for example, the television) 10 and the illumination output unit (lighting fixture) 9. While feeling, it is possible to enjoy the image displayed on the image sound output unit 10.
In addition, since the illuminating device of this invention can generate | occur | produce the image and the illumination light which improves the realistic feeling of an image, if an image signal is input into the image sound memory | storage part 12, the image sound receiving part 11 and an image sound reproduction | regeneration part Needless to say, it is not always necessary to provide both of 6 and it is sufficient to have at least one of them.

  Further, when sound is not required, each of the image sound receiving unit 11, the image sound reproducing unit 6, the image sound storage unit 12, the image sound illumination control unit 14, and the image sound output unit 10 in the configuration of FIG. Needless to say, it is not necessary to have a function for processing sound.

  10 includes an image sound receiving unit 11, an image sound reproducing unit 6, an image sound storage unit 12, an image analysis unit 13, an image sound illumination control unit 14, an image sound output unit 10, and an illumination output unit 9. May be configured as separate devices, or two or more components may be integrated so that, for example, the image and sound reception unit 11 and the image and sound reproduction unit 6 are image and sound reception and reproduction units. It may be configured.

  The illumination control unit 8 may control the plurality of illumination output units 9 using not only one circuit as illustrated but also a plurality of circuits. Furthermore, the illumination output unit 9 is preferably hidden so that it cannot be seen by the viewer 4.

(Fourth embodiment)
In FIG. 11, the structure of the illuminating device in the 4th Embodiment of this invention is shown. The lighting device of FIG. 11 includes a sensor unit 15, a data analysis unit 16, a lighting control unit 8, and a lighting output unit (lighting fixture) 9.

  The sensor unit 15 has a function of measuring the luminance and color temperature of an image displayed on the screen of the image sound output unit (image display device) 10 and sending the data to the data analysis unit 16. The data analysis unit 16 determines the lighting condition that increases the realistic sensation of the screen based on the information on the luminance and color temperature of the image measured by the sensor unit 15, and the signal of the output level of each lamp of the lighting output unit 9. Is sent to the lighting control unit 8. The functions of the illumination control unit 8 and the illumination output unit 9 are the same as those in the third embodiment.

  In the configuration of FIG. 11, the image sound output unit (image display device) 10 is provided as a separate device from the illumination device, but may be configured to include this.

  In the above, the means for enhancing the sense of reality centered on the image has been described. However, if lighting requirements that enhance the sense of reality for the sound such as the scale and timbre can be found, the lighting control according to the sound is performed. , Can enhance the sense of reality. Furthermore, by combining the three of image, sound, and lighting, the sense of reality can be enhanced most effectively.

(Fifth embodiment)
FIGS. 12A and 12B show a configuration of an example of the illumination output unit of the illumination apparatus according to the fifth embodiment of the present invention.

FIG. 12A shows the image sound output unit 10, the illumination output units 9 a and 9 b, and the illumination fixing units 17 a and 17 b that fix the illumination output unit 9 to the image sound output unit 10. The illumination fixing units 17a and 17b are provided with unnecessary illumination output units 9a and 9b when viewing images of television and video without using the illumination effect by the illumination output units 9a and 9b, or when not viewing images. It has a function for storing in the image sound output unit 10. Accordingly, a type in which the illumination output unit 9a is hooked, such as the illumination fixing unit 17a, a type in which the illumination output unit 9b is accommodated, such as the illumination fixing unit 17b, and further, although not shown, the image output unit 10 can be accommodated. It may be a type.
FIG. 12B illustrates a state in which the illumination output units 9 a and 9 b are separated from the image sound output unit 10. The cord 20 connecting the image sound output unit 10 and the illumination output unit 9a functions as at least a transmission line for transmitting an illumination signal to the illumination output unit 9a. With this configuration, the position of the illumination output unit 9a can be set freely. Needless to say, the cord 20 may be used as a transmission line for supplying electric energy to the illumination output unit 9a in addition to the illumination signal.
Or the code | cord | chord 20 is omissible by using the illumination signal output part 18 provided in the image sound output part 10, and the illumination signal input part 19 provided in the illumination output part 9b. Specifically, the illumination signal output unit 18 has a function of outputting an illumination signal, and the illumination signal input unit 19 has a function of receiving the output illumination signal. With such a configuration, since it is cordless, the position of the illumination output unit 9b can be set more freely. The electrical energy required for the illumination output unit 9b may be supplied by providing an electrical energy source to the illumination output unit 9b, or may be supplied to the illumination output unit 9b from a power source (not shown) provided elsewhere. .

The illumination fixing portions 17a and 17b and the illumination output portions 9a and 9b may be of different types as shown in the drawing, or may be the same type, or a type that is only in one place. There may be. In the illustrated example, the illumination output unit 9a having the cord 20 is fixed by the hook-type illumination fixing unit 17a, and the cordless type illumination output unit 9b is fixed by the storage type illumination fixing unit 17b. The combination is not limited to the above.
FIG. 13 is a diagram illustrating a configuration example of the hook-type illumination fixing unit 9a, and illustrates a part of the image sound output unit 10, the illumination output unit 9a, and the illumination fixing unit 17a. The illumination output unit 9a is provided with a recess 21 for fixing by the illumination fixing unit 17 in the vicinity of the center, and light emitting units 23 are provided on both sides thereof. In addition, the illumination fixing unit 17 is attached to the image sound output unit 10 via the pairing unit 22.

  By fitting the recess 21 of the illumination output unit 9a into the ring portion (partially missing) of the illumination fixing unit 17a, the rotation function indicated by the arrow 20a can be performed while the illumination output unit 9a remains attached to the image sound output unit 10. Realized. On the other hand, the coupling part 22 is for giving the illumination output part 9a a function of rotating in the direction of the arrow 20b and changing the position in the direction of the arrow 20c. With such a configuration, it is possible to change the light direction of the illumination output unit 9a while the illumination output unit 9a is attached to the image sound output unit 10.

  The concave portion 21 and the paired portion 22 are not limited to the shapes described in FIG. 13 as long as they can be rotated and changed in the direction of the arrows 20a, 20b, or 20c in the figure. Needless to say, the configuration may be as follows.

  In controlling the illumination output units 9a and 9b, each may be controlled by a separate control circuit, or both may be controlled by one circuit. Furthermore, the illumination output unit 9a or 9b is preferably arranged at a position where it cannot be seen by the viewer. Further, a light shielding plate that hides the light emitting unit 23 may be provided.

(Sixth embodiment)
With reference to FIG.14 and FIG.15, the illuminating device in the 6th Embodiment of this invention is demonstrated.

  The illuminating device of FIG. 14 constitutes a television frame luminaire 24. The lighting fixture 24 is a type of lighting fixture that is attached to a frame portion around a television screen, and is composed of a light source such as an RGB LED or a cold cathode fluorescent lamp and a light guide plate. As the light source, any type of light source that is currently on the market or will be put into practical use can be used. For example, an EL panel (including an organic EL) is provided on the front surface of the illumination output unit. The surface light emitter may be provided as a light source, or the display itself such as a liquid crystal panel whose light color can be arbitrarily changed may be used as a light source. Further, a method of guiding leakage light from a CRT or the like of the image display device may be used.

  Regardless of which means is used, the lighting fixture 24 controls the light color, brightness, etc. of the light emitting surface in conjunction with the image of the image display device in accordance with the lighting control method of the present invention that improves the sense of reality.

  At this time, the lighting device 24 in the light emission color mode is attached to the periphery of the screen of the image display device in the pseudo light emission color mode, so that the image displayed on the screen of the image display device in the light emission color mode is in the light emission color mode. It is confined by the frame and enters the object color mode. Therefore, an effect that a color existing only in the object color mode such as brown looks more like an original brown than when viewed on the screen of a conventional image display device can be obtained.

  On the other hand, the illuminating device of FIG. 15 constitutes a television side illumination output unit 25 and has a structure in which a light source such as an RGB LED or a cold cathode fluorescent lamp is attached to the side surface of the television body. This luminaire 25 is also controlled by the illumination control method of the present invention that improves the sense of reality, and illuminates the peripheral visual field of the image display device.

  Note that both the television frame lighting device 24 in FIG. 14 and the television side lighting device 25 in FIG. 15 may be integrated with the image display device by being embedded in the main body of the image display device. Alternatively, the image display device may be attached as a separate device to the main body of the image display device.

(Seventh embodiment)
FIG. 16 shows a projector-type illumination output unit 26, that is, an illumination device in the form of a projector, as the illumination device according to the seventh embodiment of the present invention.

  A conventional projector condenses light transmitted through a liquid crystal panel or the like with a lens and projects it onto a screen surface or the like. In such a conventional projector, the optical design of the lens is difficult in order to increase the light utilization efficiency and prevent light from leaking around the image 28. However, in reality, there is a large amount of light that cannot be completely collected by the lens but is leaked or wasted in the projector.

  On the other hand, in the projector-type illumination output unit (projector-type illumination device) 26 of the present embodiment, such light is not wasted and appropriately emitted to the screen surface as a realistic sensation-enhanced illumination image 29. The presence of images can be enhanced. Moreover, it discharges | emits through the window which stuck the milky white board like the light emission surface 27 for room illumination also indoors. These emitted lights are controlled according to a highly realistic lighting control algorithm according to the present invention.

(Eighth embodiment)
With reference to Fig.17 (a) and (b), the structure of the illumination output part of the illuminating device in the 8th Embodiment of this invention is demonstrated.

  Each illumination output part 30-32 of Fig.17 (a) is each installed in order to illuminate each visual field part shown to FIG. 5A. That is, the effective visual field illumination output unit 30 illuminates the effective visual field, the guidance visual field illumination output unit 31 illuminates the guidance visual field, and the auxiliary visual field illumination output unit 32 illuminates the auxiliary visual field.

  The difference between each of the illumination output units 30 to 32 and the conventional wall lighting fixture is that the conventional wall lighting fixture has a light distribution that illuminates the wall surface as uniformly and efficiently as possible. On the other hand, in the illumination output units 30 to 32 of the present embodiment, the wall surface behind the image sound output unit 10 such as a TV, which is the center of the viewer's effective visual field, is at the viewer's line-of-sight height (= near the center of the TV screen). It is a point that has a light distribution that illuminates to the maximum illuminance. For this reason, each illumination output part 30-32 of this embodiment is provided with the substantially parabolic condensing reflecting plate 34 so that sectional drawing may be shown in FIG.17 (b).

  Further, based on the above-described theory of illumination impression, it is considered that it is more effective to hide the light source and the light emitting portion of the viewing space from the viewer, so the light shielding louver 35 is installed. The light emitted from the light source unit 33 is reflected or collected directly or by the light collecting / reflecting plate 34, and the direction of the light is controlled by the light shielding louver 35 to be irradiated toward each visual field unit. The viewer cannot see the light emitting units 33 of all the illumination output units 30 to 32, so even if the presence of the illumination output units 30 to 32 can be confirmed, it is not known whether or not they are emitting light.

  Signals to each of the lighting output units 30 to 32 are sent through the wiring behind the ceiling. However, even if the arrangement of the TV is changed, that is, the positional relationship of each field of view is changed, the wiring is physically connected. It is possible to change the specifications simply by changing the address of the control device without changing to. However, for this purpose, it is desirable to install the illumination output units 30 to 32 in advance on the ceiling near the wall at as uniform intervals as possible. Further, the transmission of the control signal can be easily accommodated to installation or change of arrangement by making it cordless using infrared rays or radio waves.

  In addition, as each illumination output part, the conventional wall surface lighting fixture can also be used. However, when selecting from among conventional wall lighting fixtures, it is possible to select on the condition that lighting control is possible and that the light distribution is sufficiently shielded so that the light emitting part is not visible to the viewer. desirable.

  Although details are not described in the figure, since the effective visual field of humans has a high visual function, the effect is further improved particularly when the illumination of the effective visual field part is further enhanced. Specifically, a large number of LEDs and other display elements may be attached to the periphery of the image sound output unit 10 so that the image looks as if it extends to the outer wall surface.

  Further, in order to realize a state in which highly directional light is irradiated toward the viewer, a spot lighting device is attached in the vicinity of the effective visual field lighting device 30, and according to the state of the image. If it blinks, the power increases. If this spot has a light color variable function, the effect is further enhanced.

(Ninth embodiment)
With reference to FIG.18 and FIG.19 (a)-(c), a lighting fixture is demonstrated as the illuminating device in the 9th Embodiment of this invention.

  The luminaire of FIG. 18 is a light color variable luminaire 36 having a light emitting unit 23 whose light color can be arbitrarily changed. The individual lighting fixtures 36 can be placed in an arbitrary position like a desk lamp so that they can be easily enjoyed at home even without a large lighting device. In FIG. 18, as an example, a state in which one lighting fixture 36 is arranged at a position corresponding to each of the effective visual field, the guidance visual field, and the auxiliary visual field in FIG. 5A is illustrated.

  This luminaire 36 has no power line and has a built-in rechargeable battery. Further, there is no signal line, and a signal is sent from the illumination control unit 8 in a cordless manner by infrared rays or the like. However, it goes without saying that the power supply line and the signal line may be provided in a wired manner.

  Further, in accordance with the idea of lighting impression, the light color variable lighting device 36 is installed behind the image sound output unit 10 or indoor furniture so that the light emitting unit 23 of the lighting device 36 is not visible to the viewer. In addition, by placing the light shielding plate 37 in front of the light color variable lighting device 36 to shield the light, the effect of improving the sense of reality is further increased. The light-shielding plate 37 may be a diffusely transmissive plate such as a milky white acrylic plate.

  By controlling the individual light color variable lighting fixtures 36 having the above-described features according to the high realistic lighting control method according to the present invention, the viewer can easily enjoy high realistic images at home. .

  Further, FIGS. 19A to 19C show a specific form of the light emitting unit 23. The configuration of the lamp-shaped light-emitting portion 23 shown in the figure is an alternative to a light bulb as an example, and has an Edison-based base 42. In the diffusion plate 41 provided on the base 42, a red light emitting unit 38, a green light emitting unit 39, and a blue light emitting unit 40 are built. The light emitting units 38 to 40 of the respective colors are adjusted in light emission intensity levels in response to the control signal sent from the illumination control unit, and the color light emitted from the light emitting units 38 to 40 of the respective colors is mixed by the diffusion plate 41. And irradiated indoors.

  The red light emitting unit 38, the green light emitting unit 39, and the blue light emitting unit 40 may have a configuration similar to the form of a light emitting element currently used in a display device as shown in FIG. Alternatively, as shown in FIG. 19B, each of the light emitting units 38 to 40 may have a configuration similar to that of a light bulb alternative type fluorescent lamp having a light emitting tube shape.

  Note that the sizes and shapes of the red, green, and blue light emitting portions 38 to 40 do not have to be the same, and the size and shape of the light emitting portions 38 to 40 may be changed as appropriate in order to reduce the size of the lamp. Good. For example, in general, the green phosphor has good luminous efficiency, whereas the blue phosphor has poor luminous efficiency. Therefore, as shown in FIG. 19C (the base is omitted), the blue light emitting unit 40 May be larger than the other light emitting portions 38 and 39. Thereby, each light emission part 38-40 is accommodated in the inside of the diffusion plate 41 efficiently.

  Note that the base included in the light emitting unit 23 is not limited to the shape of the bulb replacement type as illustrated, and may be any form of base.

(Tenth embodiment)
With reference to FIG. 20, the illuminating device in the 10th Embodiment of this invention is demonstrated.

  The lighting fixture 45 installed on the ceiling as the lighting device of the present embodiment is composed of a plurality of light emitting units with high directivity. Each light emitting unit can be changed to an arbitrary light color. Since each light emitting part has high directivity, various light changes can be produced as if an image is projected from the ceiling toward each wall surface (in the direction of the arrow in the figure). As a light emission part, arbitrary forms, such as a structure using a light emitting element, such as a projector shape and LED, can be used. Since current LEDs have a low output level, a large number of LEDs must be used to apply to such a luminaire 45, but future technological innovation can be expected to significantly improve the output of LEDs. The possibility of future application is high.

  By controlling the lighting fixture 45 based on the high presence lighting control technology according to the present invention, the viewer 49 feels an illusion as if it exists in the virtual image space. Our experiments show that not only light but also the appearance of shadows are important for enhancing the realism of images. In this figure, shadow 46 in virtual image space and shadow 47 in viewing space Shadows 47 and 48 are generated so that the shadow 48 of the viewer 49 does not contradict the lighting impression of the virtual image space. Due to such an effect, the viewer 49 is so realistic that he / she wants to start surfing in the southern sea projected on the image of the image sound output unit (image display device, wall-mounted TV in the illustrated example) 50. It is possible to taste the feeling.

(Eleventh embodiment)
For example, as shown in FIG. 21, the lighting device according to the present invention may have a configuration that is controlled in conjunction with a telephone, an interphone, a mobile communication device, or a home appliance. In this case, a signal for controlling the lighting device is transmitted to the lighting device directly or via a computer from a telephone, an interphone, a mobile communication device, or a home appliance, and the lighting device is operated according to the transmitted signal. The device is controlled and the lighting changes. For example, it is possible to change and notify the illumination light when a call is received or when a visitor contacts from an interphone.

  FIGS. 22A and 22B schematically show the configuration of the present invention configured using a data line using a wired circuit or a wireless circuit.

  In the configuration of FIG. 22A, audiovisual data and audiovisual lighting data are transmitted from the Internet or mobile communication device to a computer through a data line. The transmitted data is reproduced by the image sound illumination reproduction device, and the illumination data is output from the illumination output unit (lighting fixture) via the illumination control unit. If the data sent from the Internet or mobile communication device is audiovisual data, after being transmitted to the computer, the image acoustic data is analyzed by a processing board or software installed in the computer, and the result is It is also possible to generate illumination data based on it. Alternatively, the image acoustic illumination data may be recorded in a data recording device and reproduced when desired.

  In FIG. 22B, a recording medium such as a CD-ROM or DVD-ROM is connected to a computer (for example, a notebook personal computer) from the Internet or a mobile communication device through a data line using a wired circuit or a wireless circuit. FIG. 2 schematically illustrates the configuration of the present invention configured to provide the necessary data. In particular, the configuration of FIG. 22B is that a lighting fixture including a lighting control unit and a lighting output unit is incorporated in a computer. This provides illumination light distribution as depicted by the concentric ellipses in the figure.

(Twelfth embodiment)
FIG. 23A shows a block diagram of a configuration of a lighting apparatus according to the twelfth embodiment of the present invention. The illumination device of the present embodiment includes an image acoustic illumination receiving unit 111, an image acoustic illumination reproducing unit 106, an image acoustic illumination storage unit 112, an image acoustic illumination control unit 114, and an image acoustic illumination output unit 110. FIG. 23B is a diagram schematically showing the configuration of the image acoustic illumination output unit 110 in the illumination device configured based on the above block diagram.
The image acoustic illumination control unit 114 has a function of inputting an image signal, an acoustic signal, and an illumination signal and outputting the acoustic signal and the illumination signal in synchronization with the timing at which the image signal is imaged. The illumination output unit 109 in the image acoustic illumination output unit 110 includes one or more lamps and a lighting circuit, inputs an illumination signal, and freely adjusts the intensity, light distribution, and color temperature of the illumination light based on the signal. It has a function that can be changed. The image signal indicates at least a color signal and a luminance signal of each pixel of each image. The signal system and signal order may be in any form.

The image signal, the acoustic signal, and the illumination signal received by the image acoustic illumination receiving unit 111 or reproduced and supplied by the image acoustic illumination reproduction unit 106 are stored in the image acoustic illumination storage unit 112 once. Alternatively, the image signal and the sound signal are transmitted to the image output unit 107 and the sound output unit 108 so as to be synchronized with the timing at which the image is displayed and input to the image sound illumination control unit 114 without being stored. The illumination signal is transmitted to the illumination output unit 109. As a result, the resident who is viewing the image can use the image, sound, and illumination output in synchronization with the image output unit (for example, television) 107, the sound output unit 108, and the illumination output unit (lighting fixture) 109. Thus, the user can enjoy the image displayed on the image output unit 107 while feeling high presence.
Note that if the image acoustic illumination signal is input to the image acoustic illumination control unit 114, the illumination device of the present invention can control the image and the illumination light that enhances the presence of the image. Needless to say, it is not always necessary to provide both of the image sound illumination reproducing units 106, and at least one of them may be provided.

  Moreover, when sound is not required, it is needless to say that each component shown in FIGS. 23A and 23B does not need to have a function of processing sound.

  Furthermore, each of the image acoustic illumination receiving unit 111, the image acoustic illumination reproducing unit 106, the image acoustic illumination storage unit 112, the image acoustic illumination control unit 114, and the image acoustic illumination output unit 110 may be configured as separate devices. Alternatively, for example, two or more components may be integrally configured such that the image acoustic illumination receiving unit 111 and the image acoustic illumination reproducing unit 106 are image acoustic illumination receiving and reproducing units. .

  The image acoustic illumination control unit 114 may control a plurality of output units by using not only one circuit but also a plurality of circuits. Furthermore, the illumination output unit 109 of the image sound illumination output unit 110 is preferably hidden so as not to be seen by the viewer.

  In FIG. 24, the configuration of the illumination device 120 configured by integrating all of the image acoustic illumination receiving unit, the image acoustic illumination reproducing unit, the image acoustic illumination storage unit, the image acoustic illumination control unit, and the image acoustic illumination output unit. Is schematically shown. In the figure, a front view of the illumination device 120 is shown to schematically show the arrangement of the image output unit 107, the sound output unit 108, the illumination output unit 109, and the reproduction unit 106 included in the image acoustic illumination output unit. , Side and top views.

  The device 120 in which the respective parts are integrated in this way has already been commercialized as a television / video integrated device and is widely used. Such an integrated device 120 is useful because it eliminates the need for wiring work during use. However, the integration device 120 according to the present embodiment has a configuration in which the illumination output unit 109 is further integrated with the conventional configuration, and can provide an improved sense of realism for the image. If the illumination output unit 109 is arranged behind the image output unit 107 and the sound output unit 108 from the viewpoint of the viewer, the illumination output unit 109 can be effectively hidden from the viewer, and the background and surrounding areas of the image The illumination light can also be output to the part, which is effective.

  FIGS. 25A and 25B schematically show a configuration in which the output of the image output unit can be used as the output of illumination light. FIG. 25A is a side view of this configuration, and in addition to the image display unit 107, a light guide unit 121 and an image control unit 122 are further provided in this order. The input image signal is converted into RGB output by the image control unit 122 and an image is displayed on the image display unit 107.

  The portion of the light from the image that actually reaches the viewer's eyes varies depending on the device of the image output unit 107, but is only a few percent of the total RGB output. Therefore, in the configuration of FIG. 25, light that is not actually used for image display is efficiently extracted from these RGB outputs and used for illumination of the peripheral portion of the image. Specifically, a part of the RGB output is guided to the image peripheral portion by the light guide unit 121 and used as light 123 that irradiates the periphery of the image output unit 107.

  FIG. 26 schematically illustrates a configuration in which light sources 131 are arranged at the left and right ends and the upper and lower ends of a goggle-type image output unit 132 as an example of another integrated configuration. As the light source 131, for example, an LED light source can be used. The illustrated configuration combined with the goggle type image output unit 132 eliminates the need for illumination in the viewing room, so that the effects described so far can be obtained with low light output.

  As the light source 131, in addition to the LED light source described above, other small light sources such as a cold cathode fluorescent lamp can be used.

  Further, FIGS. 27A and 27B schematically show a side view and a front view of a configuration in which the sound output unit (speaker) 108 and the illumination output unit (light source) 109 are integrated. . From the viewpoint of the viewer, the illumination output unit 109 is arranged behind the acoustic output unit 108, and from the viewer, the illumination output unit 109 is connected to the acoustic output unit 108 as schematically illustrated in FIG. In the hidden state, only the emitted light 143 can be seen, and an improved realistic effect can be obtained.

(13th Embodiment)
The light source or the luminaire that can be included in the lighting device of the present invention includes a light color variable control unit and a light distribution variable control unit as shown in FIG. 28 (d) in order to control the state of light used for lighting. , And one of the variable direction control units, or a combination of two or more.

  FIG. 28A is a configuration of a light source having any one of the above three control units (denoted as “A control unit”), and FIG. 28B is a diagram of the above three control units. FIG. 28 (c) shows a configuration of a light source having any two of them (denoted as “A control unit” and “B control unit”). FIG. 28 (c) shows all three control units (“A control unit”, “B” A configuration of a light source having a “control unit” and a “C control unit” is schematically illustrated. “A control unit”, “B control unit”, and “C control unit” in these are the light color variable control unit, light distribution variable control unit, and direction variable control unit shown in FIG. Corresponds to either.

  Further, FIGS. 28E to 28K separately depict functions that can be further added to the light source. The receiving unit in FIG. 28E has a function of receiving an illumination signal, an image signal, and / or an audio signal. The data analysis unit in FIG. 28F has a function of analyzing a received image signal and / or audio signal and generating a predetermined illumination signal. The data mapping unit in FIG. 28G has a function of selecting a predetermined illumination signal by associating (mapping) the received image signal and / or audio signal with a previously stored illumination signal. The sensor unit in FIG. 28 (h) has a function of measuring various output values useful for lighting control. The reproduction unit in FIG. 28 (i) has a function of reproducing an illumination signal, an image signal, and / or an audio signal. The storage unit in FIG. 28J has a function of storing illumination signals, image signals, and / or audio signals. The transmission unit in FIG. 28 (k) has a function of transmitting the illumination signal, the image signal, and / or the audio signal to another device (for example, each output unit that is remotely located) located remotely.

  By properly incorporating one or more of these into the light source, their functionality is added to the light source.

  When the light source as described above is configured as a lighting fixture, the configuration described above is accommodated in an appropriate envelope, for example, as schematically shown in FIGS. do it. At this time, the light emitting unit and the control unit of the light source may be housed in separate envelopes 151 and 152 as illustrated in FIGS. 29A to 29C, or may be integrated. You may store the whole in an envelope.

(Fourteenth embodiment)
In the present embodiment, the illumination is linked to the image projected on the image display device (image sound output unit) such as a television and also linked to the emotion and mood of the viewer who is viewing the image. A configuration of a lighting device that can be controlled will be described.

FIG. 30 is a block diagram schematically showing the configuration of the illumination device. Specifically, the lighting device includes an image sound receiving unit 161, an image sound reproducing unit 166, a biological / emotion information measurement unit 165 of the viewer, an image sound and biological / emotion information recording unit 162, an image sound and biological / An emotion information analysis unit 163 and an image sound illumination control unit 164 are included.
The functions of the image sound receiving unit 161 and the image sound reproducing unit 166 are the same as the functions of the corresponding components described in the above embodiments, and the description thereof is omitted here.

  The image signal and sound signal supplied from the image sound receiving unit 161 or the image sound reproducing unit 166 and the information signal supplied from the living body / emotion information measuring unit 165 are temporarily recorded in the image sound and living body / emotion information recording unit 162. Is sent to the image sound and biological / emotion information analysis unit 163 without being recorded. The image sound and biological / emotion information analysis unit 163 analyzes part or all of the received signal, calculates the lighting conditions that can enhance the realism of the image, and is necessary for controlling the lighting apparatus. Is generated.

  The image signal, the sound signal, and the illumination signal are input to the image sound illumination control unit 164, and the image signal and the sound signal are transmitted to the image sound output unit 170 so as to be synchronized with the timing at which the image is displayed. Is transmitted to the illumination output unit 169 via the illumination control unit 178 (see FIGS. 31A to 31C). As a result, the occupant viewing the image has a high sense of realism due to the image, sound, and lighting output in synchronization with the image sound output unit (eg, television) 170 and the illumination output unit (lighting fixture) 169. While feeling, it is possible to enjoy the image displayed on the image sound output unit 10.

  As the viewer's biological / emotion information measuring unit 165, for example, as shown in FIGS. 31A, 31B, and 31C, a brain potential / biological measuring unit 175 that measures the viewer's brain potential and various biological rhythms is provided. Can be provided. By these measurements, the viewer's emotions can be monitored. Specifically, FIG. 31A illustrates a configuration in which the brain potential / biological measurement unit 175 performs necessary measurements for the viewer in a wired manner, while FIG. 31B illustrates the brain potential / biological measurement unit 175. A configuration is shown that performs the necessary measurements for viewers wirelessly. Furthermore, in the configuration of FIG. 31C, the receiver 171 that receives the measurement data after wirelessly measuring the viewer's brain potential and various biological rhythms is used as the image sound output unit 170 (in the case of (1)). Installed in an appropriate place inside the room (in the case of (2)), or in the lighting output unit (lighting fixture) 169 (in the case of (3)), the brain potential / biological measurement unit 175 is required via this To acquire accurate measurement data. However, the installation location of the receiving unit 171 in the configuration of FIG. 31C is not limited to the positions depicted as (1) to (3) in the figure, and can be arranged at any position.

  Examples of brain potentials that can be measured include the appearance rate of wavelength-analyzed data such as α waves, β waves, γ waves, and θ waves, or electroencephalogram data as measured, and λ waves. All brain potentials are included, including event-related potentials. Various biological rhythms that can be measured include all biological rhythms such as heart rate, blood pressure value, respiratory rate, myoelectric potential, eye movement, circadian rhythm, and the like. As a measuring method and measuring apparatus for these, any technique known in the related technical field can be used.

  Further, FIG. 32 schematically shows a block diagram of a configuration of a lighting device that enables lighting control according to audio information in addition to the above. Specifically, in the configuration of the lighting device in FIG. 32, a voice information measurement unit 185 is further added to the configuration shown in FIG. Accordingly, the image sound and biological / emotion information recording unit 162 and the image sound and biological / emotion information analysis unit 163 in the configuration of FIG. 30 can also record audio information measured by the sound measurement unit. Part 182 and analysis part 183. However, the functions and features of each component included in the configuration of FIG. 32 including these recording unit 182 and analysis unit 183 are substantially the same as the corresponding components included in the configuration of FIG. Here, description thereof is omitted.

The audio information indicates a language or the like emitted by the viewer. Therefore, the illumination is often controlled independently from the image signal and the sound signal so as to correspond only to the audio information. For example, with this switch function in which the illumination control method can be selected according to the viewer's preference as described above, it is possible to recognize the audio information and control the illumination with this configuration.
In the illumination device of the present embodiment, if an image signal is input, the image and illumination light that enhances the presence of the image can be generated. Therefore, both the image sound reception unit and the image sound reproduction unit are necessarily provided. Needless to say, at least one of the two is sufficient.

  When sound is not required, it goes without saying that each of the image sound receiving unit and the image sound reproducing unit in the configuration described above does not need to have a function for processing sound.

  Furthermore, each component included in the illustrated configuration may be configured as a separate device, or two or more such that, for example, the image sound receiving unit and the image sound reproducing unit are image sound receiving and reproducing units. The form in which these components are integrally configured may be used.

  The illumination control unit may control a plurality of illumination output units using a plurality of circuits. Furthermore, it is better to hide the illumination output unit so that it is not visible to the viewer.

(Fifteenth embodiment)
FIG. 33 is a block diagram schematically showing the configuration of the illumination device of the present embodiment. Specifically, this illumination apparatus includes an image acoustic illumination receiving unit 261, an image acoustic illumination reproducing unit 266, a viewer's biological / emotion information measuring unit 165, an audio information measuring unit 165, a sensor unit 191, and a data recording unit 192. A data analysis unit 193 and an image sound illumination control unit 164.
The functions of the image sound illumination reception unit 261 and the image sound illumination reproduction unit 266 are substantially the same as the functions of the image sound reception unit 161 and the image sound reproduction unit 166 described in the previous embodiment, respectively. The signal is received and played back. The sensor unit 191 has a function of measuring an arbitrary information signal that may be necessary for generating an illumination signal. The functions of the living body / emotion information measurement unit 165 and the voice information measurement unit 185 are the same as the functions of the corresponding components in the previous embodiment, and a description thereof is omitted here.

  In the configuration of FIG. 33, any one of an image acoustic illumination receiving unit 261, an image acoustic illumination reproducing unit 266, a viewer's biological / emotion information measuring unit 165, an audio information measuring unit 165, and a sensor unit 191, Alternatively, data transferred from a plurality of data is temporarily recorded in the data recording unit 192 or sent to the data analysis unit 193 without being recorded. The data analysis unit 193 analyzes part or all of the received signal, calculates lighting conditions that can enhance the realistic sensation of the image, and generates a lighting signal necessary for controlling the lighting fixture. Alternatively, instead of generating an illumination signal as a result of analysis by the analysis unit 193, the illumination signal received or reproduced by the reception unit 261 or the reproduction unit 266 may be used as it is.

  The image signal, the sound signal, and the illumination signal are input to the image sound illumination control unit 164, and the illumination device is controlled by the same method as that described in each of the above embodiments.

  On the other hand, FIG. 34 shows a configuration in which the data analysis unit 193 in the configuration of FIG. 33 is replaced with a data mapping unit 194. The data mapping unit 194 selects a predetermined illumination signal by associating (mapping) the various received data with a previously stored illumination signal.

Even with such a configuration, it is possible to obtain the effect of improving the realistic sensation effect as described above by executing the illumination control according to the illumination control method of the present invention.
In the illumination device of the present embodiment, if an image signal is input, the image and illumination light that enhances the presence of the image can be generated. Therefore, both the image sound reception unit and the image sound reproduction unit are necessarily provided. Needless to say, at least one of the two is sufficient.

  When sound is not required, it goes without saying that each of the image sound receiving unit and the image sound reproducing unit in the configuration described above does not need to have a function for processing sound.

  Furthermore, each component included in the illustrated configuration may be configured as a separate device, or two or more such that, for example, the image sound receiving unit and the image sound reproducing unit are image sound receiving and reproducing units. The form in which these components are integrally configured may be used.

  The illumination control unit may control a plurality of illumination output units using a plurality of circuits. Furthermore, it is better to hide the illumination output unit so that it is not visible to the viewer.

It is a block diagram which shows the layout of the laboratory used in connection with this invention. It is a figure which shows the concept of virtual space. It is a block diagram of a visual field. It is a block diagram which shows the layout of the experimental apparatus used in connection with this invention. It is the figure which drew typically the TV viewing room where the lighting control method of this invention can be applied. FIG. 5B is a diagram schematically illustrating a modified configuration example of the viewing room in FIG. 5A. It is the figure which drawn typically the other modified structural example of the viewing room of FIG. 5A. (A)-(e) is a figure which shows the example of the image used in order to demonstrate the high presence control method in this invention. It is a figure explaining an example of the illumination control method in the viewing room of FIG. 5A. It is a figure explaining the other example of the illumination control method in the viewing room of FIG. 5A. (A) And (b) is a figure which shows typically the switch function which enables selection of the illumination control method according to a viewer's liking. (A) And (b) is a figure explaining the structure and function of a multifunctional light source which can be used as a light source which illuminates an effective visual field. (A) And (b) is a figure explaining the structure and function of a multifunctional light source which can be used as a light source which illuminates a guidance visual field. It is a figure which shows the result of the experiment shown in xy chromaticity diagram (xyz color system). (A) is a correlation diagram between an average output signal value and an elapsed time in a certain period when an image changes, and (b) is linked to the image change of (a). It is a correlation diagram between the output value (signal value) of the illumination and the elapsed time. It is a figure which shows typically the structure which transmits data with the form of a color and a brightness signal so that the data conversion according to a viewer's liking may become easy. It is a figure which shows typically the structure which transmits data, such as a light control signal, in a device dependent form, such as a lamp output voltage value, in order to raise the transfer rate of data. It is a figure which shows typically the structure of the illuminating device in the 2nd Embodiment of this invention. It is a figure which shows typically the use condition of the illuminating device of FIG. It is a figure which shows typically the structure of the illuminating device in the 3rd Embodiment of this invention. It is a figure which shows typically the structure of the illuminating device in the 4th Embodiment of this invention. (A) And (b) is a figure which shows typically the structure of the illuminating device in the 5th Embodiment of this invention. It is a figure which shows the detail of the illumination fixing | fixed part of the illuminating device in the 5th Embodiment of this invention. It is a figure explaining the illuminating device in the 6th Embodiment of this invention. It is a figure explaining the other illuminating device in the 6th Embodiment of this invention. It is a figure explaining the illuminating device in the 7th Embodiment of this invention. (A) And (b) is a figure explaining the illuminating device in the 8th Embodiment of this invention. It is a figure explaining the illuminating device in the 9th Embodiment of this invention. (A)-(c) is a figure which shows the specific example of a light emission part of the illuminating device (lighting fixture) of FIG. It is a figure explaining the illuminating device in the 10th Embodiment of this invention. It is a figure which shows typically the structure of the illuminating device of this invention which can be controlled in conjunction with a telephone, an intercom, and also a mobile communication apparatus and household appliances. (A) And (b) is a figure which shows typically the structure of the illuminating device of this invention comprised using the data circuit | line by a wired circuit or a wireless circuit. (A) And (b) is a figure explaining the illuminating device in the 12th Embodiment of this invention. It is a figure which shows typically the illuminating device of this invention which has the structure integrated. (A) And (b) is a figure which shows typically the structure of the illuminating device of this invention which can use the output of an image output part as an output of illumination light. It is a figure which shows typically the structure of the illuminating device of this invention by which the light source is arrange | positioned at the right-and-left end and upper-lower-end of a goggle type image output part. (A) And (b) is the side view and front view which show typically the illuminating device of this invention which has the structure by which the acoustic output part (speaker) and the illumination output part (light source) were integrated. . (A)-(k) is a figure explaining the light source which may be contained in the illuminating device in the 13th Embodiment of this invention. (A)-(c) is a figure explaining the lighting fixture which may be contained in the illuminating device in the 13th Embodiment of this invention. It is a figure explaining the structure of the illuminating device in the 14th Embodiment of this invention. FIG. 31 is a diagram illustrating a configuration for measuring brain potential / biological information with respect to the illumination device of FIG. 30. FIG. 31 is a diagram illustrating another configuration for measuring brain potential / biological information with respect to the illumination device of FIG. 30. FIG. 31 is a diagram illustrating still another configuration for measuring brain potential / biological information with respect to the illumination device of FIG. 30. It is a figure explaining the structure which also enables the illumination control according to audio | voice information regarding the illuminating device of FIG. It is a figure explaining the structure of the illuminating device in the 15th Embodiment of this invention. It is a figure explaining the other structure of the illuminating device in the 15th Embodiment of this invention.

Explanation of symbols

1 Illumination output unit (illumination device)
2 Image sound output unit (image display device)
3 Chair 4 Viewer (subject)
DESCRIPTION OF SYMBOLS 5 Computer 6 Image sound reproduction part 7 Data recording device 8 Illumination control part 9 9a, 9b Illumination output part 10 Image sound output part 11 Image sound receiving part 12 Image sound memory | storage part 13 Image analysis part 14 Image sound illumination control part 15 Sensor part 16 Data Analysis Units 17a, 17b Illumination Fixing Unit 18 Illumination Signal Output Unit 19 Illumination Signal Input Unit 20 Code 21 Recess 22 Pairing Unit 23 Light Emitting Unit 24 Television Frame Lighting Device 25 Television Side Lighting Device 26 Projector Type Illumination Output Unit 27 Indoor Light emitting surface for illumination 28 Image 29 Illumination improving illumination image 30 Effective visual field illumination output unit 31 Guide visual field illumination output unit 32 Auxiliary visual field illumination output unit 33 Light source unit 34 Condensing reflector 35 Light shielding louver 36 Light color variable illumination fixture 37 Light-shielding plate 38 Red light emitting part 39 Green light emitting part 40 Blue light emitting part 41 Diffusion plate 51 light-shielding plate

Claims (4)

An illumination control method for controlling a light source in conjunction with a video display device,
The illumination control unit has a chromaticity of the peripheral visual field of the image display device that is substantially opposite to the hue on the chromaticity diagram with respect to the average chromaticity of all pixels of the image displayed on the image display device. An illumination control method for controlling the chromaticity of the light source. An image display device that controls the light source in conjunction with each other,
The light source;
An illumination control unit for controlling the light source;
An image display unit for displaying an image,
The illumination control unit is configured such that the chromaticity of the peripheral visual field of the image display device is a hue having a substantially opposite hue on the chromaticity diagram with respect to the average chromaticity of all pixels of the image displayed on the image display device. An image display device for controlling the chromaticity of the light source so as to be.   The video display device according to claim 2, wherein the light source is integrated.   The video display device according to claim 3, wherein the light source is disposed at a position where the light source is not directly visible to a viewer.

Images