JP2009036801A - View environment control device and view environment control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an illumination control method capable of appropriately performing illumination control according to an image displayed on a video display device. <P>SOLUTION: The view environment control method for changing the illuminating light of a lighting device based on the amount of features of the video data ought to be displayed on a display device includes varying the lighting control operation based on the amount of the features of the video data according to distribution of the feature pattern indicating the image contents within the prescribed picture region of the video content displayed on the display device. Even if any image is displayed on the video display device by the lighting control data, the illuminating light control can be appropriately performed according to the image displayed on the video display device. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a viewing environment control device and a viewing environment control method capable of improving the sense of reality when viewing an image by controlling illumination light of a lighting device installed in a viewing environment space.

  In recent years, with the rapid advancement of electronics technology related to video and audio, the display has become larger, wider viewing angle, higher definition and surround system have improved, and it has become possible to enjoy realistic video and audio. Yes. For example, in a home theater system that is now widely used, a system that can provide a high sense of realism is realized by a combination of a large display or screen and multi-channel audio / sound technology.

  In addition, recently, it is not just to enjoy video on a single display device, but a system for viewing wide-field images by combining multiple displays, and the video displayed on the display and the illumination light of the lighting device are linked. The system which makes it move is proposed, and the development of the system which raises a sense of reality more by combining a plurality of media is performed actively.

  In particular, in technologies that achieve a high sense of realism by linking a display and a lighting device, a high sense of realism can be obtained without using a large display. It has been attracting a lot of attention.

  According to this technology, the viewer can control the illumination light of a plurality of lighting devices installed in the viewer's room (viewing environment space) to a color and intensity according to the image displayed on the display. It can give the sensation and effect as if they existed in the image space projected on the display. Techniques for interlocking the image displayed on the display with the illumination light of the illumination device are disclosed in, for example, Japanese Patent Application Laid-Open Nos. 2001-343900 and 3-184203.

  The technique disclosed in Japanese Patent Application Laid-Open No. 2001-343900 is intended to provide a high sense of presence. In an illumination system that controls a plurality of illumination devices in conjunction with an image to be displayed, video data Describes a method of generating illumination control data for a plurality of illumination devices from the feature quantities (representative colors, average luminance). Specifically, a feature amount of video data in a predetermined screen area is detected according to an installation position of each lighting device, and lighting control data for each lighting device is generated based on the detected feature amount. Is described.

  Further, the illumination control data is not limited to the one obtained by calculating from the feature amount of the video data, and may be one that is distributed alone or together with the video data, or one that is distributed via the Internet, or one that is distributed by a carrier wave. It is described that it is good.

  Furthermore, in Japanese Patent Laid-Open No. 3-184203, R (red), G (green), and B (blue) color signals of an image obtained by removing a skin color portion such as a human face from an original image and removing the skin color portion, and luminance It is described that appropriate illumination control is performed from the signal.

JP 2001-343900 A JP-A-3-184203

  However, in the above-mentioned Japanese Patent Application Laid-Open No. 2001-343900, when the area of the light source included in the video is small, if the representative color derived by the histogram is used as the feature amount, the light source in the video is viewed in the viewing environment illumination. If the average luminance is used as a feature amount, the degree of reflection of the light source in the video to the viewing environment illumination will be reduced, and the light source contained in the video will not be reflected in the viewing environment illumination effectively. was there. Further, for example, when there is not much difference between the distributions of a plurality of colors, there is a problem that the influence of the representative color is too strong and preferable viewing environment illumination cannot be performed.

  Also, a method of performing illumination control from the R (red), G (green), and B (blue) color signals of the image from which the flesh-colored portion is removed as described in JP-A-3-184203 and the luminance signal Then, for example, in the case of a video where a person is up in a night scene, the viewing environment illumination becomes brighter due to the brightness of the body part (other than the skin color part) illuminated by the shooting illumination, There was a problem that the atmosphere of darkness could not be produced.

  The present invention has been made in view of the above-described problems of the prior art, and an object thereof is to provide an illumination control method capable of appropriately performing illumination control according to an image displayed on a video display device. Is.

  The present invention solves the above problems by the following technical means.

  According to a first aspect of the present application, in a viewing environment control device that changes illumination light of a lighting device based on a feature amount of video data to be displayed on the display device, a predetermined screen of video content displayed on the display device The illumination control operation based on the feature amount of the video data is varied according to the distribution of the feature pattern representing the image content in the region.

  According to a second aspect of the present invention, in the viewing environment control device according to the first aspect, the distribution of the feature pattern is a distribution of a feature pattern of a block obtained by dividing the screen area into one or more. .

  According to a third aspect of the present invention, in the viewing environment control device according to the first aspect or the second aspect, the feature pattern includes a subject pattern indicating that the image content of the screen area is a subject. Features.

  4th invention of this application WHEREIN: In the viewing-and-listening environment control apparatus as described in 1st invention or 2nd invention, the said feature pattern contains the light source pattern which shows that the image content of the said screen area | region is a light source. Features.

  According to a fifth aspect of the present invention, in the viewing environment control device according to the first aspect or the second aspect, the feature pattern includes a night view pattern indicating that the image content of the screen area is a night view. Features.

  According to a sixth invention of the present application, in the viewing environment control device according to the first or second invention, the feature pattern includes a specific color pattern indicating that the image content of the screen area is a specific color. It is characterized by that.

  According to a seventh aspect of the present invention, in the viewing environment control device according to the first aspect or the second aspect, the feature pattern includes a uniform background pattern indicating that the image content of the screen area is a uniform background. It is characterized by that.

  According to an eighth aspect of the present invention, in the viewing environment control device according to the first aspect or the second aspect, the feature pattern includes a diverse background pattern indicating that the image content of the screen area is a diverse background. It is characterized by that.

  According to a ninth aspect of the present invention, in the viewing environment control method for changing the illumination light of the lighting device based on the feature amount of the video data to be displayed on the display device, the predetermined screen of the video content displayed on the display device The illumination control operation based on the feature amount of the video data is varied according to the distribution of the feature pattern representing the image content in the region.

  According to a tenth aspect of the present invention, in the viewing environment control method according to the ninth aspect, the distribution of the feature patterns is a distribution of feature patterns of blocks obtained by dividing the screen area into one or more. .

  ADVANTAGE OF THE INVENTION According to this invention, control of the suitable illuminating device interlock | cooperated with a display image | video is attained regardless of what the image | video displayed on the display screen of a video display apparatus is.

  A viewing environment control device and a viewing environment control system according to an embodiment of the present invention will be described with reference to FIGS.

  FIG. 1 is a block diagram showing a viewing environment control apparatus according to an embodiment of the present invention. In the viewing environment control apparatus 1 according to the present embodiment, the reception unit 2 receives broadcast data transmitted from the transmission side (broadcast station), and the data separation unit 3 multiplexes the video data and audio data with the broadcast data. And are separated. The video data and audio data separated by the data separation unit 3 are sent to the video display device 4 and the audio reproduction device 5, respectively.

  Next, the illumination control data generation unit 6 generates appropriate illumination control data according to the installation position of each illumination device 7 from the video data and audio data separated by the data separation unit 3, and sends the illumination control data to the illumination device 7. send.

  Further, since the illumination control data sent to the illumination device 7 needs to match the output timing with the video data and the audio data, for example, only the time necessary for generating the illumination control data in the illumination control data generation unit 6 Delay generators 8a and 8b are provided for delaying the video data and audio data separated by the separation unit 3 and synchronizing with the illumination control data.

  By configuring the viewing environment control device 1 in such a configuration, one or more lighting devices 7 installed in the viewing environment space are appropriately controlled according to the video displayed on the display screen of the video display device 4. Can do.

  Note that the viewing environment control device 1 may be provided integrally with the video display device 4 and the audio reproduction device 5 or may be provided separately. Here, a case where the viewing environment control device 1 is provided integrally with the video display device 4 and the audio reproduction device 5 will be described.

  Next, an outline of the illumination control data generation operation in the illumination control data generation unit 6 of FIG. 1 will be described.

  The illumination control data generation unit 6 first divides the display screen of the video display device 4 into regions of a predetermined size (hereinafter, the region of the predetermined size is referred to as “block”). Next, one of a plurality of feature patterns prepared in advance is selected and assigned to all the blocks included in the display screen of the video display device 4 (hereinafter, the feature pattern is referred to as “mode”). Called). Next, a screen area for detecting the feature amount of the video data for controlling the lighting device installed in the viewing environment space is determined. Furthermore, for each feature quantity detection area, one is selected from a weight value table prepared in advance based on the distribution of modes assigned to each block in the feature quantity detection area. Here, the mode distribution indicates a frequency distribution, and the weight value table is selected by selecting one of a plurality of weight value tables depending on the ratio of each mode block included in the feature amount detection area. It is to be. Then, the feature amount of the video data in each feature quantity detection region is detected from the selected weight value table, the mode data of each block, and the video data displayed in each block, and the illumination corresponding to each feature quantity detection region Generate lighting control data for the device.

  Hereinafter, the illumination control data generation method will be described in detail.

  FIG. 2 is a block diagram showing the illumination control data generation unit 6 of the viewing environment control apparatus 1. The illumination control data generation unit 6 receives the video data separated by the data separation unit 3 from the input unit 9. The input unit 9 sends the received video data to the block averaging unit 10.

  Next, the block average unit 10 that has received the video data reads the block information stored in the block information storage unit 11 in advance, and the predetermined pixels (for example, 5 pixels × 5 pixels = 25 pixels) constituting each block are read out. The average value of the video data is calculated and the image block average data is sent to the mode selection unit 12.

  Here, the block information stored in the block information storage unit 11 relates to information obtained by dividing the display screen of the video display device 4 as shown in FIG. 3 into one or more predetermined blocks 41. For example, if the block 41 shown in FIG. 3 is composed of 5 pixels in the x-direction and 5 pixels in the y-direction, a total of 25 pixels can be stored as long as information such as (x, y) = (5, 5) is stored. Good. Of course, the block information is not limited to the division in units of pixels as described above. Even in the case of division in units of pixels, it is not necessary to have the same number of pixels in the x direction and the y direction, and the size of the block 41 may be freely changed.

  Next, the mode selection unit 12 that has received the image block average data converts the average data into data indicating lightness, chroma, and hue (hereinafter, lightness, saturation). (Chroma) and hue (Hue) information are referred to as “LCH data”). Then, in accordance with the LCH data in all the blocks 41 included in the display screen of the video display device 4, an appropriate one mode is selected and assigned to each block 41 from a predetermined mode. Then, the LCH data and mode data of all blocks included in the display screen of the video display device 4 are sent to the table selection unit 13.

  Next, when the table selection unit 13 receives the LCH data and the mode data of all the blocks included in the display screen of the video display device 4, the table selection unit 13 reads the feature amount detection region information from the feature amount detection region storage unit 14, and From the distribution of the modes of all the blocks included in the amount detection area, the weight value of LCH data for generating illumination control data appropriate for the feature amount detection area is selected from a plurality of weight value tables prepared in advance. One weight value table is selected. Then, the table selection information is sent to the illumination control data calculation unit 15 together with the LCH data and mode data of each block. Here, the feature amount detection region information stored in the feature amount detection region storage unit 14 is the image display device 4 in order to appropriately control each lighting device installed in the viewing environment space of the viewer. This is information indicating from which area of the display screen the feature amount of the video data should be detected.

Next, the illumination control data calculation unit 15 selects an appropriate one table from among a plurality of types of tables stored in the table information storage unit 16 based on the table selection information sent from the table selection unit 13, and selects the LCH. A desired weighting operation is performed on the data to generate illumination control data. Here, FIG. 4 shows an example of the weight value table. The table of FIG. 4 shows weight values (W _L , W _C , W _H ) used when generating illumination control data for each of L (lightness), C (saturation), and H (hue) in each mode selected above. Is decided. A plurality of types of such tables are stored in the table information storage unit 16, and one is read based on the table selection information sent from the table selection unit 13.

  Next, the calculated illumination control data (LCH data) is converted into RGB data, and is sent from the output unit 17 to the illumination device 7 in accordance with the output timing of the video data and audio data.

  Hereinafter, the mode selection unit 12 and the table selection unit 13 included in the illumination control data generation unit 6 will be described in more detail.

  First, a method for detecting feature amounts of video data corresponding to all the blocks 41 included in the display screen of the video display device and allocating each block 41 to a predetermined mode according to the video feature amount will be described with reference to FIG. 5 and FIG.

  FIG. 5 is a block diagram of the mode selection unit 12 of the illumination control data generation unit 6. When the mode selection unit 12 receives the image block average data from the block average unit 10, the LCH conversion unit 18 converts the image block average video data into lightness (Lightness), saturation (Chroma), and hue (Hue). Convert to data. The LCH data converted by the LCH conversion unit 18 is sent to the inter-frame difference determination unit 19, the frame memory 20, and the mode determination unit 21 for each block.

  First, the inter-frame difference determination unit 19 uses the current determination as one of information for determining whether or not the block 41 to be determined in the mode determination unit 21 described later is included in the region representing the subject in the video. The frame data is compared with the previous frame data, and difference data between frames is sent to the mode determination unit 21. Specifically, the frame memory 20 stores the LCH data of the previous frame, and when the LCH data of the current frame is sent, the frame difference determination unit 19 determines the frame of the previous frame. Send LCH data. Here, when transmission of the previous LCH data is completed, the frame memory 20 overwrites and stores the LCH data of the current frame. By adopting such a configuration, the frame memory 20 has a capacity sufficient to store one frame of LCH data. Then, the inter-frame difference determination unit 19 compares the brightness of the LCH data of the current frame sent from the LCH conversion unit 18 with the brightness of the LCH information of the previous frame sent from the frame memory 20, and Difference data between frames is calculated and sent to the mode determination unit 21. And the mode determination part 21 analyzes the difference data between the frames for every block sent from the interframe difference determination part 19, and the saturation (Chroma) and hue (Hue) sent from the LCH conversion part 18, It is determined whether each block is a subject area.

  In the above description, the LCH data of the current frame and the LCH data of the previous frame are compared. However, for example, the LCH data for a plurality of frames is stored in the frame memory 20 and the interframe difference determination unit 19 The difference data between frames may be calculated by comparing the LCH data for the frame with the LCH data for the current frame. Thus, by comparing with the LCH data of a plurality of frames, the mode determination unit 21 can determine the subject area with higher accuracy.

  Next, the mode determination unit 21 selects each block from a plurality of modes prepared in advance from the LCH data sent from the LCH conversion unit 18 and the difference data between frames sent from the interframe difference determination unit 19. Select and assign the appropriate mode. Hereinafter, the mode allocation method performed by the mode determination unit 21 will be described together with the mode allocation operation flow of FIG.

  The mode determination unit 21 assigns one mode to all the blocks included in the display screen of the video display device 4. For example, when the display screen of the video display device 4 includes n blocks, the mode allocation operation is performed on the n blocks. The mode determination unit 21 first determines whether or not the target block is included in the subject area. If it is determined that the block is included in the subject area, mode data indicating that the block is in the subject mode is added to the LCH data and output to the table selection unit 13 (step 1).

  Here, whether or not the target block is included in the subject area is determined by determining the inter-frame difference data sent from the inter-frame difference judgment unit 19 and the saturation (Chroma) and hue (from the LCH conversion unit 18). Hue) is analyzed to determine whether each block is a subject area. Analysis from difference data between frames shows that if the difference between lightness frames is more than a certain value (when movement is large compared to other parts (background)), the target block is the subject. judge. Further, for example, when the subject exists in the frame but the same image continues, that is, when the subject exists in the display video but the difference data between frames is small, the saturation (Chroma) sent from the LCH conversion unit 18 The hue (Hue) may be analyzed to determine a block belonging to a specific color range as a subject. For example, if it is a human being, it may be determined as a subject if it belongs to the skin color range.

  Further, when the subject is included in the video, since the subject is generally focused, the input video data may be analyzed and the region corresponding to the high frequency component in the video data may be set as the subject. Furthermore, since the subject is often located at the center of the displayed video, the subject determination threshold may be changed between the center and the end of the screen. By using the above-described determination methods in combination, it can be determined whether or not the subject is appropriate, and appropriate illumination control can be performed later. Conversely, if it is not possible to properly determine whether or not the subject is present, illumination control that enhances the sense of reality cannot be performed. For example, when the video displayed on the video display device 4 is a video in which a person is up in a night scene, it is affected by the brightness of the body part (other than the skin color part) illuminated by the shooting illumination. As a result, the viewing environment lighting becomes brighter, making it impossible to create a dark atmosphere. However, by accurately determining the subject, it is possible to generate illumination control data in a portion other than the subject, thereby creating an atmosphere of darkness and enhancing the sense of reality.

  Next, when it is determined in step 1 that the target block is not included in the subject area, it is determined whether or not the brightness of the LCH data is equal to or greater than a predetermined value (first threshold value), so that the target block is in the light source area. It is determined whether or not. If it is determined that the block is the light source region, mode data indicating that the block is in the light source mode is added to the LCH data and output to the table selection unit 13 (step 2). Here, for example, when the sun (light source) is included in the video displayed on the video display device 4, the brightness and color of the light source are positively reflected in the illumination light of the lighting device 7, thereby providing a sense of reality. Can be increased.

  Next, when it is determined in step 2 that the target block is not the light source region, it is determined whether or not the brightness of the LCH data is equal to or less than a predetermined value (second threshold value), so that the target block is a dark region. It is determined whether or not. If it is determined that the block is in the dark area, mode data indicating that the block is in the night view mode is added to the LCH data and output to the table selection unit 13 (step 3). Here, for example, when the video displayed on the video display device 4 is dark, the sense of reality can be enhanced by extremely reducing the brightness of the lighting device 7.

  Next, when it is determined in step 3 that the target block is not in the dark region, by determining whether the color of the target block is in a specific color range from the saturation and hue of the LCH data, It is determined whether the block is a specific color area. If it is determined that the block is a specific color area, mode data indicating that the block is in the specific color mode is added to the LCH data and output to the table selection unit 13 (step 4).

  Here, the determination as to whether or not the image is in the specific color range is made based on whether or not the specific color range is stored in advance in a memory or the like. For example, the video displayed on the video display device 4 is displayed. In the case of sunset, displaying the sunset color (such as orange) on the lighting device 7 gives the viewer an immersive feeling and a high sense of realism. For this reason, a color range of sunset colors (such as orange) is stored in a memory or the like, and when the block matches the color range of sunset, it is determined as a specific color mode. In addition, if the image displayed on the image display device 4 is green when the image is forested, and if the image is displayed underwater when the light device 7 is turned on with the lighting device 7, the immersive feeling and the realistic sensation can be enhanced. What is necessary is just to store beforehand in a memory as a specific color range.

  Further, when a plurality of specific color ranges such as sunset color (orange), forest color (green), underwater color (blue) are stored in the memory, the specific color to be sent to the table selection unit 13 It is only necessary to send data for identifying which color range each mode belongs to.

  Furthermore, in the above description, the color range of the specific color is stored in the memory in advance. For example, when video data is input, the specific range for the entire screen is determined by the peak intensity of the histogram of the entire screen of the display device. The presence or absence of a color tint is determined, and when there is a specific color tint, a specific color mode may be set. By doing in this way, it becomes possible to reflect appropriately in illumination also in cases other than the above-mentioned images (sunset, forest, underwater, etc.).

  Next, when it is determined in step 4 that the target block is not a specific color region, the color of the target block is compared with the color of the surrounding blocks of the block based on the saturation and hue of the LCH data. It is determined whether or not the background is a uniform region by determining whether or not is less than a predetermined value. If it is determined that the block is a uniform background area, mode data indicating that the block is in the uniform background mode is added to the LCH data and output to the table selection unit 13. If it is determined that the background is not a uniform region, mode data indicating that the block is in various background modes is added to the LCH data and output to the table selection unit 13 (step 5). Here, for example, when the background of the video displayed on the video display device 4 is uniform, the sense of reality can be enhanced by reflecting the saturation and hue of the uniform background mode in the illumination light of the lighting device 7.

  This completes the allocation operation in an appropriate mode for one block. Such mode allocation operation is repeated for the number of blocks included in the feature amount detection area, and the mode allocation operation is completed. In the above description, one of the six modes is assigned to each block. However, the present invention is not limited to this, and more modes may be set. Conversely, the number of modes is reduced. May be.

  Next, the table selection method of the table selection unit 13 will be described together with an example of the feature amount detection region in FIG. 7, the table selection operation flow in FIG. 8, and each table in FIG.

  The table selection unit 13 performs table selection from the mode data of each block sent from the mode selection unit 12 and the feature amount detection region information read from the feature amount detection region storage unit 14. Here, the feature amount detection region information stored in the feature amount detection region storage unit 14 is the image display device 4 in order to appropriately control each lighting device installed in the viewing environment space of the viewer. This is information indicating from which region of the display screen the feature amount of the video data should be detected. FIG. 7 shows an example of the feature amount detection area when two lighting devices are installed in the viewing environment space of the viewer. Screen areas represented by 42 and 43 in FIG. 7 are feature amount detection areas corresponding to the two lighting devices installed in the viewing environment space of the viewer. For the feature quantity detection area information indicating these feature quantity detection areas 42 and 43, for example, a number is assigned to each of the blocks 41 obtained by dividing the display screen of the video display device 4 described above, and a block number corresponding to the feature quantity detection area. May be stored for each lighting device 7, or may be stored in units of corresponding pixels.

  Next, a table selection operation performed by the table selection unit 13 will be described.

  First, when the light source mode is greater than or equal to a certain ratio among the modes assigned to the blocks included in the feature amount detection region (for example, the light source mode is 1/5 or more), the color of the light source in the video is viewed. A table 1 that can be positively reflected in lighting is selected (step 1). FIG. 9A shows an example of the weighting values in Table 1. In an image in which the light source mode occupies 1/5 or more, there is a strong light source in the screen, and the light source is actively reproduced by illumination. Therefore, the weight of the light source mode block is tripled.

  Next, when the light source mode is not equal to or greater than a certain ratio in step 1 (for example, the light source mode is equal to or less than 1/5), it is determined whether or not the specific color mode is equal to or greater than a certain ratio. If it is determined (for example, the specific color mode is ½ or more), the table 2 capable of reflecting the specific color in the video on the color of the viewing environment illumination is selected (step 2). FIG. 9B shows an example of weighting in Table 2. In an image in which the specific color mode occupies 1/2 or more, a specific color such as morning / sunset, underwater, clear blue sky, or forest gives an impression. It is thought that it is strengthened, and it is thought that the realism can be enhanced by reproducing the specific color by lighting, so the saturation and hue weighting of the specific color mode block is tripled, and the lightness is high. The weight of the light source mode block that is likely to affect is reduced to 1/2.

  Next, when the specific color mode is not a certain ratio or more in step 2 (for example, the specific color mode is 1/2 or less), it is determined whether or not the night view mode is a certain ratio or more. If it is determined (for example, the night view mode is 1/2 or more), the table 3 capable of reducing the brightness and saturation of the viewing environment illumination is selected (step 3). FIG. 9C shows an example of the weighting of the table 3, and in an image in which the night view mode occupies more than half, it is considered that the realism can be enhanced by making the entire viewing environment space dark. The weight of the night view mode block is tripled, the overall lightness is ½, the saturation is ¼, and the lightness mode block is highly likely to have high lightness and bright lighting, and the weight of the light source mode block is ½. To do. In addition, the weight of the subject mode block that is lighted for shooting and tends to have a higher brightness than the background is halved.

  Next, when the night scene mode is not a certain ratio or more in step 3 (for example, the night scene mode is 1/2 or less), it is determined whether or not the uniform background mode is a certain ratio or more. If it is determined (for example, the uniform background mode is 1/3 or more), the table 4 capable of reflecting the uniform background in the viewing environment illumination is selected (step 4). FIG. 9D shows an example of the weighting of the table 4. In an image in which the uniform background mode occupies 1/3 or more, a natural atmosphere is reproduced if the background brightness and color are reproduced as they are. Therefore, the weight of the uniform background mode block is tripled, and the weight of the subject mode block that tends to increase the occupied area (number of corresponding blocks) on the screen is halved.

  Next, when the uniform background mode is not a certain ratio or more in step 4 (for example, the night scene mode is 1/3 or less), it is determined whether the various background modes are a certain ratio or more. If it is determined (for example, the diverse background mode is 2/3 or more), the table 5 capable of reducing the saturation of the viewing environment illumination is selected (step 5). FIG. 9 (e) shows an example of the weighting of the table 5. In an image in which the diverse background mode occupies 2/3 or more, it is difficult to uniquely determine the color representing the atmosphere because the background is complex. If the average of the background is applied to the lighting, it is thought that an inappropriate color will appear. Therefore, by reproducing only the brightness with the lighting, the weight of the various background mode blocks is doubled only for the brightness to make it look natural. Make the saturation of ¼.

  Next, when the diverse background mode is not a certain ratio or more in step 5 (for example, the diverse background mode is 2/3 or less), it is determined whether or not the subject mode is a certain ratio or more. When the determination is made (for example, the subject mode is 4/5 or more), the table 6 that can reflect only the luminance of the subject in the video in the viewing environment illumination is selected. (Step 6) FIG. 9 (f) shows an example of the weighting of the table 6. In an image in which the subject mode occupies 4/5 or more, the subject is up and controls the impression of the screen. However, particularly when there are a plurality of subjects, it is considered that the color may change frequently. Therefore, reflecting the video data of the subject may give an unnatural impression. Therefore, in order to eliminate an unnatural impression, the weight of the subject mode block is doubled only for the brightness so that only the brightness is reproduced by illumination.

  Next, when the subject mode is not a certain ratio or more in step 6 (for example, the subject mode is 4/5 or less), the table 7 that can be reflected in the viewing environment lighting with emphasis on the background in the video is selected. Is done. FIG. 9 (g) shows an example of the weighting of the table 7. In an image like the table 7 in which various modes are mixed, a stable uniform background mode and a light source with a high brightness and a strong impression. To positively reflect the mode, the weight of the uniform background mode block and the light source mode block is tripled. In the specific color mode, the presence of the image can be enhanced by strongly reflecting the color. Therefore, the saturation and hue weights of the specific color mode block are tripled. Further, in the subject mode, only the brightness of the subject mode block is doubled to reflect only the brightness to some extent. Furthermore, it is difficult to determine the color and the various background modes and night scene modes that are likely to be unnatural are reflected in the brightness and hue of the various background mode blocks and night scene mode blocks in order to reflect only the lightness. To.

  Thus, the table selection based on the mode distribution in the feature amount detection region is completed, and this table selection information is sent to the illumination control data calculation unit 15 together with the LCH data and mode data of each block. In the above table selection method, the distribution to seven tables has been described. However, the present invention is not limited to these, and more tables may be set, or conversely, the number of tables may be reduced.

  Next, the calculation method of the illumination control data calculated by the illumination control data calculation unit 15 will be described below. The illumination control data calculation unit 15 refers to the table corresponding to the table selection information from the tables stored in the table information storage unit 16 based on the table selection information sent from the table selection unit 13. Generate lighting control data. That is, a predetermined calculation is performed from the weighting information of the table stored in the table information storage unit 16, the LCH data of each block, and the mode data to calculate the illumination control data.

A specific calculation process performed by the illumination control data calculation unit 15 will be described together with an example of an arithmetic expression shown in FIG. FIG. 10A shows a calculation operation for L (brightness). The calculation operation of L (lightness) is performed by multiplying the lightness value of each block included in the feature amount detection region by the lightness weighting value in each mode block obtained by referring to the table information storage unit 16 (W _L ( table, mode) × L _block ), and the above values (W _L (table, mode) × L _block ) of all blocks included in the feature amount detection amount area are added (Σ [W _L (table, mode) × L _block ]), And divide (normalize) by the sum of the weight values of all blocks. Then, by multiplying the coefficient k _L lightness provided for each table to calculate the values of L (brightness) of the illumination control data.

  Next, with respect to C (saturation) and H (hue), as shown in FIGS. 10B and 10C, the calculation calculation similar to the above L (brightness) is performed, and the illumination control data (L (Lightness), C (saturation), H (hue)).

  Here, the above arithmetic expression is an example, and is not limited to the above arithmetic expression as long as the weighting value of each table is appropriately reflected in the illumination control data.

  The calculated illumination control data (LCH data) is converted into RGB data, and is sent from the output unit 17 to the illumination device 7 in accordance with the output timing of the video data and audio data. With the above-described configuration, it is possible to appropriately perform illumination control according to the image displayed on the video display device, regardless of what image is displayed on the video display device.

  In the above, after the mode selection unit 12 assigns the modes to all the blocks included in the video display device 4, the table selection unit 13 reads out the feature amount detection region, and from the distribution of the modes included in each feature amount detection region. Although table selection has been performed, for example, if the feature amount detection area is read by the mode selection unit 12, it is only necessary to assign a mode to the blocks included in the feature amount detection area. Can be reduced.

In the above description, the method for generating the illumination control data by converting the video data into L (brightness), C (saturation), and H (hue) has been described. You may make it convert in space.

It is a block diagram which shows the viewing-and-listening environment control apparatus which concerns on embodiment of this invention. It is a block diagram which shows the illumination control data production | generation part of a viewing-and-listening environment control apparatus. It is a figure which shows the concept of the block division of a display apparatus. It is a figure which shows an example of a weighting table. It is a block diagram which shows the mode selection part of an illumination control data generation part. It is a figure which shows the operation | movement flow of mode allocation. It is a figure which shows an example of the feature-value detection area | region in case two illumination devices are installed in the viewer's viewing environment space. It is a figure which shows the operation | movement flow of table selection. It is a figure which shows an example of the weighting of a table. It is a figure which shows the calculation process of the illumination control data production | generation performed in an illumination control data calculation part.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Viewing environment control apparatus 2 ... Reception part 3 ... Data separation part 4 ... Video display apparatus 5 ... Audio | voice reproduction apparatus 6 ... Illumination control data generation part 7 ... Illumination apparatus 8 (a), 8 (b) ... Delay generation part 9 ... input unit 10 ... block average unit 11 ... block information storage unit 12 ... mode selection unit 13 ... table selection unit 14 ... feature amount detection region storage unit 15 ... illumination control data calculation unit 16 ... table information storage unit 17 ... output unit 18 ... LCH conversion unit 19 ... Interframe difference determination unit 20 ... Frame memory 21 ... Mode determination unit 41 ... Blocks 42 and 43 ... Feature amount detection area

Claims (10)

In the viewing environment control device that changes the illumination light of the lighting device based on the feature amount of the video data to be displayed on the display device,
Viewing environment control characterized in that illumination control operation based on a feature amount of the video data is varied in accordance with a distribution of a feature pattern representing an image content within a predetermined screen area of the video content displayed on the display device apparatus.   The viewing environment control apparatus according to claim 1, wherein the distribution of the feature pattern is a distribution of a feature pattern of a block obtained by dividing the screen area into one or more.   The viewing environment control apparatus according to claim 1, wherein the feature pattern includes a subject pattern indicating that the image content of the screen area is a subject.   The viewing environment control apparatus according to claim 1, wherein the feature pattern includes a light source pattern indicating that an image content of the screen area is a light source.   The viewing environment control apparatus according to claim 1, wherein the feature pattern includes a night view pattern indicating that the image content of the screen area is a night view.   The viewing environment control apparatus according to claim 1, wherein the characteristic pattern includes a specific color pattern indicating that the image content of the screen area is a specific color.   The viewing environment control apparatus according to claim 1, wherein the feature pattern includes a uniform background pattern indicating that the image content of the screen area is a uniform background.   The viewing environment control apparatus according to claim 1, wherein the feature pattern includes a diverse background pattern indicating that the image content of the screen area is a diverse background. In a viewing environment control method for changing illumination light of a lighting device based on a feature amount of video data to be displayed on a display device,
Viewing environment control characterized in that illumination control operation based on the feature amount of the video data is varied according to the distribution of the feature pattern representing the image content within a predetermined screen area of the video content displayed on the display device Method.   The viewing environment control method according to claim 9, wherein the distribution of the feature pattern is a distribution of feature patterns of blocks obtained by dividing the screen area into one or more.

Images