JP2009021847A - Viewing environment control device, system, and method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a viewing environment control device and a viewing environment control system capable of executing appropriate illumination control to viewing environments different on a viewer basis, and of providing a high realistic sensation. <P>SOLUTION: By a CPU 8, illumination control information is calculated from viewing environment information input by a viewer, and illumination control data for controlling a lighting system installed in a viewing environment space of the viewer are generated by using the illumination control information by an illumination control data generation part 10. Since the lighting system installed in the viewing environment space of the viewer can be appropriately controlled in accordance with its installation position by the illumination control data, a realistic sensation in viewing an image can be improved. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a viewing environment control device capable of improving a sense of reality when viewing a video by controlling illumination light of a lighting device installed in the viewing environment space, and a viewing device including the viewing environment control device. The present invention relates to an environment control system and a viewing environment control method.

  In recent years, with the rapid advancement of electronics technology related to video and audio, the display has become larger, wider viewing angle, higher definition and surround system have improved, and it has become possible to enjoy realistic video and audio. Yes. For example, in a home theater system that is now widely used, a system that can provide a high sense of realism is realized by a combination of a large display or screen and multi-channel audio / sound technology.

  In addition, recently, it is not just to enjoy video on a single display device, but a system for viewing wide-field images by combining multiple displays, and the video displayed on the display and the illumination light of the lighting device are linked. The system which makes it move is proposed, and the development of the system which raises a sense of reality more by combining a plurality of media is performed actively.

  In particular, in technologies that achieve a high sense of realism by linking a display and a lighting device, a high sense of realism can be obtained without using a large display. It has been attracting a lot of attention.

  According to this technology, the viewer can control the illumination light of a plurality of lighting devices installed in the viewer's room (viewing environment space) to a color and intensity according to the image displayed on the display. It can give the sensation and effect as if they existed in the image space projected on the display. A technique for interlocking an image displayed on such a display with illumination light of an illumination device is disclosed in, for example, Japanese Patent Application Laid-Open No. 2001-343900.

  The technology disclosed herein is intended to provide a high sense of presence, and in a lighting system that controls a plurality of lighting devices in conjunction with a video to be displayed, a feature amount (representative color) of video data is provided. , Average luminance), a method for generating illumination control data for a plurality of illumination devices is described. Specifically, a feature amount of video data in a predetermined screen area is detected according to an installation position of each lighting device, and lighting control data for each lighting device is generated based on the detected feature amount. Is described.

  Further, the illumination control data is not limited to the one obtained by calculating from the feature amount of the video data, and may be one that is distributed alone or together with the video data, or one that is distributed via the Internet, or one that is distributed by a carrier wave. It is described that it is good.

  Furthermore, recently, with the progress of GUI (Graphical User Interface) technology, GUI is used for various setting operations of AV devices, and intuitive and simple operations can be realized, improving convenience for users. A technique related to the GUI is disclosed in, for example, Japanese Patent Application Laid-Open No. 2005-286903.

  The technology disclosed here performs the setting input of the viewer's viewing position (listening point) and speaker position in accordance with the setting procedure and operation displayed on the display screen by the viewer, and based on the input information, It describes that the output timing of the speaker is calculated. Thus, it is described that even when the arrangement of a sound source such as a listening point or a speaker is changed, an optimal sound field can be easily reproduced without performing complicated work.

  However, the device described in the above-mentioned Japanese Patent Application Laid-Open No. 2001-343900 generates illumination control data corresponding to a predetermined layout of the illumination device. Therefore, the illumination device installed in the viewing environment space It is not equipped with the structure which detects the position of this and produces | generates the appropriate illumination control data according to the detection result. Therefore, for example, when the position of the lighting device or the position of the video display device in the viewing environment space is changed or when a new lighting device is added, appropriate lighting control cannot be performed.

  Moreover, although the above-mentioned Japanese Patent Application Laid-Open No. 2005-286903 describes that an optimum sound field is realized by simply setting and inputting a listening point and a speaker position using a GUI, optimal illumination control is performed. There is no mention of using a GUI to achieve this. That is, in order to realize optimal illumination control, it is necessary to set and input information on the relative positional relationship between the display device and each illumination device, and the above-described technique for realizing optimal sound field control is used as it is. It cannot be used.

  The present invention has been made in view of the above-described problems of the prior art, and can perform appropriate illumination control even when the installation position of the illumination device is changed or when a new illumination device is added. It is an object of the present invention to provide a viewing environment control device, a viewing environment control system, and a viewing environment control method that can obtain a high sense of reality.

  The present invention solves the above problems by the following technical means.

  1st invention of this application is a viewing environment control apparatus which controls the illumination light of one or more illuminating devices based on the feature-value of the video data which should be displayed on a display apparatus, Comprising: The said with respect to the installation position of the said display apparatus Information input means for allowing a viewer to input information related to the installation position of the lighting device, and the video extracted according to information related to the installation position of the lighting device relative to the installation position of the display device input by the information input means Illumination data generation means for generating illumination control data for controlling each illumination device based on the feature amount of the data is provided.

  According to a second aspect of the present application, one or more illuminations are obtained based on reference data relating to an illumination position in a virtual viewing environment space acquired from an external device and illumination control data corresponding to the illumination position in the virtual viewing environment space. A viewing environment control device that controls illumination light of the device, the information input means for allowing a viewer to input information related to the installation position of the illumination device with respect to the installation position of the display device, and the information input means input by the information input means Illumination for controlling each illumination device with illumination control data corresponding to the illumination position in the virtual viewing environment space based on the information related to the installation location of the illumination device with respect to the installation location of the display device and the reference data Illumination data conversion means for converting into control data is provided.

  A third invention of the present application is a viewing environment control device that controls illumination light of one or more illumination devices based on illumination control data acquired from an external device, wherein the illumination device has an installation position of the display device. Information input means for allowing a viewer to input information related to the installation position; and transmission means for transmitting information related to the installation position of the illumination device relative to the installation position of the display device input by the information input means to the external device; Receiving means for receiving illumination control data generated by an external device based on information related to the installation position of the illumination device with respect to the installation position of the display device.

  According to a fourth aspect of the present invention, in the viewing environment control device according to any one of the first to third aspects, the information input unit further causes the viewer to input information relating to the screen direction of the display device. It is characterized by that.

  According to a fifth aspect of the present invention, in the viewing environment control device according to any one of the first to fourth aspects, the information input unit further causes the viewer to input information regarding the screen size of the display device. It is characterized by that.

  According to a sixth invention of the present application, in the viewing environment control device according to any one of the first to fifth inventions, the information input means further inputs information on an irradiation direction of each lighting device to a viewer. It is characterized by making it.

  According to a seventh invention of the present application, in the viewing environment control device according to any one of the first to sixth inventions, the information input means further includes at least one of a type or a size of the lighting device. It is characterized by allowing the viewer to input.

  An eighth invention of the present application is the viewing environment control device according to any one of the first to seventh inventions, wherein the information input means is a room in which the display device and the lighting device are further installed. It is characterized by allowing the viewer to input information regarding the size.

  A ninth invention of the present application is the viewing environment control device according to any one of the first to eighth inventions, wherein the information input means is a room in which the display device and the lighting device are further installed. It is characterized by allowing the viewer to input information on the color of the wall.

  According to a tenth aspect of the present invention, in the viewing environment control device according to any one of the first to ninth aspects, a model of a room including the display device and the lighting device when information is input by the information input means. A display means for displaying the figure on the display device is provided, and the display content displayed by the display means is changed in conjunction with the information input by the information input means.

  In an eleventh aspect of the present invention, in the viewing environment control device according to the tenth aspect, the display means first displays an input screen for prompting input of information regarding the size of the room, and After the setting is completed, a screen for prompting information input regarding at least the position of the display device or the lighting device is displayed.

  In a twelfth aspect of the present invention, in the viewing environment control device according to the tenth aspect or the eleventh aspect, a schematic diagram of a room displayed by the display means is represented by a plan view and a side view of the room. It is characterized by being.

  A thirteenth invention of the present application is the viewing environment control device according to the tenth invention or the eleventh invention, wherein the schematic diagram of the room displayed by the display device is a three-dimensional view from an arbitrary viewpoint outside the room. It is represented by a figure.

  A fourteenth invention of the present application is installed in the viewing environment control device according to any one of the first to thirteenth inventions, a display device for displaying the video data, and the periphery of the display device. A viewing environment control system including a lighting device.

  A fifteenth aspect of the present invention is a viewing environment control method for controlling illumination light of one or more illumination devices based on a feature amount of video data to be displayed on a display device, wherein An information input step for allowing a viewer to input information related to the installation position of the lighting device, and the video extracted according to information related to the installation position of the lighting device with respect to the installation position of the display device input by the information input means And an illumination data generation step for generating illumination control data for controlling each illumination device based on the feature amount of the data.

  According to a sixteenth aspect of the present application, one or more illuminations are obtained based on reference data relating to an illumination position in a virtual viewing environment space acquired from an external device and illumination control data corresponding to the illumination position in the virtual viewing environment space. A viewing environment control method for controlling illumination light of a device, an information input step for allowing a viewer to input information related to an installation position of the illumination device with respect to an installation position of the display device, and the information input means that inputs the information Illumination for controlling each illumination device with illumination control data corresponding to the illumination position in the virtual viewing environment space based on the information related to the installation location of the illumination device with respect to the installation location of the display device and the reference data And an illumination data conversion step for converting the control data into control data.

  A seventeenth invention of the present application is a viewing environment control method for controlling illumination light of one or more illumination devices based on illumination control data acquired from an external device, wherein the illumination device has a position relative to an installation position of the display device. An information input step for allowing a viewer to input information regarding the installation position; and a transmission step for transmitting information regarding the installation position of the illumination device with respect to the installation position of the display device input by the information input means to the external device; A reception step of receiving illumination control data generated by an external device based on information related to the installation position of the illumination device with respect to the installation position of the display device.

  According to the present invention, the viewer can intuitively and easily set and input the installation position of the display device and the one or more lighting devices in the viewing environment space, and according to the input display device and lighting device installation position. Therefore, it is possible to perform appropriate lighting control even when the installation position of the lighting device in the viewing environment is changed or when a new lighting device is added.

  A viewing environment control device and a viewing environment control system according to an embodiment of the present invention will be described with reference to FIGS.

  FIG. 1 is a block diagram showing a viewing environment control apparatus according to the first embodiment of the present invention. In the viewing environment control apparatus 1 according to the present embodiment, the reception unit 2 receives broadcast data transmitted from the transmission side (broadcast station), and the data separation unit 3 multiplexes the video data and audio data with the broadcast data. And are separated. The video data and audio data separated by the data separation unit 3 are sent to the video display device 4 and the audio reproduction device 5, respectively.

  Next, the viewer input information receiving unit 6 displays a video input by the viewer using, for example, an operation button or a remote control device (hereinafter referred to as a remote control device) provided on the main body of the viewing environment control device 1. Image display device information such as the installation position, screen direction and screen size of the device 4, lighting device information such as the installation position, type, size and irradiation direction of the lighting device 7, the size of the viewer's room, the color of the wall, etc. Are received and sent to the CPU 8. In the following, the viewer's room is referred to as “viewing environment space”.

  In the CPU 8, a predetermined calculation described later is performed based on the video display device information, the lighting device information, and the viewing environment space information received by the viewer input information receiving unit 6, and the lighting control information of each lighting device 7 (each lighting device). Information necessary for generating the lighting control data) is sent to the lighting control information storage unit 9.

  The illumination control information storage unit 9 stores the illumination control information calculated by the CPU 8 in a table format. Here, an identifier (hereinafter referred to as “ID”) is assigned in advance to each of the lighting devices 7, and the lighting control information stored in the lighting control information storage unit 9 is for each ID of the lighting device 7. Stored in table format. The illumination control information stored in the illumination control information storage unit 9 is appropriately sent to the illumination control data generation unit 10 via the CPU 8 in accordance with a request from the illumination control data generation unit 10. The illumination control data generation unit 10 corresponds to the installation position of each illumination device 7 from the video data and audio data separated by the data separation unit 3 and the illumination control information read from the illumination control information storage unit 9 via the CPU 8. Appropriate lighting control data is generated and sent to the lighting device 7.

  Further, since the illumination control data sent to the illumination device 7 needs to match the output timing with the video data and the audio data, for example, only the time necessary for generating the illumination control data in the illumination control data generation unit 10 Delay generators 11a and 11b are provided for delaying the video data and the audio data separated by the separation unit 3 and synchronizing with the illumination control data.

  By configuring the viewing environment control device 1 as described above, one or more lighting devices 7 installed in the viewing environment space can be appropriately controlled according to the viewing environment space of the viewer. In addition, when the installation position of the lighting device 7 in the viewing environment space is changed, when the lighting device 7 is added, when the position of the video display device 4 is further changed, or when the wallpaper of the room is changed, etc. However, proper lighting control is always possible. Note that the viewing environment control device 1 may be provided integrally with the video display device 4 and the audio reproduction device 5 or may be provided separately. Here, a case where the viewing environment control device 1 is provided integrally with the video display device 4 and the audio reproduction device 5 will be described.

  Below, the illuminating device 7 is demonstrated in detail.

  First, the illumination device 7 will be described. FIG. 2 is an external view showing an example of the lighting device 7 used in the present embodiment. As described above, each lighting device 7 is assigned a unique ID for recognizing a plurality of lighting devices 7 individually. Has been. For example, in the illumination device 7 shown in FIG. 2, LED light sources of R (red), G (green), and B (blue) colors that can be independently controlled to emit light are arranged at a constant cycle. These three primary color LED light sources emit illumination light having a desired color and brightness.

  However, the illumination device 7 may be configured to be able to control the illumination color and brightness of the surrounding environment of the video display device 4, and is limited to the combination of the LED light sources that emit the predetermined colors as described above. Alternatively, a white LED and a color filter may be used, or a combination of a white light bulb, a fluorescent tube and a color filter, a color lamp, or the like may be applied. Further, not only the color-variable illumination device but also, for example, only the brightness of white light from a white light bulb or a fluorescent lamp may be variably controlled for each illumination device 7, and in this case also, the brightness of the illumination light is fixed. Compared to, you can get a higher sense of realism.

Fig.2 (a) is explanatory drawing which shows the provision method of ID which identifies each illuminating device 7 with a seal | sticker. The lighting device 7 in FIG. 2A is provided with a hole where a seal is attached below the LED light source. Here, as shown in the figure, for example, six holes are provided, and a light-shielding seal can be attached to each hole region. In addition, a light sensor is provided at a position corresponding to each hole in the lighting device, and it is detected whether a seal is stuck on the hole, that is, whether light is transmitted or blocked in each hole. Is possible. Therefore, a maximum of 2 ⁶ (6 bits / 64 ways) IDs can be assigned to the lighting device in accordance with the sticking state of the seal to each hole. Of course, when the number of lighting devices 7 installed in the viewing environment space is more than 64, it goes without saying that the number of holes to which the stickers are attached can be increased to infinite by increasing the number of holes to seven.

FIG. 2B is an explanatory diagram illustrating an ID assigning method for identifying each lighting device 7 using a dip switch. In the illumination device 7 in FIG. 2B, a dip switch is provided below the LED light source. This dip switch includes a switch that can set whether or not to pass an electrical signal instead of sticking the above-described seal. Here, for example, as shown in FIG, it provided six switches, for example, by what the switch is above a conducting state, what has become lower detected as cut-off state, the maximum 2 ⁶ (6 (Bit / 64) IDs can be given to the lighting device. Of course, if the number of lighting devices installed in the viewing environment space exceeds 64, it goes without saying that the number of switches can be increased to infinite by increasing the number of switches from seven to eight.

  Next, the viewing environment control device 1 will be described. First, information input related to the video display device 4, the lighting device 7, and the viewing environment space by the viewer will be described.

  FIG. 3 is an explanatory diagram showing an example of the viewing environment space. Here, it is assumed that the video display device 4 and seven lighting devices 7 are installed in the viewing environment space. The illumination device 7a is a ceiling installation type, and the illumination devices 7b to 7g are portable installation type illumination devices. The arrangement and the number of the lighting devices 7a to 7g differ depending on the viewing environment space of the viewer, and even in the same viewing environment space, the lighting device 7 is moved or the lighting device 7 is moved by redesigning the room. It depends on adding / deleting. Furthermore, the position of the illumination device 7 relative to the video display device 4 also changes by moving the video display device 4.

  Therefore, even in such a case, in order to always appropriately control the lighting device 7 and provide a high sense of presence, the relative positions of the video display device and the lighting device installed in the viewing environment space are set. It is necessary to detect and perform illumination control according to the position of the illumination device with respect to the video display device.

  FIG. 4 is a diagram showing a flowchart of an information input operation regarding the viewing environment space, the video display device, and the lighting device. The viewer's information input operation will be described below with reference to FIG.

  Information input regarding the viewing environment space, the video display device, and the lighting device by the viewer is first performed from the operation button provided on the main body of the viewing environment control device 1 or a remote control device (hereinafter referred to as video display device information, The information that combines the lighting device information and the viewing environment space information is referred to as “viewing environment information”). Hereinafter, an input operation by remote control will be described as an example.

  FIG. 5 is a diagram illustrating an example of the remote control device 12. When the viewing environment setting key 13 of the remote control device 12 shown in FIG. 5 is pressed, an instruction to start viewing environment information input is issued, and the start of input of viewing environment information as shown in FIG. Displayed. When the screen display as shown in FIG. 6 is displayed, when the enter key 14 of the remote control device 12 in FIG. 5 is pressed, a screen prompting input of information in the viewing environment space as shown in FIG. 7 is displayed.

  When the viewer presses the enter key 14 of the remote control device 12 in FIG. 5 while the screen as shown in FIG. 7 is displayed, the viewing environment space as shown in FIG. 8 is displayed on the display screen of the video display device 4. A screen for entering the size is displayed. In this screen, in order to set the size of the viewing environment space, the viewer looks at the schematic view of the viewing environment space displayed on the screen and uses the corner of the viewing environment space as a reference point in the x direction of the viewing environment space. The lengths in the y direction and the z direction are input in centimeters, for example.

  Specifically, when the screen shown in FIG. 8 is displayed, the part for inputting the meter in the x direction is active, and an appropriate numerical value is input using the cross key 15 or the numeric key 16 of the remote control device 12, and the enter key is entered. Press 14 to complete the entry. When the meter input in the x direction is completed, the part for inputting the centimeter in the x direction becomes active next, an appropriate numerical value is input with the cross key 15 or the numeric key 16, and the enter key 14 is pressed to complete the input. When the centimeter input in the x direction is completed, the portion for inputting the meter in the y direction becomes active next. The same operation as the numerical value input in the x direction is performed in the y direction and the z direction, and the setting input of the size of the viewing environment space is completed. Here, the input in centimeters is taken as an example, but of course, a unit of 10 centimeters may be used, or another unit system may be used (step 1).

  When the setting input of the size of the viewing environment space is completed, a screen for inputting the ceiling, floor, and wall colors of the viewing environment space as shown in FIG. 9 is displayed on the display screen of the display device 4. In this screen, the viewer sets and inputs the colors of the ceiling, floor 1, and wall 4 to set the ceiling, floor, and wall colors of the viewing environment space (of course, the number of walls depends on the viewing environment space. However, in the present embodiment, the ceiling 1 surface, the floor 1 surface, and the wall 4 surface, which are considered to be the most general, are taken as an example.

  Specifically, when the screen of FIG. 9 is displayed, the portion for selecting the ceiling color is activated, and the color can be selected from a pull-down menu. When a desired color is selected with the cross key 15 of the remote control device 12 and then the enter key 14 is pressed, the ceiling color input is completed. When the ceiling color input is completed, the part for selecting the floor color is activated next, and the input is performed by the same operation as the ceiling color input. The same input operation is performed on the four walls, and the setting input of the color of the wall, ceiling, and floor of the viewing environment space is completed.

  In this way, by inputting the color of the wall, ceiling, and floor of the viewing environment space, even when indirect lighting is performed where the wall is illuminated by illumination light, appropriate lighting control considering the color of the wall is performed. Will be able to do. Here, the color input using the pull-down menu has been described as an example, but of course, the viewer may enter numerical values using the notation of R, G, and B, and other input methods may be used. In addition, information such as reflectance and material may be input as the ceiling, floor, and wall information. In this way, by appropriately inputting information on the ceiling, floor, and wall of the viewing environment space, it is possible to appropriately control indirect illumination (step 2).

  When the setting input of the wall, ceiling, and floor colors of the viewing environment space is completed, a screen for prompting input of information regarding the video display device 4 as shown in FIG. 10 is displayed. When the viewer presses the enter key 14 of the remote control device 12 in FIG. 4 while the screen as shown in FIG. 10 is displayed, the screen for inputting the screen size of the video display device 4 as shown in FIG. Is displayed. In this screen, the viewer inputs the length of the video display device 4 in the x and y directions, for example, in centimeters, in order to set the screen size of the video display device 4.

  Specifically, first, when the screen of FIG. 11 is displayed, the numerical value input portion in the x direction is active, and an appropriate numerical value is input with the cross key 15 or the numerical key 16 of the remote control device 12, and the decision key 14 Press to complete the input. When the numerical value input in the x direction is completed, the numerical value input portion in the y direction becomes active next, and input is performed by the same operation as in the x direction. Here, the input unit in the x-direction and y-direction is centimeters, but the unit may be in inches, and it may be input in the number of diagonal inches instead of numerical input in the x- and y-directions. Further, when the video display device itself already stores information on the screen size, the screen size input operation by the viewer may be omitted by using this (step 3).

  When the input of the screen size information of the video display device 4 is completed, a screen for inputting the installation position of the video display device 4 as shown in FIG. 12 is displayed. In this screen, the viewer inputs the horizontal position and the vertical position of the video display device 4 in units of centimeters, for example, in order to set the installation position of the video display device 4. Here, the “vertical direction” is a direction perpendicular to the horizontal direction and is a “vertical direction”.

  The horizontal position can be input using a plan view viewed from the vertical direction of the viewing environment space, and the vertical position input can be input using a side view viewed from the horizontal direction of the viewing environment space. ing. Also, when information related to the position of the video display device 4 is input, it is reflected in the three-dimensional view displayed on the same screen, and the installation position of the video display device 4 based on the information input by the viewer is intuitively easy to understand. Can be prevented.

  Specifically, when the screen of FIG. 12 is displayed, the numerical value input portion in the x direction of the horizontal position input is active, and an appropriate numerical value is input with the cross key 15 or the numeric key 16 of the remote control device 12. When the enter key 14 is pressed, the input is completed. When the numerical value input in the x direction is completed, the numerical value input portion in the y direction becomes active next, and input is performed by the same operation as in the x direction. Here, the x direction and the y direction are directions along the wall with one corner of the viewing environment space as a reference point (step 4). When the numerical value input in the y direction is completed, the numerical value input portion for the horizontal angle becomes active next, and an appropriate numerical value is input with the cross key 15 or the numerical key 16, and the input is completed when the enter key 14 is pressed. Here, the angle is represented by a numerical value based on the x direction (of course, the y direction may be used as a reference).

  When the horizontal position input is completed, the numerical value input portion in the z direction of the vertical position input becomes active next. When an appropriate numerical value is input with the cross key 15 or the numerical key 165 and the enter key 14 is pressed, the input is completed. When the numerical value input in the z direction is completed, the numerical value input portion for the vertical angle becomes active next, an appropriate numerical value is input with the cross key 15 or the numerical key 16, and the determination key 14 is pressed to complete the input. Here, the angle of the vertical position input corresponds to the so-called elevation angle of the video display device 4 (step 5).

  When the input of information regarding the video display device 4 is completed, a screen prompting input of information regarding the illumination device 7 as shown in FIG. 13 is displayed. When the viewer presses the enter key 14 of the remote control device 12 in FIG. 4 while the screen as shown in FIG. 13 is displayed, the screen for inputting basic information of the lighting device 7 as shown in FIG. Is displayed. In this screen, the viewer inputs the type, size, and 1/2 irradiation angle of the lighting device 7 in order to set the basic information of the lighting device 7. First, as the type of the lighting device 7, the shape and color of the lighting device 7 are input. Here, the shape of the illumination device 7 is the shape of the light source, and here, any one of a point light source, a line light source, and a surface light source can be selectively input. Next, the color of the illuminating device can be selected and input depending on whether it is a color variable type or a single color.

  Further, in the size input part, when the shape of the illumination device 7 is a line light source, the length can be input, and when the shape is a surface light source, the area (the length in the x direction and the y direction) can be input. Yes. In addition, the 1/2 illumination angle is a guideline for determining the performance of the reflector for lighting. The line that connects the fixture and the fixture directly below and the horizontal illuminance that is half the horizontal illuminance directly below the fixture and fixture. Is an angle formed by a line connecting, and can be input as information indicating the spread of irradiation light. As described above, each of the lighting devices 7 is assigned a unique ID (six bits in the above description, but nine bits in FIG. 14) so that individual control is possible. Basic information about the lighting device 7 can also be input for each ID representing each lighting device.

  Specifically, when the determination key 14 of the remote control device 12 shown in FIG. 4 is pressed while the screen shown in FIG. 13 is displayed, a screen for inputting basic information of the lighting device 7 shown in FIG. 14 is displayed. The specific operation of the lighting device 7 for inputting information starts. In response to the command, the CPU 8 instructs the lighting control data generation unit 10 to turn on only the lighting device with IDn (n = 1 in the initial operation) and turn off the remaining lighting devices (or dimming). send.

  The illumination control data generation unit 10 receives a command from the CPU 8, and controls illumination control data corresponding to the command (for example, when the RGB light sources of R, G, and B are controlled to be driven by 8 bits, n = 1 At this time, ID1 (255, 255, 255), ID2 (0, 0, 0), ID3 (0, 0, 0), ..., IDn (0, 0, 0)) are output to the lighting device. Then, only the lighting device corresponding to ID1 is turned on, and the other lighting devices are turned off.

  In this state, on the screen for inputting the basic information of the lighting device 7 shown in FIG. 14, the part for inputting the shape of the lighting device of ID1 is active, and the viewer sets the shape of the lighting device that is lit to the remote control device. When the corresponding shape is input from the pull-down menu using the twelve cross keys 15 and the enter key 14 is pressed, the input is completed. When the input of the shape of the ID1 lighting device is completed, the part for inputting the color of the ID1 lighting device is activated next, the corresponding color is input from the pull-down menu with the cross key 15, and the enter key 14 is pressed to input. Is completed (step 6). When the input of the color of the illumination device of ID1 is completed, the part for inputting the size of the illumination device becomes active next, an appropriate numerical value is input with the cross key 15 or the numeric key 16, and the decision key 14 is pressed, the input is made. Complete (step 7).

  Here, when the shape of the lighting device is a linear light source, the length is input, and when the shape of the lighting device is a surface light source, the area (the length in the x direction and the y direction) is input. Further, when the shape of the illumination device is a point light source, no input is made. When the input of the size of the ID1 lighting device is completed, the part for inputting the 1/2 irradiation angle of the ID1 lighting device becomes active next, and an appropriate numerical value is input with the cross key 15 or the numeric key 16, and the enter key When 14 is pressed, the input is completed (step 8). Here, the 1/2 irradiation angle is described on the product package of the lighting device or the manufacturer's website. This completes the input of basic information of the illumination device with ID1.

  When the input of the basic information of the ID1 lighting device is completed, a screen for inputting the lighting device position shown in FIG. 15 is displayed to input information related to the installation position of the ID1 lighting device. In the illumination device position input shown in FIG. 15, the horizontal position (x direction, y direction) and the vertical position (z direction) are input in units of centimeters, for example. The horizontal position can be input using a plan view viewed from the vertical direction of the viewing environment space, and the vertical position input can be input using a side view viewed from the horizontal direction of the viewing environment space. ing. Moreover, when the position information of the lighting device is input, it is reflected in the three-dimensional view displayed on the same screen, so that the viewer can input intuitively and easily, and can prevent input mistakes. Here, the lighting devices displayed in the plan view, the side view, and the three-dimensional view are displayed in the same scale based on the information regarding the viewing environment space input earlier and the basic information of the lighting device. Yes.

  Specifically, first, when the screen shown in FIG. 15 is displayed, the part for inputting the x direction of the horizontal position becomes active, an appropriate numerical value is input with the cross key 15 or the numeric key 16, and the enter key 14 is entered. Press to complete the input. When the input in the x direction is completed, the portion where the y direction is input next becomes active, and the same operation is performed. When the input of the horizontal position is completed, the portion for inputting the z direction of the vertical position becomes active next, and the input is performed by the same operation. This completes the input of information related to the installation position of the illumination device of ID1 (step 9).

  When the input of information related to the installation position of the ID1 lighting device is completed, a screen for inputting the irradiation direction shown in FIG. 16 is displayed in order to input information related to the irradiation direction of the ID1 lighting device. On the screen for inputting the irradiation direction of the illumination device shown in FIG. 16, the irradiation direction is divided into a horizontal direction and a vertical direction for input. When inputting in the horizontal direction, one is selected from the eight arrows prepared in advance. In addition, when inputting in the vertical direction, one is selected and input from among seven easy irradiation heights. Here, the eight directions are described in the horizontal direction and the seven steps are described in the vertical direction. However, this is only an example, and it may be further divided, or the viewer may be allowed to input numerical values.

  Also, for horizontal input, input is performed using a plan view viewed from the vertical direction of the viewing environment space, and for vertical input, input is performed using a side view viewed from the horizontal direction of the viewing environment space. It has become. Also, when the illumination direction of the lighting device is input, it is reflected in the three-dimensional view displayed on the same screen, so that the viewer can input intuitively and easily, and input errors can be prevented. Here, the lighting device displayed in the plan view, the side view, and the three-dimensional view displays a simulation image when the lighting device is turned on based on the information regarding the viewing environment space input previously and the basic information of the lighting device. It has come to be.

  Specifically, when the screen shown in FIG. 16 is displayed, the part for inputting the horizontal direction becomes active, and when a suitable direction is selected and input with the cross key 15 of the remote control device 12 and the enter key 14 is pressed. Input is complete. When the input in the horizontal direction is completed, the portion for inputting the vertical direction becomes active next, and the input is performed by the same operation as the input in the horizontal direction. This completes the input of information relating to the irradiation direction of the illumination device of ID1 (step 10).

  With the above, all the information input related to the illumination device of ID1 is completed, and next, when the CPU 8 recognizes that the information input related to the illumination device of ID1 is completed, only the illumination device of ID2 is given to the illumination control data generation unit 10. A command is sent to turn on and turn off the remaining lighting devices (or dimming). And the illumination control data generation part 10 receives the command from CPU8, and outputs the illumination control data according to it to an illuminating device. Then, only the illumination device corresponding to ID2 is turned on, and the other illumination devices are turned off, and the information input portion regarding the illumination device of ID2 becomes active. After that, the same operation as the information input operation of the ID1 illumination device described above is performed, and the information input of the ID2 illumination device is performed.

  And the same operation is repeated with respect to all the illuminating devices 7 which exist in a viewer's viewing environment space, and the information input of all the illuminating devices 7 is completed. As described above, by turning on only the lighting device that is the target of setting input and turning off or reducing the other lighting devices, the user can surely and easily do not have to know the ID of each lighting device. It is possible to input information regarding each lighting device. In addition, the above-described information input by the viewer regarding the video display device, the lighting device, and the viewing environment space has been described by taking the input with the remote control device as an example, but of course the operation buttons provided on the main body of the viewing environment control device 1 are used. It may be used and input, or may be input by another input means.

  Next, when the information input as described above is completed by the viewer, the CPU 8 generates illumination control data for each lighting device from the feature amount of the video data based on the relative positional relationship between the video display device and each lighting device. The lighting control information necessary for the calculation is calculated and stored in the lighting control information storage unit 9 in a table format. Here, the correction amount of the irradiation position, irradiation area, color, and luminance is calculated and stored in the illumination control information storage unit 9 in a table format so that the illumination control can be appropriately performed even for the indirect illumination.

  Below, the arithmetic processing performed by CPU8 is demonstrated.

  First, the CPU 8 converts the viewing environment space into a coordinate system using the center of the screen of the video display device as a reference point based on input information from the viewer. Information regarding the position of the video display device and the lighting device input by the viewer is expressed in a coordinate system in the x, y, and z directions along the wall with the corner of the installed viewing environment space as a reference point. The In other words, the relative positional relationship between the video display device 4 and the illumination device 7 is not shown at the stage of input by the viewer, but only the positions of both devices in the viewing environment space are input. It is.

  In addition, the relative positional relationship between the video display device 4 and the illumination device 7 is important in order to appropriately control illumination in conjunction with the video displayed on the video display device 4. Therefore, it is necessary to convert to a coordinate system using the video display device 4 as a reference (origin) in order to obtain a coordinate system that can indicate the relative positional relationship between the video display device 4 and the illumination device 7. Thereby, the installation position of the illumination device 7 is expressed as a relative position with respect to the video display device 4.

  17 and 18 are diagrams showing coordinate conversion based on an example of the viewing environment space of the viewer. FIG. 17 is a three-dimensional view showing the conversion, and FIG. 18 is a plan view of the conversion viewed from the vertical direction. A video display device 4 and eight lighting devices 7 are installed in the viewing environment space. The video display device 4 is arranged at one corner of the room and is installed so that the screen faces the center of the room. The illumination devices 7h and 7i are ceiling installation types, and the illumination devices 7j to 7o are portable installation type illumination devices. In particular, 7j to 7o are intended for indirect illumination and are installed with the irradiation direction facing the wall. The coordinates are the center of the screen of the video display device 4 as a reference point (origin), the parallel and horizontal direction to the screen is the x direction, the vertical direction to the screen is the y direction, and the parallel and vertical direction is the z direction. To be. Then, the installation position information of the lighting device input by the viewer is redefined in the coordinate system after coordinate conversion. Thus, the position of the illumination device 7 is expressed as a relative position with respect to the video display device.

  The CPU 8 includes, for example, an internal memory, and the internal memory includes a reference model representing a virtual viewing environment space, and the reference model for performing appropriate lighting control on the virtual viewing environment space. A characteristic amount detection area indicating which area of the display screen of the video display apparatus should be controlled by using the characteristic amount of the video data displayed in the display screen of the video display apparatus is stored.

  An example of the reference model stored in the internal memory of the CPU 8 is shown in FIGS. FIG. 19 is a diagram showing a reference model, and FIG. 20 is a development view of the reference model. The video display device 4 is arranged along one wall of the viewing environment space, and nine lighting devices 7 are periodically arranged on the ceiling, floor, and four walls. Here, of course, the number and arrangement of the reference model illumination devices are not limited to the above.

  Next, the feature amount detection areas corresponding to the illumination devices v1 to v54 of the reference model stored in the internal memory of the CPU 8 are obtained in advance, and the calculation method thereof will be described below. Here, a feature amount detection region corresponding to each of the lighting devices v1 to v9 provided on the ceiling will be described. For the lighting devices v1 to v9 provided on the ceiling, first, a feature amount detection region in the horizontal direction (x direction) of the screen is determined, and then a feature amount detection region in the vertical direction (y direction) of the screen is determined. Finally, based on the feature amount detection regions determined in the x direction and the y direction in the display screen of the video display device, the feature amount detection region for each lighting device is determined.

  The illuminating device installed on the ceiling of the reference model shown in FIG. 19 is located at the center of the illuminating devices v1, v4, v7 located on the left side of the screen for each illuminating device existing at the same position in the x direction. Lighting devices v2, v5, v8 and lighting devices v3, v6, v9 located on the right side of the screen can be classified into three columns (hereinafter referred to as “left lighting device column”, “center lighting”, respectively). Device rows ”and“ right illumination device rows ”). The left illuminating device column uses the left part of the screen of the video data as a feature amount detection area, the central illuminating device column uses the central part of the screen of the video data as a feature amount detection region, and the right illuminating device column includes the video data The right part of the screen is the feature amount detection area. That is, the feature amount detection region in the x direction on the display screen of the video display device 4 is determined according to the row position of each lighting device.

  Next, a feature amount detection region in the y direction on the display screen of the video display device 4 is determined. In the determination of the feature amount detection area in the y direction, one or a combination of information such as the content (luminance distribution, color distribution, histogram, etc.) of the display image displayed on the image display device 4 and the type (category) of the display image Therefore, it is necessary to determine an appropriate feature amount detection region. There are many indexes for determining the feature amount detection region, and it is only necessary to use an optimal index as needed. Here, as an index for determining the feature amount detection region, the feature amount detection region for the image shown in FIG. 21 is determined using the content (luminance distribution) of the display image.

  The image shown in FIG. 21 is an image of the sunset setting in the sea. The sun displayed at the center of the image has the maximum luminance, and the luminance increases as the distance from the center increases. It is continuously decreasing.

  On the other hand, the illuminating device installed on the ceiling of the reference model shown in FIG. 19 includes the illuminating devices v1, v2, v3 located on the near side of the screen for each illuminating device existing at the same position in the y direction, and the illuminating device. The lighting devices v4, v5, and v6 located on the opposite side of the screen from the devices v1, v2, and v3, and the lighting devices v7, v8, and v9 that are located farthest from the screen can be classified into three columns (hereinafter, referred to as “lighting devices”). These will be referred to as “front lighting device row”, “center lighting device row”, and “back lighting device row”). The front illumination device row is installed closest to the video display device 4, and is present at the farthest position in the video display device 4 direction from the viewer side.

  Therefore, in the front illumination device row, it is necessary to create illumination light based on the color and brightness far from the shooting position in the display image. In the image of FIG. 21, the portion corresponding to the horizon needs to be a feature amount detection region. However, when the illumination light of the front illumination device row is generated according to the image feature amount of only the horizon portion, the brightness of this illumination light becomes too high, and there is no continuity with the display image at the top of the screen, resulting in a sense of discomfort Therefore, as shown in FIGS. 22A to 22C, a region that includes the horizon portion as a center and includes a large portion around the horizon portion is set as a feature amount detection region for the illumination devices v1, v2, and v3.

  Next, the back lighting device row is a row of lighting devices that are farthest from the video display device 4, for example, directly above the viewer. In the back lighting device row, it is necessary to create illumination light based on the color and brightness closest to the display video shooting location. Therefore, in the image of FIG. 21, it is necessary to make the portion corresponding to the uppermost part of the empty portion the feature amount detection region. Further, since the back illumination device row needs to reproduce the space of the photographing position, as shown in FIGS. 22 (g) to (i), the area used as the feature amount detection region for the illumination devices v7, v8, and v9 is reduced. If the color and brightness of the sky directly above the shooting position are reproduced, the realistic sensation can be effectively enhanced.

  Finally, the central illumination device row may be intermediate between the front illumination device row and the back illumination device row described above. In other words, in the image of FIG. 21, it is a sky portion that exists in the middle from the horizon to the sky directly above the shooting position. Accordingly, as shown in FIGS. 22D to 22F, the region used as the feature amount detection region for the illumination devices v4, v5, and v6 may be an intermediate region between the front illumination device row and the back illumination device row. . This completes the feature amount detection region of the lighting device installed on the ceiling of the reference model shown in FIG. Next, the feature amount detection area of each lighting device 7 installed on the floor and wall of the virtual viewing environment space is calculated by the same method as described above.

  As a result, the corresponding feature amount detection areas are determined for all of the lighting devices 7 in the reference model, and lighting control in conjunction with the video is possible in the virtual viewing environment space. In the above description, the screen size of the video display device 4 has not been mentioned. However, since the distance / direction from the screen edge to each lighting device changes when the image size changes, the screen size of the video display device 4 also changes. By taking into consideration, it is possible to determine a feature amount detection region that enables more accurate illumination control. Furthermore, the above-described method for calculating the feature amount detection region is an example, and is not limited to the above.

  The feature amount detection area corresponding to each illumination device of the reference model described above is stored in the internal memory of the CPU 8 as information that gives a reference together with the reference model. The feature amount detection area is uniquely determined from the relative positional relationship between the reference model illumination device and the video display device, and is used when generating illumination control data of the illumination device in an actual viewing environment space described later. Is done. In addition, the reference model may be set in advance regardless of the viewer's input information, or after the viewer's viewing environment information has been input, based on the input information, for example, an actual viewing environment space (room) A reference model that matches the size of may be generated.

  Next, arithmetic processing in which the CPU 8 generates illumination control information based on viewer input information will be described. The CPU 8 performs actual control so as to appropriately control the lighting device installed in the actual viewing environment space based on the video display device information, the lighting device information, and the viewing environment space information received by the viewer input information receiving unit 6. Information indicating a correspondence relationship with the illumination device in the reference model of the illumination device installed in the viewing environment space is generated.

  23 and 24 are diagrams in which the actual viewing environment space and the reference model are superimposed with the position of the video display device aligned, FIG. 23 is a plan view thereof, and FIG. 24 is a three-dimensional view thereof. The reference numerals of the lighting devices installed in the actual viewing environment space and the reference model are the same as those in FIGS. When the lighting device installed in the actual viewing environment space is used as direct illumination (7h, 7i), the lighting devices 7h, 7i installed in the actual viewing environment space are installed in the reference model. It is calculated which of the devices v1 to v54 corresponds. Of course, each of the lighting devices 7h and 7i may correspond to a plurality of the lighting devices v1 to v54.

  Specifically, as shown in FIG. 25, the illumination device 7h installed in the actual viewing environment space corresponds to the illumination devices v2 and v5 in the reference model, and the illumination device 7i corresponds to the illumination device v4. To do. For each ID of each lighting device installed in the actual viewing environment space, information on the corresponding reference model lighting device is stored in the lighting control information storage unit 9 in a table format.

  Next, when the illumination device installed in the actual viewing environment space is used as indirect illumination (7j to 7o), as shown in FIG. 23, the irradiation direction of the illumination device (7j to 7o), 1/2 Based on the irradiation angle, the wall area of the reference model irradiated with the illumination light of the illumination devices (7j to 7o) is calculated, and the illumination devices v1 to v54 corresponding to the illumination region are determined. Of course, each of the lighting devices 7j to 7o may correspond to a plurality of the lighting devices v1 to v54.

  Specifically, for example, the illumination device 7l corresponds to the illumination devices (v10 to v15) in the reference model as illustrated in FIGS. Regarding the indirect lighting (7j to 7o), as in the case of the direct lighting (7h, 7i) described above, information on the lighting device of the corresponding reference model is provided for each ID of each lighting device installed in the actual viewing environment space. The table is stored in the lighting control information storage unit 9 in a table format.

  From the above, it is understood which of the lighting devices v1 to v54 in the reference model corresponds to the lighting devices 7h to 7o installed in the actual viewing environment space. In the lighting control data generation unit 10, the CPU 8 The feature amount detection areas corresponding to the illumination devices 7h to 7o installed in the actual viewing environment space are used using the information of the feature amount detection regions corresponding to the illumination devices of the reference model stored in the internal memory of Can be sought.

  Here, when the lighting devices installed in the actual viewing environment space correspond to a plurality of lighting devices in the reference model, the lighting control information is calculated by calculating the degree of influence by each of the plurality of lighting devices in the reference model. It may be stored in the storage unit 9. For example, as shown in FIG. 26, the area ratio of the illumination areas by the respective illumination devices of the reference model that constitute the illumination area by the illumination devices installed in the actual viewing environment space is calculated, and this is used as the illumination control information. By storing in the storage unit 9, when generating illumination control data of the illumination device installed in the actual viewing environment space, the feature amount of the video data corresponding to the plurality of illumination devices of the reference model is weighted. In addition, more appropriate illumination control can be realized.

  In addition, regarding the indirect lighting devices (7j to 7o) described above, since the viewer views the reflected light reflected by the walls of the actual viewing environment space as illumination light, the color and reflectance of the walls of the viewing environment space The illumination light is greatly affected by (decrease in luminance). Therefore, the CPU 8 obtains correction information for generating the illumination control data based on the wall color and reflectance input in advance by the viewer, and stores the correction information in the illumination control information storage unit 9 for each ID of each illumination device. Store.

  Here, FIG. 27 is a diagram illustrating an example of a data table stored in the illumination control information storage unit 9. In the data table, for each ID of each lighting device installed in the actual viewing environment space, in addition to the reference lighting information related to the lighting device of the corresponding reference model, correction information including wall color information and reflection information Is stored. That is, the lighting control information storage unit 9 stores which lighting device of the reference model each lighting device 7 corresponds to along with the degree of influence (configuration area ratio).

  Further, the wall color of the correction information is stored in 8-bit gradation notation of R, G, and B, and the reflectance is stored in the reflection information. Here, in the case of the direct illumination device, the color of the wall is represented by (255, 255, 255), and the reflectance is 1 (100%). The lighting control information stored in the lighting control information storage unit 9 is read out by the CPU 8 when the lighting control data generation unit 10 requests the CPU 8. Then, the CPU 8 sends the illumination control information read from the illumination control information storage unit 9 and the reference model information stored in the internal memory to the illumination control data generation unit 10.

  Next, the illumination control information created based on the viewing environment information input by the viewer described above and stored in the illumination control information storage unit 9, and the reference model information stored in the internal memory of the CPU 8 A method of generating appropriate lighting control data using the above will be described.

  FIG. 28 is a diagram illustrating an operation flow of the illumination control data generation unit 10. First, the illumination control data generation unit 10 reads the video data separated by the data separation unit 3 shown in FIG. 1 for each frame (step 1). Next, on the basis of the reference model information sent from the CPU 8 (information on the feature amount detection area corresponding to each illumination device in the reference model), the feature of the video data in the feature amount detection region corresponding to each illumination device of the reference model The amount is detected every frame (step 2).

  Then, based on the illumination control information sent from the CPU 8 and the feature amount of the video data corresponding to each illumination device in the reference model calculated in step 2, each illumination device installed in the actual viewing environment space The feature amount of the video data corresponding to is calculated, and the illumination control data of each illumination device is generated according to this (step 3).

  Here, for example, as shown in FIG. 27, when the illumination device ID1 installed in the actual viewing environment space corresponds to the illumination device V1 in the reference model, the feature amount detection region corresponding to the illumination device V1 in the reference model The illumination control data of the illumination device ID1 installed in the actual viewing environment space is generated using the feature amount of the video data detected in step 1 as it is. In addition, when the illumination device ID2 installed in the actual viewing environment space corresponds to the illumination devices V2 and V3 in the reference model and the influence levels of the illumination devices V2 and V3 are 0.5, respectively, Installed in the actual viewing environment space using the weighted coefficient 0.5 added to each feature quantity of the video data detected in the feature quantity detection area corresponding to the illumination devices V2 and V3. The lighting control data of the lighting device ID1 is generated.

  Similarly, the illumination device ID3 installed in the actual viewing environment space corresponds to the illumination devices V3, V4, and V5 in the reference model, and the influence levels of the illumination devices V3, V4, and V5 are 0.3, 0, and 0.5, respectively. 3 and 0.4, the weighting factors 0.3 and 0.3 are respectively applied to the feature amounts of the video data detected in the feature amount detection regions corresponding to the reference model illumination devices V3, V4, and V5. , 0.4 is accumulated and added, and the illumination control data of the illumination device ID1 installed in the actual viewing environment space is generated. By adopting such a weighted average calculation, it is possible to appropriately detect the feature amount of the video data corresponding to the lighting device installed in the actual viewing environment space. That's fine. Of course, it is needless to say that other conversion methods may be used instead of the weighted average based on the area ratio as described above.

  Further, as a feature amount of video data, a color signal, a luminance signal, a surrounding color temperature at the time of video shooting, and the like can be used. Here, not only the feature amount of the video data but also the feature amount of the audio data is detected. As a feature amount of audio data, a volume, an audio frequency, or the like can be used.

  Further, in the case of indirect illumination, the wall in the actual viewing environment space is obtained by appropriately correcting the illumination control data from the correction information of the color and reflectance of the wall stored in the illumination control information storage unit 9. Appropriate indirect illumination control according to the above can be realized. Specifically, when the wall color is colored, correction is performed so as to generate illumination control data that cancels the color of the wall by emitting illumination light with a color that is a complementary color of the wall color. . In addition, when the reflectance of the wall is 1/2, the illumination control data is generated so that the brightness of the illumination light emitted from the illumination device is doubled and the reflected light on the wall has a desired brightness. It is sufficient to correct it.

  The illumination control data generated by the illumination control data generation unit 10 and the video data and audio data of the frame corresponding to the illumination control data are synchronized with each other, and the illumination device 7, the video display device 4, and the audio reproduction device 5 is sent out. When the generation of the illumination control data for one frame is completed, it is determined whether or not there is a next input frame, that is, whether or not the input of video data has been completed (step 4). The next frame is read (step 1). If there is no next input frame, the processing operation is terminated. By sequentially repeating the above operations, illumination control suitable for the video to be displayed can be performed on a video frame basis.

  In the above, the reference model information is stored in the internal memory of the CPU 8, and the viewing environment information input by the viewer is made to correspond to the illumination device installed in the reference model, thereby the illumination device 7 installed in the actual viewing environment space. Although the method for detecting the feature amount of the video data corresponding to the above has been described, other methods for detecting the feature amount of the video data are conceivable. For example, the installation position of the lighting device 7 installed in the actual viewing environment space is represented by a coordinate system after coordinate conversion, the position from the center of the screen of the video display device 4 is represented by a space vector, and its direction The feature amount detection area of the display screen corresponding to each lighting device may be determined based on the size and the size, and the feature amount of the video data in the feature amount detection area may be detected. For example, as shown in FIG. 29 and FIG. 30, in this feature amount detection region calculation method, the indirect illumination devices (7j to 7o) use virtual illumination devices (7j ′) ~ 7o '), the position of the virtual lighting device (7j'-7o') from the center of the screen of the video display device 4 is expressed by a space vector, and each lighting device is indicated by its direction and size. It is also possible to determine the feature amount detection area on the corresponding display screen.

  The feature amount detection area determined in this way is used to detect the feature amount of the video data corresponding to the illumination device 7 installed in the actual viewing environment space, thereby installing the viewing environment space. Regardless of whether the lighting device is a direct lighting device or an indirect lighting device, it is possible to realize appropriate lighting control in conjunction with the video displayed on the video display device. In this case, information (space vector notation) indicating the spatial position of each lighting device may be stored in the lighting control information storage unit 9 in a table format for each ID of each lighting device.

  In this way, by setting the detection region of the video feature amount according to the installation position and the installation angle of each lighting device, and generating the illumination control data according to the feature amount of the video data, for example, the video shown in FIG. When displaying, the illumination light by each illuminating device installed around the video display device 4 can be effectively controlled to give the viewer a high sense of realism. In addition, the video feature amount detection method corresponding to each lighting device need not be limited to the above two methods, and the determination method may vary depending on, for example, the type of video.

  In the above-described embodiment, the description has been given of the case where the video feature amount and / or the audio feature amount is detected in units of frames and the illumination control data is generated. The amount may be detected, and control may be performed so that the illumination light from each illumination device 7 is kept substantially constant in the same scene or shot having a story connection.

  In the above-described embodiment, the illumination control data for each lighting device is generated based on the feature amount of the video data and audio data received by the video receiving device. However, the present invention is not limited to this method. .

  For example, the illumination position information (viewing environment reference data) indicating the installation position of the lighting device in a specific virtual viewing environment space and the lighting control data for the lighting device in the virtual viewing environment space are independent. Or when transmitted from an external device such as multiplexed with a broadcast wave together with video data, the transmitted illumination based on the transmitted viewing environment reference data and the illumination control information stored in the illumination control information storage unit Lighting control data for each lighting device installed in the viewer's viewing environment space may be generated by performing a predetermined conversion process on the control data. This will be described below as a second embodiment of the present invention, but the same parts as those in the first embodiment will be denoted by the same reference numerals, and the description thereof will be omitted.

  FIG. 31 is a block diagram showing a viewing environment control apparatus according to the second embodiment of the present invention. The viewing environment control device 21 of the present embodiment receives broadcast data transmitted from the transmission side (broadcast station) at the reception unit 22, and video data and audio data multiplexed into the broadcast data at the data separation unit 23. Separate lighting control data and viewing environment reference data. The video data and audio data separated by the data separation unit 3 are sent to the video display device 4 and the audio reproduction device 5, respectively, and the illumination control data and viewing environment reference data are sent to the illumination control data conversion unit 29. .

  Here, FIG. 32 and FIG. 33 show examples of viewing environment reference data. 32 shows a virtual viewing environment space represented by viewing environment reference data, and FIG. 33 is a diagram showing viewing environment reference data. As shown in FIG. 32, in the space represented by the viewing environment reference data, the video display device 34 is arranged along one wall of the viewing environment space, and the lighting device 37 is 16 on the ceiling, floor, and 4 walls. They are arranged periodically. FIG. 33 shows viewing environment reference data representing the viewing environment space. The viewing environment space information such as the size of the viewing environment space, the wall color and the reflectance, the installation position of the video display device 34, and the screen Video display device information such as size and screen direction, and lighting device information indicating the position and irradiation direction of each lighting device 37 with respect to the video display device are included. Here, the position and direction are expressed in a coordinate system with the screen center of the video display device 34 as a reference. Moreover, the illuminating device 37 is set as the direct illumination each installed in the wall. The reference data shown in FIGS. 32 and 33 is an example and is not limited to the above.

  In addition, the viewer input information receiving unit 6 is configured such as the installation position, the screen direction, and the screen size of the video display device 4 input by the viewer using, for example, operation buttons provided on the body of the viewing environment control device 1 or the remote control device. The video display device information, the lighting device information such as the installation position, type, size, and irradiation direction of the lighting device 7 and the viewing environment space information such as the size of the viewer's room and the wall color are received and sent to the CPU 8.

  The CPU 8 performs calculations based on the video display device information, the lighting device information, and the viewing environment space information received by the viewer input information receiving unit 6, generates lighting control information for the lighting device 8, and stores lighting control information. Send to part 9. Here, the arithmetic processing performed by the CPU 8 is the same as the processing described in the first embodiment, and therefore description thereof is omitted.

  The illumination control information storage unit 9 stores the illumination control information calculated by the CPU 8 in a table format. Here, an identifier (hereinafter referred to as “ID”) is assigned to the lighting device 7 in advance, and the lighting control information stored in the lighting control information storage unit 9 is a table for each ID of the lighting device 7. Stored in the format. The projection lighting control information stored in the lighting control information storage unit 9 is appropriately sent to the lighting control data conversion unit 29 via the CPU 8 in accordance with a request from the lighting control data conversion unit 29. The illumination control data conversion unit 29 converts the illumination control data separated by the data separation unit 3 into the viewing environment space based on the viewing environment reference data separated by the data separation unit 3 and the viewing environment control information sent from the CPU 8. Is converted into appropriate lighting control data corresponding to the position of each lighting device 7 installed in the lighting device 7 and sent to the lighting device 7.

  Here, the illumination control data conversion method compares the reference model information stored in the internal memory of the CPU 8 with the viewing environment reference data acquired from the external device, and is represented by the illumination control information sent from the CPU 8. Based on the correspondence between the position and the illumination position represented by the viewing environment reference data, the illumination control data corresponding to the illumination device in the virtual viewing environment space acquired from the external device is obtained as the illumination device in the actual viewing environment space. May be converted into illumination control data corresponding to the above.

  Specifically, the reference model shown in FIGS. 19 and 20 and the reference data multiplexed and transmitted on the broadcast wave shown in FIGS. 32 and 33 match the installation position of the image display device and the screen direction. Thus, the coordinate conversion is performed to calculate which of the lighting devices s1 to s96 represented by the reference data corresponds to the lighting devices v1 to v54 in the reference model. Here, this calculation method will be described with reference to FIGS. 34 and 35 by taking the lighting devices v1 to v9 installed on the ceiling of the reference model as an example. In addition, in the example of FIG. 34, it is assumed that the ceiling size of the viewing environment space of the reference model and the reference data is the same for easy understanding. In FIG. 34, the illumination devices v1 to v9 in the reference model correspond to any of the illumination devices s1 to s16 in the reference data, respectively. For example, the illumination device v1 in the reference model corresponds to s1, s2, s5, and s6 of the illumination device in the reference data.

  Here, FIG. 35 is a diagram illustrating a corresponding positional relationship and an area ratio between the illumination device v1 in the reference model and the illumination devices s1, s2, s5, and s6 in the reference data. As for the area ratio of the illumination devices s1, s2, s5, and s6 in the reference data corresponding to the illumination device v1 in the reference model, (s1: s2: s5: s6) is (5: 2: 2: 1). Thus, the lighting device in the reference data corresponding to the lighting device v1 in the reference model and the area ratio thereof can be calculated, and the corresponding positional relationship and the area with the lighting device in the reference data for other lighting devices in the reference model can be calculated in the same manner. Calculate the ratio.

  Next, the illumination control data conversion unit 29 stores the projection illumination control information stored in the illumination control information storage unit 9 and read out via the CPU 8 (corresponding position between the illumination device in the actual viewing environment space and the illumination device in the reference model). Relationship information) and the corresponding positional relationship between the lighting device in the reference model calculated above and the lighting device in the reference data, the lighting device in the actual viewing environment space is converted into the corresponding positional relationship with the lighting device in the reference data. . Then, the lighting control data acquired from the external device together with the reference data is weighted according to the area ratio of the lighting device in the reference data corresponding to the lighting device in the actual viewing environment space, and the lighting device in the actual viewing environment space is appropriately Illumination control data for controlling illumination is calculated and sent to each illumination device 7.

  In addition, since it is necessary to match the output timing of the illumination control data sent to the illumination device 7 with the video data and the audio data, the illumination control data conversion unit 29 generates the illumination control data in the illumination control data conversion unit 29, for example. Delay generation units 30a and 30b are provided for delaying the video data and the audio data separated by the data separation unit 3 and synchronizing with the illumination control data by a time necessary for the above.

  By configuring the viewing environment control device as described above, one or more lighting devices 7 installed in the viewing environment space can be provided without providing a function of generating illumination control data from the video feature amount / audio feature amount. It can be appropriately controlled according to the installation position. In addition, appropriate lighting control can always be performed even when the installation position of the lighting device 7 in the viewing environment space is changed, or when the lighting device 7 is added.

  In the above, as the second embodiment of the present invention, the reference model information is stored in advance in the internal memory of the CPU 8, and first, the installation position information of the lighting device 7 in the actual viewing environment space input by the viewer is used as the reference model. To the corresponding position information of the lighting device in the reference model, and then the lighting device in the reference model is converted to the corresponding position information of the lighting device in the reference data sent from the external device, and then the illumination in the actual viewing environment space The conversion method of generating the illumination control data by converting the device 7 into the corresponding position information of the illumination device in the reference data has been described. However, the illumination control data conversion method is not limited to the above, and a reference model is not necessarily required.

  For example, information related to the relative position between the lighting device 7 and the video display device 4 is acquired from information input by the viewer, and the information and reference data sent from an external device are used as the position and screen direction of each video display device. Lighting control to appropriately illuminate the lighting device in the actual viewing environment space by calculating the lighting device and the area ratio in the reference data corresponding to the lighting device in the actual viewing environment space A method of converting to data may be used. Still another method may be used.

  In this embodiment, the lighting control data and the viewing environment reference data are added to the video data and broadcast. However, the lighting control data is multiplexed with the broadcast wave and transmitted, and the viewing environment reference data is transmitted. Needless to say, the present invention can be applied even when the position of the video display device 4 is changed when it can be obtained from an external server device or the like via the Internet.

  Furthermore, the lighting control information stored in the lighting control information storage unit is once transmitted to an external server device via the Internet or the like, and the server device responds to the installation state of the lighting device in the viewing environment space of the viewer. The lighting control data may be generated and received via the Internet or the like, and used as lighting control data for each lighting device. This will be described below as a third embodiment of the present invention, but the same parts as those in the first embodiment are denoted by the same reference numerals, and the description thereof will be omitted.

  FIG. 36 is a block diagram showing a viewing environment control apparatus according to the third embodiment of the present invention. The viewing environment control apparatus 31 according to the present embodiment receives broadcast data transmitted from the transmission side (broadcast station) in the first receiving unit 32, and video data multiplexed in the broadcast data in the data separation unit 3. And audio data. The video data and audio data separated by the data separation unit 3 are sent to the video display device 4 and the audio reproduction device 5, respectively.

  In addition, the viewer input information receiving unit 6 is a video image such as an installation position, a screen direction, and a screen size of the video display device input by the viewer using, for example, an operation button provided on the main body of the viewing environment control device 31 or a remote control device. The display device information, the illumination device information such as the installation position, type, size and irradiation direction of the illumination device, and the viewing environment space information such as the viewer's room size and wall color are received and stored in the illumination control information storage unit 9. send.

  The lighting control information storage unit 9 stores the video display device information, lighting device information, and viewing environment space information received by the viewer input information receiving unit 6 in a table format. Here, an identifier (hereinafter referred to as “ID”) is assigned to the lighting device 7 in advance, and the lighting device information stored in the lighting control information storage unit 9 is in a table format for each ID of the lighting device 7. Stored in The CPU 41 notifies the external server device via the transmission unit 42 of a transmission request for lighting control data related to the program content displayed on the video display device 4 based on an instruction from the user. At this time, the illumination control information stored in the illumination control information storage unit 9 and the reference model information stored in the internal memory of the CPU 41 are sent from the transmission unit 42 to an external server device in accordance with a command from the CPU 41.

  Then, the external server device generates lighting control data related to the program content requested for transmission based on the lighting control information and the reference model information, and transmits the lighting control data to the viewing environment control device that is the request source. The illumination control data transmitted from this external server device is received by the second receiving unit 43 and once held in the CPU 41. Then, the CPU 41 sends the illumination control data corresponding to the TC (time code) of the video data separated by the data separation unit 3 to the illumination device 7. That is, the illumination control data transmitted from the external server device is described in units of frames in association with the TC (timing code) of the video data so that it can be output in synchronization with the output timing of the video data. ing.

  Since the operation of the viewer input information receiving unit 6 is the same as that of the first embodiment described above, description thereof is omitted here. Moreover, in this embodiment, it can be said that the function of the illumination control data conversion unit 29 in the second embodiment is provided in an external device. That is, the viewing environment control device 31 can acquire illumination control data corresponding to the arrangement / number of illumination devices in the actual viewing environment space from an external device.

  By configuring the viewing environment control device in this way, the viewing environment can be provided without providing a function for generating illumination control data from the video feature / audio feature and a function for converting the illumination control data according to the viewing environment. One or more lighting devices 7 installed in the space can be appropriately controlled according to the installation position. In addition, when the installation position of the lighting device 7 in the viewing environment space is changed, when the lighting device 7 is added, or when the position of the video display device 4 is further changed, appropriate lighting control can always be performed. .

  As described above, as the third embodiment of the present invention, the reference model information is stored in advance in the internal memory of the CPU 41, and the installation position information of the lighting device 7 in the actual viewing environment space input by the viewer is used as the illumination in the reference model. It has been described that the illumination control information is converted to the corresponding position information of the device, the obtained illumination control information is transmitted to the external server device, and the illumination control data is generated by the external server device. However, the illumination control data conversion method is not limited to the above, and a reference model is not necessarily required. For example, information related to the relative position between the lighting device 7 and the video display device 4 is acquired from information input by the viewer, and the information is transmitted to an external server device. You may make it calculate the illumination control data which carry out illumination control appropriately for the illuminating device in space. Still another method may be used.

  In the above description, the program content is not limited to content related to a television program transmitted by television broadcasting, but may be content related to a work stored on a media medium such as a DVD. That is, the input video data is not limited to that obtained by receiving a television broadcast, and the present invention can also be applied to the case where video data reproduced from an external reproduction device is input.

It is a block diagram which shows the viewing environment control apparatus which concerns on 1st embodiment of this invention. It is an external view which shows an example of the illuminating device used by this invention. It is a figure which shows an example of viewing-and-listening environment space. It is a figure which shows the input operation | movement flowchart of the viewing environment information which a viewer performs. It is a figure which shows an example of a remote control device. It is a figure which shows the screen display which signals the input start of viewing environment information. It is a figure which shows the screen display which prompts input of viewing environment space information. It is a figure which shows the screen display which inputs the magnitude | size information of viewing environment space. It is a figure which shows the screen display which inputs the color information of viewing environment space. It is a figure which shows the screen display which prompts input of video display apparatus information. It is a figure which shows the screen display which inputs the screen size information of a video display apparatus. It is a figure which shows the screen display which inputs the position and angle information of a video display apparatus. It is a figure which shows the screen display which prompts input of illuminating device information. It is a figure which shows the screen display which inputs the basic information of an illuminating device. It is a figure which shows the screen display which inputs the positional information on an illuminating device. It is a figure which shows the screen display which inputs the irradiation direction information of an illuminating device. It is a three-dimensional view showing coordinate transformation based on an example of viewing environment space. It is a top view showing coordinate transformation based on an example of viewing environment space. It is a three-dimensional view showing a reference model. It is a plane development view showing a reference model. It is a figure which shows an example of a display image. It is a figure which shows the feature-value detection area | region with respect to the display image of FIG. It is the top view which piled up the actual viewing environment space and the reference model. FIG. 3 is a three-dimensional diagram in which an actual viewing environment space and a reference model are superimposed. It is a figure which shows the irradiation position in the reference model of the illuminating device in an actual viewing-and-listening environment space. It is a figure which shows the illuminating device in the reference model corresponding to the irradiation area | region of the illuminating device 71. It is a figure which shows an example of the data table stored in an illumination control information storage part. It is a figure which shows the operation | movement flow of an illumination control data generation part. It is a top view which shows the calculation method of another feature-value detection area | region. It is a three-dimensional view showing another feature amount detection region calculation method. It is a block diagram which shows the viewing environment control apparatus which concerns on 2nd embodiment of this invention. It is a figure which shows an example of the virtual viewing environment space represented by viewing environment reference data. It is a figure which shows an example of viewing environment reference data. It is a figure which shows the correspondence of the illuminating device in a reference model, and the illuminating device in reference data. It is a figure which shows the correspondence with the illuminating device in the reference data of the illuminating device v1. It is a block diagram which shows the viewing-and-listening environment control apparatus which concerns on 3rd embodiment of this invention.

Explanation of symbols

1, 21, 31, viewing environment control device 2, 22, reception unit 3, 23, data separation unit 4, 34, video display device 5, audio reproduction device 6, viewer input information reception unit 7, 37, lighting device 8 41 CPU
9 ... Lighting control information storage 10 ... Lighting control data generation unit 11 (a), 11 (b), 30 (a), 30 (b) ... Delay generation unit 12 ... Remote control device 13 ... Viewing environment setting key 14 ... Decision key 15 ... Cross key 16 ... Number key 29 ... Illumination control data converter 32 ... First receiver 42 ... Transmitter 43 ... Second receiver

Claims (17)

A viewing environment control device that controls illumination light of one or more illumination devices based on a feature amount of video data to be displayed on a display device,
Information input means for allowing a viewer to input information related to the installation position of the lighting device with respect to the installation position of the display device;
Illumination control for controlling each lighting device based on the feature amount of the video data extracted according to information about the installation position of the lighting device with respect to the installation position of the display device input by the information input means A viewing environment control apparatus comprising illumination data generation means for generating data. Viewing that controls illumination light of one or more lighting devices based on reference data regarding a lighting position in a virtual viewing environment space acquired from an external device and lighting control data corresponding to the lighting position in the virtual viewing environment space An environmental control device,
Information input means for allowing a viewer to input information related to the installation position of the lighting device with respect to the installation position of the display device;
Based on the information related to the installation position of the illumination device with respect to the installation position of the display device input by the information input means and the reference data, illumination control data corresponding to the illumination position in the virtual viewing environment space, A viewing environment control device comprising illumination data conversion means for converting into illumination control data for controlling each illumination device. A viewing environment control device that controls illumination light of one or more illumination devices based on illumination control data acquired from an external device,
Information input means for allowing a viewer to input information related to the installation position of the lighting device with respect to the installation position of the display device;
Transmitting means for transmitting, to the external device, information related to the installation position of the lighting device with respect to the installation position of the display device input by the information input means;
A viewing environment control device comprising: a receiving unit configured to receive illumination control data generated by an external device based on information related to an installation position of the illumination device with respect to an installation position of the display device.   The viewing environment control apparatus according to claim 1, wherein the information input unit further causes a viewer to input information related to a screen direction of the display device.   The viewing environment control apparatus according to claim 1, wherein the information input unit further causes a viewer to input information relating to a screen size of the display device.   6. The viewing environment control apparatus according to claim 1, wherein the information input unit further causes a viewer to input information regarding an irradiation direction of each of the lighting devices.   The viewing environment control apparatus according to claim 1, wherein the information input unit further causes a viewer to input at least one of a type or a size of the lighting device.   8. The viewing environment control according to claim 1, wherein the information input unit further causes a viewer to input information regarding a size of a room in which the display device and the lighting device are installed. apparatus.   9. The viewing environment according to claim 1, wherein the information input unit further causes the viewer to input information regarding a color of a wall of a room in which the display device and the lighting device are installed. Control device. A display unit that displays a schematic diagram of a room including the display device and the lighting device on the display device at the time of information input by the information input unit;
10. The viewing environment control apparatus according to claim 1, wherein the display content displayed by the display unit is changed in conjunction with the information input by the information input unit. The display means first displays an input screen that prompts the user to input information regarding the size of the room,
11. The viewing environment control device according to claim 10, wherein after the setting of the size of the room is completed, a screen that prompts information input regarding at least the position of the display device or the lighting device is displayed.   The viewing environment control apparatus according to claim 10 or 11, wherein the schematic diagram of the room displayed by the display means is represented by a plan view and a side view of the room.   The viewing environment control apparatus according to claim 10 or 11, wherein the schematic diagram of the room displayed by the display device is represented by a three-dimensional view viewed from an arbitrary viewpoint outside the room.   The viewing environment control device according to any one of claims 1 to 13, a display device for displaying the video data, and an illumination device installed around the display device. Viewing environment control system. A viewing environment control method for controlling illumination light of one or more illumination devices based on a feature amount of video data to be displayed on a display device,
An information input step for allowing a viewer to input information related to the installation position of the lighting device with respect to the installation position of the display device;
Illumination control for controlling each lighting device based on the feature amount of the video data extracted according to information about the installation position of the lighting device with respect to the installation position of the display device input by the information input means A viewing environment control method comprising: an illumination data generation step for generating data. Viewing that controls illumination light of one or more lighting devices based on reference data regarding a lighting position in a virtual viewing environment space acquired from an external device and lighting control data corresponding to the lighting position in the virtual viewing environment space An environmental control method,
An information input step for allowing a viewer to input information related to the installation position of the lighting device with respect to the installation position of the display device;
Based on the information related to the installation position of the illumination device with respect to the installation position of the display device input by the information input means and the reference data, illumination control data corresponding to the illumination position in the virtual viewing environment space, A viewing environment control method comprising: an illumination data conversion step for converting into illumination control data for controlling each illumination device. A viewing environment control method for controlling illumination light of one or more illumination devices based on illumination control data acquired from an external device,
An information input step for allowing a viewer to input information related to the installation position of the lighting device with respect to the installation position of the display device;
A transmission step of transmitting, to the external device, information related to the installation position of the lighting device with respect to the installation position of the display device input by the information input means;
A viewing environment control method comprising: a reception step of receiving illumination control data generated by an external device based on information related to an installation position of the illumination device with respect to an installation position of the display device.