JP2011040963A - Video display device, and illumination control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To further effectively present the content of an image displayed on a screen of a video display device by controlling illumination of a viewing environment by being operatively connected with the content of the image of the video display device. <P>SOLUTION: A keyword extraction section 23 extracts a category keyword from a category keyword table 40 based on a character string included in program information of a program name and a broadcast program, and an illumination color determination section 24 determines an illumination color of a viewing environment by extracting color corresponding to the category keyword from a correlationship table between color and emotion based on the category keyword. A color temperature measurement section 19 measures the color temperature of illumination of the viewing environment; a reaching time calculation section 25 calculates an arrival time until reaching the illumination color of the viewing environment; a light color calculation section 26 calculates a chromaticity value of a division point between a chromaticity value by the color temperature of the viewing environment before the illumination color changes and a final chromaticity value of the illumination color to be converted to an RGB value, and transmits the RGB value to an illumination control section 21. The illumination control section 21 transmits a control signal of the RGB value to a lighting system 22 to control the illumination color. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a video display device and a lighting control method for controlling lighting in a viewing environment in conjunction with an image of a video display device.

  In recent years, in video display devices such as digital broadcast receivers, the performance of display devices has been dramatically improved and the screen has been enlarged, and it has become possible to enjoy clear and powerful video at home. It was. When enjoying the video, lighting in the viewing environment has been attracting attention in order to further enhance the realism of the video. Conventionally, with regard to illumination, attention has been paid mainly to the brightness of the viewing environment, but attention has also been paid to the color of the illumination in addition to the brightness.

  An image display device that controls a light source in conjunction with an image, and includes a light source, an illumination control unit that controls the light source, and an image display unit that displays an image, and the illumination control unit is displayed on the image display device An image display device that controls the chromaticity of the light source so that the chromaticity of the peripheral visual field of the image display device is a hue that is substantially opposite to the hue on the chromaticity diagram with respect to the average chromaticity of all pixels of the image. It has been devised (for example, see Patent Document 1).

JP 2006-156416 A

  In Patent Document 1, the illumination of the viewing space is controlled in conjunction with the video so that the presence of the image displayed on the screen of the image display device is enhanced. This is a control method for illuminating a chromaticity that is substantially opposite to the average chromaticity of the image display device.

  If the illumination of the viewing environment is appropriate for the content and atmosphere of the program displayed on the screen of the video display device, the viewer is more likely to be immersed in the program and feel more realistic. There is a possibility that red or yellow matches the content of the program more than the bright blue or purple lights in a lively program.

  The present invention has been made in view of the circumstances as described above, and controls the illumination of the viewing environment in conjunction with the content of the image of the video display device, thereby allowing the image displayed on the screen of the video display device to be displayed. An object of the present invention is to provide a video display device and a lighting control method capable of presenting the contents more effectively.

  In order to achieve the above object, a video display device according to the present invention includes a keyword extraction unit that extracts a property keyword based on program information of a broadcast program, and an illumination color that determines an illumination color of a viewing environment based on the property keyword. It has a determination part and the illumination control part which controls the illuminating device of the said viewing environment based on the said illumination color, It is characterized by the above-mentioned.

  The lighting control method of the present invention is a lighting control method for a viewing environment in a video display device, and includes a keyword extracting step for extracting a property keyword based on program information of a broadcast program, and a viewing environment based on the property keyword. An illumination color determining step for determining the illumination color and an illumination control step for controlling the illumination device in the viewing environment based on the illumination color.

  ADVANTAGE OF THE INVENTION According to this invention, the content of the image displayed on the screen of an image display apparatus can be shown more effectively by controlling the illumination of viewing environment in conjunction with the content of the image of an image display apparatus.

The block diagram which shows the structure of the Example of the video display apparatus by this invention. The figure which shows the example of a property keyword table. The figure which shows the example of the correlation table of a color and an emotion. The figure which showed that the chromaticity value of viewing environment changes from the state before a change to the state after a change. The figure which expanded from the point A shown in FIG. 4 to the point B. FIG. The figure which showed the series of formula which calculates | requires RGB value from the chromaticity value on a CIE chromaticity diagram. The figure which showed the operation | movement flow of the illumination control of a video display apparatus. The block diagram which shows the structure of the video display apparatus concerning a 2nd Example.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a block diagram showing the configuration of an embodiment of a video display device 1 according to the present invention. The antenna 2 is an antenna for terrestrial digital broadcasting or satellite digital broadcasting for receiving broadcast radio waves transmitted from the broadcasting station 30. The tuner 3 selects a broadcast signal of a desired channel from broadcast signals of terrestrial digital broadcast or satellite digital broadcast.

  The demodulator 4 demodulates corresponding to each digital broadcasting modulation method. Terrestrial digital broadcast signals are demodulated into digital video signals and audio signals by OFDM (Orthogonal Frequency Division Multiplexing) demodulation, and satellite digital broadcast signals are demodulated into PSK (Phase Shift Keying) demodulation and output to the signal processing unit 5. Is done.

  The signal processing unit 5 selectively performs predetermined digital signal processing on the digital video signal and audio signal supplied from the demodulator 4, and outputs them to the video processing unit 6 and the audio processing unit 7. The signal processing unit 5 has functions such as an MPEG (Moving Picture Experts Group) encoder, an MPEG decoder, and a video / audio decoder.

  The video processing unit 6 converts the digital video data input from the signal processing unit 5 into a format that can be displayed on the display device 8 or arbitrarily adjusts the display color, and outputs it to the display device 8. To display the image. The audio processing unit 7 converts the digital audio data input from the signal processing unit 5 into an analog audio signal that can be reproduced by the speaker 9, and then outputs the analog audio signal to the speaker 9 to reproduce the audio.

  In the video display device 1, all the operations including the above-described reception operation are comprehensively controlled by the control unit 11. The control unit 11 is equipped with an MPU (Micro Processing Unit) 12 and controls each component connected via the bus 10.

  A RAM (Random Access Memory) 13 is a read / write memory that stores various data necessary for data processing of the control unit 11, and operates as a buffer memory that stores video data and the like. A ROM (Read Only Memory) 14 is a read only memory and stores a control program executed by the control unit 11.

  The flash memory 15 is a non-volatile semiconductor memory that can be rewritten and does not lose data even when the power is turned off. The flash memory 15 has a function of storing a control program or the like corresponding to a newly developed lighting device acquired by the video display device 1 from a server or digital broadcast on the Internet.

  The operation reception unit 16 receives an operation signal transmitted from the operation device 17 and transfers the operation signal to the control unit 11. The operation device 17 is, for example, a remote controller (remote controller), a wired or wireless keyboard, a mouse, or the like using wireless communication such as infrared or Bluetooth, and transmits an operation signal. The operation receiving unit 16 receives operation signals from the remote controller, keyboard, mouse and the like.

  The video display device 1 is connected to the Internet 31 via the transmission / reception unit 18. Thereby, the video display apparatus 1 can perform information transmission via the transmission / reception unit 18 with a device such as a server on the network of the Internet 31.

  The color temperature measurement unit 19 has a function of measuring the color temperature of the light source in the viewing environment. The color temperature measurement unit 19 transmits information on the measured color temperature to the control unit 11. The color temperature measuring unit 19 receives the signal from the light receiving unit 19a in which a sensor for measuring the color temperature is stored, and measures the color temperature. The light receiving unit 19a is connected to the video display device 1 by a cable (not shown).

  The illumination control unit 21 controls the light color (illumination color) of the illumination device 22 in the viewing environment. The illumination control unit 21 outputs RGB control signals to the illumination device 22. The illumination device 22 is installed outside the video display device 1 and includes a plurality of light sources of R, G, and B colors. The illumination device 22 has various light colors based on RGB control signals sent from the illumination control unit 21. Emits light. The illumination device 22 is, for example, an illumination device in which a plurality of RGB high-brightness LEDs are combined. Communication from the illumination control unit 21 to the illumination device 22 is performed by wireless communication or wired communication using infrared rays, Bluetooth, or the like.

  The control unit 11 has functions of a keyword extraction unit 23, an illumination color determination unit 24, an arrival time calculation unit 25, and a light color calculation unit 26. The keyword extraction unit 23 extracts emotion property keywords based on the character string included in the program information of the broadcast program decoded by the signal processing unit 5. Program information data is included in an EIT (Event Information Table) of SI (Service Information, program arrangement information), and character strings are extracted from information on individual programs such as a program name and a broadcast summary. The keyword extraction unit 23 compares the character string included in the program information of the broadcast program with the property keyword table to extract the property keyword.

  FIG. 2 is a diagram illustrating an example of the property keyword table 40. The item of program name and detailed information indicates a character string included in the program information of the broadcast program. The item of emotional nature indicates a nature keyword. Property keywords corresponding to program name and detailed information items are shown on the same line.

  The keyword extraction unit 23 compares the character string included in the program information of the program name and broadcast program with the character string described in the detailed information item of the property keyword table 40, and searches for a character string having a high appearance frequency. To do. For example, “soccer” is included in the information about the program such as the program name and the broadcast summary, and “soccer” is set as the main character string if the appearance frequency is higher than other character strings. The keyword extracting unit 23 extracts “furious / angry / joyful / active / excited” from the property keyword table 40 as a property keyword corresponding to “soccer, martial arts”. The extracted keyword is temporarily stored in the RAM 13.

  The illumination color determination unit 24 determines the illumination color of the viewing environment based on the property keyword extracted by the keyword extraction unit 23. The illumination color determination unit 24 extracts the corresponding color from the correlation table between the color and the emotion based on the property keyword and sets it as the illumination color.

  FIG. 3 is a diagram illustrating an example of the correlation table 41 between colors and emotions. As the correlation table 41 between color and emotion, for example, a table published in the Color Chemistry Handbook published by the Japan Color Society may be adopted. The item of the nature of emotion in the rightmost item of the color-emotion correlation table 41 corresponds to the property keyword shown in FIG. There are color items on the left side of the emotional nature item, and colors corresponding to the emotional nature are displayed. For example, when the nature of the emotion is “rage, anger, joy, vitality, excitement”, the corresponding color is “red”.

  The illumination color determination unit 24 retrieves the property keyword data stored in the RAM 13, refers to the color and emotion correlation table 41, searches for the corresponding property keyword, and extracts the color corresponding to the property keyword. Determine the lighting color. For example, when the property keyword is “rage, anger, joy, vitality, excitement”, the illumination color of the viewing environment is determined as “red”. For example, in the case of “Peacefulness, Relaxation, Calmness, Youthfulness”, “Green” is set.

  The arrival time calculation unit 25 calculates the time until the illumination color determined by the illumination color determination unit 24 changes and finally arrives. Since the viewer feels uncomfortable when the illumination color in the viewing environment is rapidly changed, it is desirable to gradually change the illumination color from the state before the illumination color to the final illumination color. The arrival time calculation unit 25 has a plurality of modes for the time to reach the illumination color of the final viewing environment. For example, the arrival time calculation unit 25 acquires the program end time from the program information, and the final illumination at the program end time. A mode that changes to a color, a mode that changes to a final illumination color a predetermined time before the program end time, a mode that changes to a final illumination color in a predetermined time after the change starts, and the like are provided. These modes can be selected by the viewer.

  The light color calculation unit 26 calculates the illumination color that is being changed and sends it to the illumination control unit 21 in order to gradually change the illumination color. First, a division number (quotient) is calculated when the arrival time calculated by the arrival time calculation unit 25 is divided at a predetermined time interval. For example, if the time to reach the final illumination color is 80 minutes later and the illumination is changed at intervals of 8 minutes, the number of divisions becomes 10 (80 ÷ 8 = 10). The viewer can select the time interval or the number of divisions. If the time interval is reduced or the number of divisions is increased, the illumination color changes smoothly.

  The light color calculation unit 26 divides the chromaticity value according to the color temperature before the illumination color measured by the color temperature measurement unit 19 and the chromaticity value of the final illumination color by the above-described division number, The chromaticity value for each division point is calculated. The chromaticity value indicates chromaticity coordinates in the chromaticity diagram. For example, when the chromaticity value before the illumination color changes is x≈0.34, y≈0.35, and the final illumination color chromaticity value is x≈0.46, y≈0.29, When this interval is divided into 10, the chromaticity value of the first division point is x1 = 0.34 + (0.46-0.34) ÷ 10 = 0.352, y1 = 0.35 + (0.29). −0.35) ÷ 10 = 0.344. The light color calculation unit 26 converts the chromaticity values into RGB values and sends them to the illumination control unit 21.

  FIG. 4 is a diagram showing that the chromaticity value of the viewing environment changes from the state before the change to the state after the change. FIG. 4 uses a CIE (Commission international e de l'eclairage) 1931 chromaticity diagram and shows the color locus of blackbody radiation inside. Point A is a chromaticity value (chromaticity coordinate) calculated from the color temperature of the light source (illumination) in the viewing environment before the illumination measured by the color temperature measurement unit 19 changes. For example, the point A is a case where the color temperature is 5000 K close to that of ordinary sunlight, and the chromaticity coordinates are x≈0.34 and y≈0.35. Point B is the illumination color of the viewing environment determined by the illumination color determination unit 24. For example, if the color is “red”, the chromaticity coordinates are x = 0.46 and y = 0.29. If it is “green”, x = 0.30 and y = 0.60. The point A changes to the point B through the time calculated by the arrival time calculation unit 25.

  FIG. 5 is an enlarged view from point A to point B shown in FIG. For example, if the illumination is changed at intervals of 8 minutes after the time from point A to point B is 80 minutes, the number of divisions is 80 ÷ 8 = 10. A line segment from the point A to the point B is divided into ten, and the dividing points are represented by points C1 to C9. For example, the light color calculation unit 26 outputs the chromaticity values of the chromaticity value x1 = 0.352 and y1 = 0.344 of the point C1. The light color calculation unit 26 converts the chromaticity values of the points A, B, and C1 to 9 into RGB and sends them to the illumination control unit 21. For example, the RGB values of the chromaticity value at point B are R237, G26, and B61.

  FIG. 6 is a diagram showing a series of equations for obtaining RGB values from chromaticity values (chromaticity coordinates) on the CIE chromaticity diagram. The light color calculation unit 26 converts it into RGB values by the calculation formula shown in FIG. The RGB values shown in the last three rows in FIG. 6 are output to the illumination control unit 21 as illumination control values.

  FIG. 7 is a diagram illustrating an operation flow of illumination control of the video display device 1. In S11, the video display device 1 receives a television broadcast such as a digital broadcast. In S <b> 12, the keyword extraction unit 23 extracts a property keyword from the program name, the character string included in the program information of the broadcast program, and the property keyword table 40.

  In S13, the illumination color determination unit 24 determines the illumination color of the viewing environment based on the property keyword extracted by the keyword extraction unit 23. The illumination color determination unit 24 extracts a corresponding color from the color and emotion correlation table 41 based on the property keyword and determines the illumination color.

  In S <b> 14, the color temperature measurement unit 19 measures the color temperature of the illumination in the viewing environment and transmits data to the control unit 11. In S <b> 15, the arrival time calculation unit 25 calculates an arrival time until the illumination color of the viewing environment determined by the illumination color determination unit 24 gradually changes and arrives.

  In S <b> 16, the light color calculation unit 26 determines the chromaticity value according to the color temperature of the illumination in the viewing environment before the illumination color measured by the color temperature measurement unit 19 changes, and the final determined by the illumination color determination unit 24. The chromaticity values of various illumination colors are divided by a predetermined division number, and the chromaticity value for each division point is calculated. The light color calculation unit 26 converts the chromaticity values into RGB values and sends them to the illumination control unit 21.

  In S <b> 17, the illumination control unit 21 transmits an RGB value control signal to the illumination device 22 to control the illumination color of the illumination device 22. At the arrival time calculated by the arrival time calculation unit 25, the final illumination color is reached and the process ends.

  As described above, the property keyword is extracted from the property keyword table 40 based on the program name and the character string included in the program information of the broadcast program, and the property keyword is supported from the color and emotion correlation table 41 based on the property keyword. The color to be extracted is extracted and the illumination color of the viewing environment is determined. Measure the color temperature of the lighting in the viewing environment before the change, calculate the arrival time to reach the final lighting color, and reach the final lighting color while controlling the lighting color to change gradually Like that. By doing so, the illumination of the viewing environment can be controlled in conjunction with the content of the image on the image display device 1, and the content of the image displayed on the screen of the image display device 1 can be presented more effectively. be able to. In addition, by gradually changing to illumination having a psychological effect, video content having a psychological effect can be displayed.

  FIG. 8 is a block diagram illustrating the configuration of the video display device 50 according to the second embodiment. In each part of the second embodiment, the same parts as those of the video display device 1 of the first embodiment shown in FIG. The second embodiment is different from the first embodiment in that the control unit 11 is replaced with the control unit 51 and the control unit 51 includes an image recognition unit 52.

  The image recognition unit 52 performs face recognition or motion recognition of a person in the video. The control unit 51 temporarily stores the broadcast program image in the RAM 13. The image recognizing unit 52 takes out the image data stored in the RAM 13, performs face recognition of the person, and recognizes the emotion level of the person. Face emotion data indicating the level of emotion such as anger, anxiety (fear), joy, sadness, etc. is generated from facial expressions. Further, the image recognition unit 52 generates motion emotion data indicating the level of emotion such as anger, joy, and sadness from the motion of the person, and motion data indicating the motion level such as calm, activity, and excitement. It should be noted that various known methods have been devised for image recognition methods relating to human face recognition or motion recognition, and any suitable method may be employed.

  The keyword extraction unit 23 extracts emotion property keywords based on the facial emotion data, the motion emotion data, and the exercise data output from the image recognition unit 52. The keyword extraction unit 23 collates words such as “anger”, “joy”, “seduce”, and “sorrow” in the facial emotion data, motion emotion data, exercise data, and emotion property items in the property keyword table 40. , The best matching property keyword is extracted. For example, if the face emotion data and the motion emotion data are mainly “anger”, “emotion / anger / joy / energy / excitement” is extracted as the property keyword. Also, for example, if “sorrow” is dominant, “settlement, loneliness, sadness, profoundness, calm” is extracted. The operation flow of lighting control after the property keyword is extracted is the same as that of the first embodiment.

  As described above, the property keyword is extracted from the property keyword table 40 based on the facial emotion data, the motion emotion data, and the exercise data output by the image recognition unit 52, and the color and emotion correlation table 41 is based on the property keyword. The color corresponding to the property keyword is extracted from the image and the illumination color of the viewing environment is determined. Measure the color temperature of the lighting in the viewing environment before the change, calculate the arrival time to reach the final lighting color, and reach the final lighting color while controlling the lighting color to change gradually Like that. In this way, the illumination of the viewing environment can be controlled in conjunction with the image content of the image display device 50, and the content of the image displayed on the screen of the image display device 50 is presented more effectively. be able to. In addition, by gradually changing to illumination having a psychological effect, video content having a psychological effect can be displayed.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

1 Video Display Device 2 Antenna 3 Tuner 4 Demodulator 5 Signal Processing Unit 6 Video Processing Unit 7 Audio Processing Unit 8 Display Device 9 Speaker 10 Bus 11 Control Unit 12 MPU
13 RAM
14 ROM
DESCRIPTION OF SYMBOLS 15 Flash memory 16 Operation receiving part 17 Operation apparatus 18 Transmission / reception part 19 Color temperature measurement part 19a Light receiving part 21 Illumination control part 22 Illumination device 23 Keyword extraction part 24 Illumination color determination part 25 Arrival time calculation part 26 Light color calculation part 30 Broadcasting station 31 Internet 40 Property keyword table 41 Correlation table 50 of color and emotion Video display device 51 Control unit 52 Image recognition unit

Claims (10)

A keyword extraction unit that extracts property keywords based on program information of broadcast programs;
An illumination color determination unit that determines the illumination color of the viewing environment based on the property keyword;
An image display device comprising: an illumination control unit that controls the illumination device in the viewing environment based on the illumination color.   2. The video display apparatus according to claim 1, wherein the keyword extracting unit extracts the property keyword by comparing program information of a broadcast program with a property keyword table.   The video display device according to claim 1, wherein the illumination color determination unit determines an illumination color of a viewing environment by collating a correlation table between the property keyword, color, and emotion. A color temperature measurement unit for measuring the color temperature of the viewing environment before the illumination color is changed;
An arrival time calculation unit for calculating an arrival time to reach the illumination color after the change, and a division number when the arrival time is divided at a predetermined time interval, the chromaticity value by the color temperature and the chromaticity value of the illumination color And a light color calculation unit that calculates a chromaticity value for each division point,
2. The video display device according to claim 1, wherein the illumination control unit controls the illumination device such that a chromaticity value for each corresponding division point is obtained every time the predetermined time interval elapses. An image recognition unit that recognizes a person in an image of a broadcast program and generates emotion data of the person;
A keyword extraction unit for extracting a property keyword based on the emotion data;
An illumination color determination unit that determines the illumination color of the viewing environment based on the property keyword;
An image display device comprising: an illumination control unit that controls the illumination device in the viewing environment based on the illumination color.   The video display device according to claim 5, wherein the keyword extraction unit extracts the property keyword by comparing the emotion data with a property keyword table.   The video display device according to claim 5, wherein the illumination color determination unit determines an illumination color of a viewing environment by collating a correlation table between the property keyword, color, and emotion. A color temperature measurement unit for measuring the color temperature of the viewing environment before the illumination color is changed;
An arrival time calculation unit for calculating an arrival time to reach the illumination color after the change, and a division number when the arrival time is divided at a predetermined time interval, the chromaticity value by the color temperature and the chromaticity value of the illumination color And a light color calculation unit that calculates a chromaticity value for each division point,
The video display device according to claim 5, wherein the illumination control unit controls the illumination device such that a chromaticity value for each corresponding division point is obtained every time the predetermined time interval elapses. A lighting control method for a viewing environment in a video display device,
A keyword extraction step of extracting a property keyword based on program information of the broadcast program;
An illumination color determination step for determining an illumination color of the viewing environment based on the property keyword;
And a lighting control step of controlling a lighting device in the viewing environment based on the lighting color. A color temperature measuring step of measuring the color temperature of the viewing environment before changing to the illumination color;
An arrival time calculating step for calculating an arrival time for reaching the illumination color after the change, and a division number when the arrival time is divided at a predetermined time interval, the chromaticity value by the color temperature and the chromaticity value of the illumination color And a light color calculating step for calculating a chromaticity value for each dividing point.
10. The illumination control method according to claim 9, wherein, in the illumination control step, the illumination device is controlled so that a chromaticity value for each corresponding division point is obtained every time the predetermined time interval elapses.

Images