JP2009284276A - Display controller - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a display controller for reflecting a visual environment of a viewer so as to control a luminance of a display. <P>SOLUTION: The display controller 1 includes: a photographed image conversion means 501 for converting a marker added photographed image into a marker added luminance image in which the luminance is given to each pixel based on a previously set function for converting a gradation value to the luminance; a video area luminance image generation means 502 for cutting out a video area from the maker added luminance image based on a position of the marker included in the marker added luminance image so as to generate a video area luminance image; a set luminance calculation means 503 for calculating an average luminance of the video area luminance image so as to calculate a set luminance from the calculated average luminance based on a correspondence relation between the set luminance of the display and the previously set average luminance; and a luminance control means 504 for controlling the luminance of the display. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a display control device that controls the luminance and chromaticity of a display that displays a video in accordance with the viewing environment when the viewer views the video.

Conventionally, an invention for controlling the brightness of a display in accordance with the viewing environment of a viewer is known (see, for example, Patent Document 1). The brightness adjusting apparatus described in Patent Document 1 is provided with sensors for detecting the external light intensity on the front and back of the peripheral part of the liquid crystal display so that the sensor detects the screen illuminance by sunlight and the brightness of the liquid crystal display is optimized. It is something to control.
JP 2007-279179 A

  However, since the brightness adjusting device described in Patent Document 1 faces the viewer from the liquid crystal display, the brightness detected by the sensor and the brightness when viewing the liquid crystal display from the viewer are large. In contrast, there is a problem that the viewing environment of the viewer is not reflected in the brightness of the liquid crystal display.

  An object of the present invention is to provide a display control device that controls the luminance of a display by reflecting the viewing environment of a viewer.

  In order to solve the above-described problem, the display control device according to claim 1 is a display control device that controls luminance of a display that displays a video according to a viewing environment when a viewer views the video. The display unit, the shooting unit, the shot image conversion unit, the video area luminance image generation unit, the set luminance calculation unit, and the luminance control unit are provided.

  In such a configuration, the display control device displays a marker indicating the video area of the display by the marker display means. This marker is a clue to separate the video area of the display from the background. In addition, the display control device captures the marker-added captured image including the image displayed on the display, the marker, and the background from the position where the viewer views the image by the image capturing unit. As described above, the photographing unit photographs the marker-added photographed image at the position where the viewer views the video, that is, in the visual environment substantially equal to the viewer.

  In addition, the display control device converts the marker-added captured image into a marker-added luminance image in which each pixel indicates luminance based on a preset function for converting the gradation value into luminance by the captured image conversion unit. Here, the captured image conversion means converts the marker-added captured image in the RGB color space such as the sRGB color space into the marker-added luminance image in the L * a * b color space through the XYZ color space.

  In addition, the display control apparatus generates a video area luminance image by cutting out the video area from the marker-added luminance image based on the position of the marker included in the marker-added luminance image by the video area luminance image generation unit. Here, the video area luminance image generation means detects the position of the marker included in the marker-added luminance image by the brightest point detection process or the edge detection process.

  In addition, the display control device calculates the average luminance of the video area luminance image by the luminance setting value calculation means, and sets from the calculated average luminance based on a preset correspondence relationship between the setting luminance of the display and the average luminance. Calculate the brightness. And a display control apparatus controls the brightness | luminance of a display based on setting brightness | luminance by a brightness | luminance control means.

  In order to solve the above-described problem, the display control device according to claim 2 is a display control device that controls at least luminance of a display that displays a video according to a viewing environment when a viewer views the video. Marker display means, photographing means, photographed image conversion means, brightness image conversion means, background brightness image generation means, brightness scale range calculation means, brightness range conversion means, and brightness control means, It was set as the structure provided.

  In such a configuration, the display control device displays a marker indicating the video area of the display by the marker display means. This marker is a clue to separate the video area of the display from the background. In addition, the display control device captures the marker-added captured image including the image displayed on the display, the marker, and the background from the position where the viewer views the image by the image capturing unit. As described above, the photographing unit photographs the marker-added photographed image at the position where the viewer views the video, that is, in the visual environment substantially equal to the viewer.

  In addition, the display control device converts the marker-added captured image into a marker-added luminance image in which each pixel indicates luminance based on a preset function for converting the gradation value into luminance by the captured image conversion unit. Here, the captured image conversion means converts the marker-added captured image in the RGB color space such as the sRGB color space into the marker-added luminance image in the L * a * b color space through the XYZ color space.

  In addition, the display control device wavelet transforms the marker-added luminance image into a marker-added brightness image in which each pixel indicates a brightness scale based on a preset weighting coefficient by the brightness image conversion unit. Here, the brightness image converting means generates a plurality of levels of images by wavelet decomposition of the marker-added luminance image. Then, the brightness image conversion means multiplies the image of each level by a weighting coefficient for each level, and generates a marker-added brightness image by wavelet synthesis of the image of each level.

  Further, the display control device generates a background brightness image by cutting out the background from the marker-added brightness image based on the position of the marker included in the marker-added brightness image by the background brightness image generating means. Here, the background brightness image generation means detects the position of the marker included in the marker-added luminance image by the brightest point detection process or the edge detection process.

  Further, the display control device calculates a brightness scale range indicating a range between the minimum value and the maximum value of the brightness scale in the background brightness image by the brightness scale range calculation means. Further, the display control device converts the brightness scale range into a luminance range indicating a range between the minimum value and the maximum value of the luminance based on the weighting coefficient by the luminance range conversion means. Here, the luminance range conversion means divides the brightness scale range by the weighting coefficient and converts it into a luminance range. Then, the display control device controls the luminance of the display by normalizing the luminance range with a predetermined luminance characteristic range of the minimum luminance and the maximum luminance of the display by the luminance control means.

  The display control device according to claim 3 is the display control device according to claim 2, wherein the perceptual color image conversion means, the background perception color image generation means, the color sensation scale range calculation means, and the chromaticity range It comprises conversion means and chromaticity control means.

  In such a configuration, the display control apparatus can control the chromaticity of the display in addition to the luminance of the display.

  In order to solve the above-described problem, the display control device according to claim 4 is a display control device that controls at least luminance of a display that displays a video according to a viewing environment when a viewer views the video. Storage means, marker display means, photographing means, photographed image conversion means, brightness image conversion means, background brightness image generation means, display brightness image conversion means, brightness image composition means, optimum A luminance image conversion unit and a luminance control unit are provided.

  In such a configuration, the display control device stores the video and the display time when the video is displayed by the storage unit. Further, the display control device displays a marker indicating the video area of the display by the marker display means. This marker is a clue to separate the video area of the display from the background.

  In addition, the display control device sequentially captures the marker-added captured image including the image displayed on the display, the marker, and the background from the position where the viewer views the image. As described above, the photographing unit sequentially photographs the marker-added photographed image in the position where the viewer views the video, that is, in the visual environment substantially equal to the viewer.

  Further, the display control device is configured to display a marker-added luminance image in which each pixel indicates luminance based on a preset function for converting the gradation value into luminance of the marker-added captured image sequentially captured by the captured image conversion unit. Convert to Here, the captured image conversion means converts the marker-added captured image in the RGB color space such as the sRGB color space into the marker-added luminance image in the L * a * b color space through the XYZ color space.

  In addition, the display control device wavelet transforms the marker-added luminance image into a marker-added brightness image in which each pixel indicates a brightness scale based on a preset weighting coefficient by the brightness image conversion unit. Here, the brightness image conversion means wavelet decomposes the marker-added luminance image to generate an image for each of a plurality of levels. Then, the brightness image conversion means multiplies the image of each level by a weighting coefficient for each level, and generates a marker-added brightness image by wavelet synthesis of the image of each level.

  Further, the display control device generates a background brightness image by cutting out the background from the marker-added brightness image based on the position of the marker included in the marker-added brightness image by the background brightness image generating means. Here, the background brightness image generation means detects the position of the marker included in the marker-added luminance image by the brightest point detection process or the edge detection process.

  Further, the display control device reads out the frame constituting the moving image at the display time that matches the shooting time from the storage means by the display brightness image conversion means, and converts the frame into a display brightness image based on the weighting coefficient. To do.

  Further, the display control device generates a combined brightness image by combining the display brightness image and the background brightness image by the brightness image combining means. This synthesized brightness image is an integration of the viewer's visual environment (background brightness image) and the video intended by the video producer (display brightness image).

  Further, the display control apparatus performs wavelet inverse transform of the combined brightness image into the optimum brightness image based on the weighting coefficient by the optimum brightness image conversion means. Here, the optimum luminance image converting means generates an image for each of a plurality of levels by performing wavelet decomposition on the combined brightness image. Then, the optimum luminance image converting means divides the image of each level by a weighting coefficient for each level, and generates an optimum luminance image by performing wavelet synthesis on the image of each level.

  In addition, the display control device calculates a luminance range between the minimum luminance and the maximum luminance in the optimum luminance image by the luminance control means, and the luminance range is a predetermined luminance characteristic range between the minimum luminance and the maximum luminance of the display. Normalize and sequentially control the brightness of the display.

  The display control device according to claim 5 is the display control device according to claim 4, wherein the perceptual color image conversion means, the background perception color image generation means, the display perception color image conversion means, and the perception color image. The image processing apparatus includes a combining unit, an optimum chromaticity image converting unit, and a chromaticity control unit.

  In such a configuration, the display control apparatus can sequentially control the chromaticity of the display in addition to the luminance of the display.

  The display control device according to claim 6 is the display control device according to any one of claims 1 to 5, wherein a plurality of marker display means are provided on a frame of the display so as to face the photographing means. And a light emitting element that emits light when the photographing unit photographs a marker-added photographed image.

  In such a configuration, the display control apparatus can accurately separate the video area and the background of the display.

  The display control device according to claim 6 is the display control device according to any one of claims 1 to 5, wherein the marker display means has a predetermined color and is along a frame of the display. A rectangular marker is displayed so as to overlap the video.

  In such a configuration, the display control apparatus can accurately separate the video area and the background of the display.

  The display control device according to claim 8 is the display control device according to any one of claims 1 to 7, wherein the photographing unit photographs a plurality of images having different apertures substantially simultaneously. The image conversion means is characterized in that a plurality of images with different apertures are combined and generated as the marker-added captured image.

  In such a configuration, the display control apparatus can widen the contrast range of the marker-added captured image.

The display control apparatus according to the present invention has the following excellent effects.
According to the first aspect of the present invention, since a marker-added captured image is captured in a viewing environment substantially equal to that of the viewer and the set brightness is calculated using the marker-added captured image, the viewing environment of the viewer is reflected. The brightness of the display can be controlled.
According to the first aspect of the present invention, the brightness of the display can be controlled by a simple calculation, so that the display control device can be made simple.

According to the second aspect of the present invention, the marker-added captured image is captured in a viewing environment substantially equal to the viewer, and the luminance range is calculated using the marker-added captured image, so that the viewer's viewing environment is reflected. The brightness of the display can be controlled.
According to the invention of claim 3, since the chromaticity of the display can be controlled in addition to the luminance of the display, the viewing environment of the viewer can be more reflected in the video displayed on the display.

According to the fourth aspect of the present invention, since the marker-added photographed image is sequentially photographed in the visual environment substantially the same as that of the viewer and the luminance range is calculated using the marker-added photographed image, the display is illuminated by the sunset inserted into the room. Display brightness can be sequentially controlled according to changes in the viewing environment, such as brighter room lighting, etc., so there is no need to reset the display brightness even if the viewing environment changes. There is no annoyance.
Further, according to the invention according to claim 4, since a composite brightness image in which the viewer's visual environment and the video intended by the video producer are integrated is used, in addition to the viewer's visual environment, The brightness of the display can be sequentially controlled in consideration of the content of the image, such as a bright image or a dark image such as a night scene.
According to the fifth aspect of the present invention, since the chromaticity of the display can be sequentially controlled in addition to the luminance of the display, the viewing environment of the viewer can be more reflected in the video displayed on the display.

According to the inventions according to claims 6 and 7, since the video area and the background of the display can be accurately separated, the situation where the erroneous area is cut out and the brightness and chromaticity of the display are erroneously controlled is prevented. And control is more accurate.
According to the invention of claim 8, since the contrast range of the marker-added captured image can be widened, the accuracy of brightness and chromaticity is increased, and the visual environment of the viewer is more enhanced in the video displayed on the display. It can be reflected.

(First embodiment)
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings as appropriate. In each embodiment, means having the same function and the same member are denoted by the same reference numerals, and description thereof is omitted.

[Outline of display control device]
The outline of the display control apparatus will be described with reference to FIG. FIG. 1 is a schematic configuration diagram of a display control apparatus according to first and second embodiments of the present invention. The display control device 1 includes a display 2, a marker display unit 3, a photographing unit 4, and a display control unit 5. In FIG. 1, the viewer is indicated by reference numeral 9, and the background and the TV stand are shown as the background.

  The display 2 displays an image viewed by the viewer 9 and is, for example, a direct view display such as a cathode ray tube display, a liquid crystal display, or a plasma display. Here, the display 2 incorporates display control means 5.

  The marker display means 3 displays a marker indicating the video area of the display 2. Here, four marker display means 3 are arranged at the four corners of the frame of the display 2 so as to face the photographing means 4, and an infrared light emitting element that emits light when the photographing means 4 takes a marker-added photographed image. It is. Two light emitting elements may be arranged on a diagonal line such as the upper right end and the lower left end of the display 2 or the lower right end and the upper left end (not shown).

  Hereinafter, another configuration of the marker display means will be described with reference to FIG. FIG. 2 is an explanatory diagram for explaining another configuration of the marker display means of FIG. As shown in FIG. 2, the display 2 is driven at a drive frequency (for example, f = 120 Hz) or more that does not hinder viewing of the video. Then, the marker display means 3 displays (synthesizes) the marker superimposed on the video, where the video is not displayed instantaneously (Low in FIG. 2) at the drive frequency. Here, the marker display means 3 displays (synthesizes), for example, red and a rectangular marker along the frame of the display 2.

Hereinafter, returning to FIG. 1, the description of the outline of the display control device will be continued.
The photographing means 4 photographs a marker-added photographed image including a video displayed on the display 2, a marker, and a background from a position where the viewer 9 views the video. The photographing unit 4 transmits the photographed marker-added photographed image to the photographed image converting unit of the display control unit 5 by an arbitrary communication method such as infrared communication, wireless communication, or wired communication. The configuration of the display control means 5 will be described later.

  Here, the photographing means 4 has a photographing element 4 a such as a small CCD camera (Charge Coupled Device) built in the remote controller of the display 2. The remote controller also includes a shooting button (not shown) synchronized with the marker display means 3. Then, when the viewer 9 points the photographing element 4a toward the display 2 and presses the photographing button of the remote controller, the marker display unit 3 emits light, and the photographing unit 4 captures the marker-added captured image. As described above, by incorporating the photographing unit 4 in the remote controller, it is possible to photograph the marker-added photographed image in a visual environment substantially equal to that of the viewer 9.

  Hereinafter, with reference to FIG. 3, it will be described that the photographing unit photographs a plurality of images having different apertures. FIG. 3 is an explanatory view for explaining a plurality of images with different apertures taken by the photographing means of FIG. As shown in FIG. 3, the photographing means 4 photographs n images (n is an integer of 1 or more) substantially simultaneously with different apertures (aperture α, aperture β... Aperture γ), and displays these images on a display. The image is transmitted to a photographed image conversion means (not shown) of the control means 5. Then, the captured image conversion means of the display control means 5 combines n images with different apertures into one image as the marker-added captured image.

[Configuration of display control means]
Hereinafter, the configuration of the display control means will be described with reference to FIG. FIG. 4 is a block diagram showing the configuration of the display control means 5 of FIG. The display control means 5 controls the luminance of the display 2 that displays the video according to the viewing environment when the viewer 9 views the video. The display control means 501 and the video area luminance image generation means. 502, a set brightness calculation unit 503, and a brightness control unit 504.

  The captured image conversion unit 501 converts the marker-added captured image captured by the capturing unit 4 into a marker-added luminance image in which each pixel indicates luminance based on a preset function for converting gradation values into luminance. It is. This gradation value is a luminance gradation value for each RGB element of each pixel constituting the marker-added captured image.

  Also, the photographed image conversion unit 501 converts the marker-added photographed image in the RGB color space such as the sRGB color space into the marker-added luminance image in the XYZ color space using Expressions (1) to (3). Here, the marker-added captured image is not limited to the sRGB color space, but may be an RGB color space such as the AdobeRGB color space. Expressions (1) to (3) are defined by Japanese Industrial Standard high-definition color digital standard images (JIS X9204).

  The photographed image conversion unit 501 converts the marker-added luminance image in the XYZ color space into the marker-added luminance image in the L * a * b color space using a predetermined conversion formula.

  The video area luminance image generation unit 502 generates a video area luminance image by cutting out the video area from the marker-added luminance image based on the marker position included in the marker-added luminance image converted by the captured image conversion unit 501. is there.

  Here, when the marker display unit 3 is a light emitting element arranged at the four corners of the frame of the display 2, the video area luminance image generation unit 502 performs the brightest point detection process on the marker-added luminance image. Thus, the four markers located at the four corners of the frame of the display 2 can be detected from the marker-added luminance image. Then, the video area luminance image generation unit 502 generates a video area luminance image by cutting out a rectangular area surrounded by four markers as a video area.

  When the marker display means 3 is two light emitting elements arranged diagonally on the frame of the display 2, the video area luminance image generation means 502 performs the brightest point detection process to detect two markers. Then, a rectangular area having a diagonal line connecting the two markers is cut out as a video area, and a video area luminance image is generated.

  Further, when the marker display unit 3 displays a predetermined color and a rectangular marker along the frame of the display 2, the video area luminance image generation unit 502 performs edge extraction processing with the predetermined color (red). The rectangular area of a predetermined color included in the marker-added luminance image is cut out as a video area to generate a video area luminance image.

  The set luminance calculation unit 503 calculates the average luminance of the video area luminance image generated by the video region luminance image generation unit 502, and calculates the average luminance based on a preset correspondence relationship between the set luminance of the display 2 and the average luminance. The set brightness is calculated from the average brightness. Here, the set luminance calculation means 503 obtains the luminance values of all the pixels constituting the video area luminance image, and calculates the average luminance by averaging the luminance values of all the pixels.

  Hereinafter, with reference to FIG. 5, an example of the correspondence relationship between the set luminance of the display 2 and the average luminance will be described. FIG. 5 is a graph showing the correspondence between the set brightness of the display and the average brightness. In FIG. 5, the vertical axis represents the set luminance, and the horizontal axis represents the average luminance. Note that the graph shown in FIG. 5 is an example in which this correspondence is obtained by a provisional function indicating the relationship between the luminance of the display 2 and the luminance of the background, and the correspondence between the set luminance of the display 2 and the average luminance. The relationship is not limited to the graph shown in FIG.

Hereinafter, returning to FIG. 4, the description of the configuration of the display control means will be continued.
The brightness control unit 504 controls the brightness of the display 2 based on the set brightness calculated by the set brightness calculation unit 503. Here, the luminance control unit 504 outputs a luminance setting signal to the display 2. The display 2 changes the brightness based on the brightness setting signal input from the brightness control means 504.

  The display control device 1 stores storage means such as a hard disk drive (HDD) in order to store a function for converting the above-described gradation value into luminance, a correspondence relationship between set luminance and average luminance of the display 2, and other parameters. May be provided (not shown).

  Moreover, the display control means 5 can be comprised by CPU (Central Processing Unit), ROM (Read Only Memory), and RAM (Random Access Memory), for example.

[Operation of display control means]
Hereinafter, the operation of the display control means will be described with reference to FIG. 6 (see FIG. 4 as appropriate). FIG. 6 is a flowchart showing the operation of the display control means of FIG. Here, it is assumed that the imaging unit 4 has captured a marker-added captured image and transmits it to the captured image conversion unit 501.

  The display control unit 5 converts the marker-added captured image into a marker-added luminance image in which each pixel indicates luminance based on a preset function for converting the gradation value into luminance by the captured image conversion unit 501 ( Step S1). Further, the display control means 5 generates a video area luminance image by cutting out the video area from the marker added luminance image based on the marker position included in the marker added luminance image by the video area luminance image generating means 502 (step S2).

  Subsequent to step S2, the display control means 5 calculates the average brightness of the video area brightness image by the set brightness calculation means 503, and based on the preset correspondence between the set brightness and the average brightness of the display 2, The set brightness is calculated from the calculated average brightness (step S3). Further, the display control means 5 controls the brightness of the display 2 based on the set brightness by the brightness control means 504 (step S4).

  As described above, the display control device 1 can control the luminance of the display 2 by reflecting the viewer's visual environment with a simple configuration.

(Second Embodiment)
[Outline of display control device]
Hereinafter, a display control apparatus according to a second embodiment of the present invention will be described with reference to FIG. In the display control apparatus 1B, the display 2, the marker display means 3, and the photographing means 4 are the same as the display control apparatus 1. On the other hand, the display control means 5B is different from the display control means 5 and will be described in detail.

[Configuration of display control means]
Hereinafter, the configuration of the display control means will be described with reference to FIG. FIG. 7 is a block diagram showing the configuration of the display control means 5B of FIG.

  As shown in FIG. 7, the display control means 5B includes a captured image conversion means 501B, a brightness image conversion means 511, a background brightness image generation means 512, a brightness scale range calculation means 513, and a brightness range conversion means. 514, luminance control means 504B, perceptual color image conversion means 515, background perception color image generation means 516, color sensation scale range calculation means 517, chromaticity range conversion means 518, chromaticity control means 519, Is provided.

  The captured image conversion unit 501B converts the marker-added captured image into a marker-added luminance image, similar to the captured image conversion unit 501 in FIG. Further, the photographed image conversion unit 501B is configured to perform marker-added chromaticity in which each pixel indicates chromaticity based on a preset function for converting the gradation value into chromaticity of the marker-added photographed image photographed by the photographing unit 4. Convert to image. Here, the photographed image converting means 501B converts the marker-added chromaticity image in the XYZ color space using the above formulas (1) to (3), and then adds the marker in the L * a * b color space. Convert to chromaticity image.

  The brightness image conversion means 511 wavelet transforms the marker-added luminance image converted by the captured image conversion means 501B into a marker-added brightness image in which each pixel indicates a brightness scale based on a preset weighting coefficient. It is. Details of the brightness scale, the weighting coefficient, and the wavelet transform will be described later.

  The background brightness image generation unit 512 generates a background brightness image by cutting out the background from the marker addition brightness image based on the marker position included in the marker addition brightness image wavelet transformed by the brightness image conversion unit 511. To do. Here, the background brightness image generation means 512 detects a marker by the same method as the video area luminance image generation means 502 of FIG. 4, and generates a background brightness image.

  The brightness scale range calculation unit 513 calculates a brightness scale range indicating a range between the minimum value and the maximum value of the brightness scale in the background brightness image generated by the background brightness image generation unit 512. Here, the brightness scale range calculation means 513 obtains a pixel having the maximum brightness scale value and a pixel having the minimum brightness scale value from the pixels constituting the background brightness image, and the brightness of both pixels is determined. The brightness scale range is calculated by subtracting the scale value.

  The brightness range conversion unit 514 converts the brightness scale range calculated by the brightness scale range calculation unit 513 into a brightness range indicating a range between the minimum value and the maximum value based on the weighting coefficient. Here, the luminance range conversion means 513 divides the brightness scale range by the weighting coefficient and converts it into a luminance range.

  The luminance control unit 504B controls the luminance of the display 2 by normalizing the luminance range converted by the luminance range converting unit 514 with a predetermined luminance characteristic range of the minimum luminance and the maximum luminance of the display 2. . Here, the luminance control means 504B outputs the normalized luminance range signal to the display 2. The display 2 changes the luminance based on the luminance range signal input from the luminance control unit 504B.

  The perceptual color image conversion unit 515 performs wavelet transform on the marker-added chromaticity image converted by the captured image conversion unit 501B into a marker-added perceptual color image in which each pixel indicates a color sensation scale based on the weighting coefficient. Details of the color sensation scale will be described later.

  The background perceptual color image generation unit 516 generates a background perception color image by cutting out the background from the marker addition perception color image based on the marker position included in the marker addition perception color image wavelet transformed by the perception color image conversion unit 515. To do. Here, the background perceived color image generation means 516 detects a marker by the same method as the video area luminance image generation means 502 of FIG. 4, and generates a background perceived color image.

The color sensation scale range calculation unit 517 calculates a color sensation scale range indicating a range between the minimum value and the maximum value of the color sensation scale in the background perception color image generated by the background perception color image generation unit 516. Here, the color sensation scale range calculation means 517 obtains the pixel having the maximum color sensation scale value and the pixel having the minimum color sensation scale value from among the pixels constituting the background perceived color image, and calculates both pixels. A color scale scale range is calculated by subtracting the color scale scale value.
Here, as described above, since the L * a * b color space is used, the color sensation scale range calculation means 517 has a color sensation scale range of red-green (RG value), blue- A yellow (BY value) color sensation scale range is calculated.

  The chromaticity range conversion means 518 converts the chromaticity scale range calculated by the chromaticity scale range calculation means 517 into a chromaticity range indicating the range between the minimum value and the maximum value of chromaticity based on the weighting coefficient. It is. Here, the chromaticity range conversion means 518 divides the color sensation scale range by the weighting coefficient and converts it to the chromaticity range.

The chromaticity control unit 519 normalizes the chromaticity range converted by the chromaticity range conversion unit 518 with a preset chromaticity characteristic range of the minimum chromaticity and the maximum chromaticity of the display 2, and the color of the display 2 The degree is controlled. Here, the chromaticity control means 519 outputs the normalized chromaticity range signal to the display 2. The display 2 changes the chromaticity based on the chromaticity range signal input from the chromaticity control means 519.
Here, as described above, since the L * a * b color space is used, the chromaticity control means 519 has a color feeling of red-green (RG value) and blue-yellow (B- (Y value) color sense is controlled.

Note that the luminance characteristic range and the chromaticity characteristic range indicate the actual luminance and chromaticity characteristics of the display 2, and normalization refers to conversion so that the luminance range falls within the luminance characteristic range, chromaticity The conversion is performed so that the range falls within the chromaticity characteristic range.
Further, the display control device 1B may include a storage unit that stores in advance the luminance characteristic range and the chromaticity characteristic range.

[Details of brightness scale, color scale and weighting coefficient]
Hereinafter, details of the brightness scale, the color scale, and the weighting coefficient will be described with reference to FIGS. 8 to 10 (see FIG. 7 as appropriate). FIG. 8 is an explanatory diagram for explaining the brightness scale in the present invention. FIGS. 9A and 9B are explanatory diagrams for explaining a color sensation scale according to the present invention, in which FIG. 9A shows perceptual saturation and FIG. 9B shows an opposite color type hue circle. FIG. 10 is a schematic diagram of a rating device that allows a subject to rate a brightness scale and a color scale in the present invention.

  As shown in FIG. 8, the brightness scale is a scale when the subject is evaluated for brightness, and the brightness is represented by a numerical value of 13. Here, considering the situation where the line of sight is directed to one pixel constituting the luminance image, the adaptation state of the viewer's eyes is expressed by comparing the pixel with the background. The brightness perceived by looking at each pixel constituting the luminance image is obtained from the luminance of the pixel after comparing the brightness having a plurality of spatial sizes. When such calculation is performed for all the pixels of the luminance image, a brightness image in which each pixel indicates a brightness scale is obtained.

  Further, as shown in FIG. 9, the color sensation scale is a scale used when the subject evaluates the perceived color, and is expressed by Expressions (4) to (6). Considering the results of previous color perception research, the color sense of red-green (RG value) and blue-yellow (BY value), which are opposite color scales, as in the L * a * b color space It should be a scale. The unique color is a color in which no change is recognized in the perceived color even when the visual environment is changed.

Unique color component = ratio of unique colors × perceptual color saturation degree (4)
RG value: Value when the unique color component of red is positive and the unique color component of green is negative. Equation (5)
BY value: Value when the unique color component of yellow is positive and the unique color component of blue is negative. Equation (6)

  Further, the evaluation of the brightness scale is performed using a rating device shown in FIG. As shown in FIG. 10, the rating device 10 is attached to a milky white panel 11 covering a field of view of 180 °, a black paper tube 12 attached from the center of the panel 11 to the outside, and a tip of the tube 12. The obtained white-white fluorescent lamp 13, a large number of fluorescent lamps 14 provided on the entire outside of the panel 11, and a film 15 attached to the other end (panel 11 side) of the tube 12.

  Then, the brightness of the evaluation target is adjusted by the light quantity of the fluorescent lamp 13, the brightness of the proximity area is adjusted by the transmittance of the film 15, the brightness of the peripheral area is adjusted by the light quantity of the fluorescent lamp 14, and the size of the proximity area is It is adjusted by the diameter of the cylinder 12. Note that the evaluation of the brightness scale using the rating device 10 is performed in a room shielded from light by a dark curtain.

  In addition, the evaluation of the brightness scale using the rating device 10 is performed from the numerical value (1 to 13) of the brightness scale of FIG. 8 as the brightness feeling of the presented evaluation object according to each sense. To select one. Then, the weighting coefficient for each level is calculated by performing multiple regression analysis on the evaluation result of the brightness scale by all subjects, and stored in the storage means in advance. Note that the evaluation of the color scale can also be performed using the evaluation apparatus of FIG. 10 in the same manner as the evaluation of the brightness scale.

  This level indicates the level of wavelet decomposition. Specifically, the wavelet decomposition performed once is defined as -1 level, the wavelet decomposition performed twice, -2 level, and the wavelet decomposition performed n times as -n level. Further, the -1 level change image is an image obtained by extracting a fine change, and an image obtained by extracting a coarse change is obtained as the level is lowered. Furthermore, the weighting coefficient for each level indicates a coefficient given for each roughness of the change.

[Details of wavelet transform]
Details of the wavelet transform will be described below with reference to FIGS. FIG. 11 is an explanatory diagram for explaining wavelet transform in the present invention. FIG. 12 is an explanatory diagram for explaining bidirectional conversion between a luminance image and a brightness image in the present invention.

  First, as shown in FIG. 11, the captured image conversion unit 501B adds a marker-added captured image (captured image) in an RGB color space such as an sRGB color space, a marker-added brightness image (luminance image), and two markers. It converts into a chromaticity image (chromaticity image (a image)) and a marker addition chromaticity image (chromaticity image (b image)). The marker-added luminance image (luminance image) is L (luminance) in the L * a * b color space, and the marker-added chromaticity image (chromaticity image (a image)) is a in the L * a * b color space. (Chromaticity) and a marker-added chromaticity image (chromaticity image (b image)) correspond to b (chromaticity) in the L * a * b color space.

  Next, the brightness image conversion unit 511 generates a plurality of levels of images by wavelet decomposition of the marker-added luminance image converted by the captured image conversion unit 501B. Then, as shown in FIG. 12, the brightness image conversion means 511 performs wavelet decomposition a plurality of times (for example, 11 times), multiplies the image of each level by the weighting coefficient (coefficient) for each level described above, The image of each level is wavelet synthesized to generate a marker added brightness image (brightness image). That is, the wavelet transform is to perform wavelet decomposition, then multiply by a weighting coefficient (coefficient) for each level, and wavelet synthesize the image of each level.

  The perceptual color image conversion means 515 converts the two marker-added chromaticity images (chromaticity image (a image)) and the marker-added chromaticity image (chromaticity image (b image)) into a brightness image conversion means. Similarly to 511, wavelet decomposition and wavelet synthesis are performed to generate two marker-added perceptual color images (perceptual color image (RG)) and marker-added perceptual color images (perceptual color image (YB)).

[Operation of display control means]
Hereinafter, the operation of the display control means will be described with reference to FIG. 13 (see FIG. 7 as appropriate). FIG. 13 is a flowchart showing the operation of the display control means of FIG. Here, it is assumed that the imaging unit 4 has captured a marker-added captured image and transmits it to the captured image conversion unit 501B.

  The display control means 5B uses the captured image conversion means 501B to convert the marker-added captured image into a marker-added luminance image based on a preset function for converting the gradation value into luminance, and convert the gradation value into chromaticity. Based on a preset function to convert to (2), the image is converted into a marker added chromaticity image (step S11).

  Subsequent to step S11, the display control means 5B uses the brightness image conversion means 511 to wavelet transform the marker-added luminance image into a marker-added brightness image based on a preset weighting coefficient, and perceptual color image conversion. The means 515 wavelet transforms the marker-added chromaticity image into a marker-added perceptual color image based on the weighting coefficient (step S12).

  Subsequent to step S12, the display control unit 5B causes the background brightness image generation unit 512 to cut out the background from the marker-added brightness image based on the position of the marker included in the marker-added brightness image. The background perceived color image generation means 516 cuts out the background from the marker-added perceptual color image based on the position of the marker included in the marker-added perceptual color image and generates a background perceived color image (step S13).

  Subsequent to step S13, the display control means 5B calculates the brightness scale range in the background brightness image by the brightness scale range calculation means 513, and in the background perceived color image by the color sense scale range calculation means 517. A color sensation scale range is calculated (step S14). Further, the display control means 5B converts the brightness scale range into the brightness range based on the weighting coefficient by the brightness range conversion means 514, and converts the color scale scale range into the weighting coefficient by the chromaticity range conversion means 518. Based on this, the chromaticity range is converted (step S15).

  Subsequent to step S15, the display control unit 5B determines whether or not the luminance of the display 2 needs to be controlled by the luminance control unit 501B, and controls the chromaticity of the display 2 by the chromaticity control unit 519. It is determined whether or not it is necessary (step S16).

  When it is determined that the luminance of the display 2 needs to be controlled (Yes in step S16), the display control unit 5B uses the luminance control unit 501B to set the luminance range to the luminance characteristic range between the minimum luminance and the maximum luminance of the display 2. Is normalized to control the brightness of the display 2. If it is determined that the chromaticity of the display 2 needs to be controlled, the display control means 5B causes the chromaticity control means 519 to change the chromaticity range between the minimum chromaticity and the maximum chromaticity of the display 2. The chromaticity of the display 2 is controlled by normalizing with the characteristic range (step S17).

  On the other hand, when it is determined that it is not necessary to control the luminance of the display 2 (Yes in step S16), the display control unit 5B ends the process without controlling the luminance of the display 2. If it is determined that it is not necessary to control the chromaticity of the display 2, the process ends without controlling the chromaticity of the display 2.

As described above, the display control device 1B can control the luminance and chromaticity of the display 2 by reflecting the viewing environment of the viewer.
In the second embodiment, the example in which the brightness and chromaticity of the display 2 are controlled has been described. However, the display control apparatus 1B may control only the brightness of the display 2. In this case, the display control unit 5B of FIG. 7 includes a captured image conversion unit 501B, a brightness image conversion unit 511, a background brightness image generation unit 512, a brightness scale range calculation unit 513, and a luminance range conversion unit 514. And a luminance control means 504B.

(Third embodiment)
[Outline of display control device]
Hereinafter, with reference to FIG. 14, the outline of the display control apparatus according to the third embodiment of the present invention will be described. FIG. 14 is a schematic configuration diagram of a display control apparatus according to the third embodiment of the present invention.

In the display control apparatus 1C, the display 2 and the marker display means 3 are the same as those in FIG.
The image capturing unit 4C sequentially captures the marker-added captured image including the image displayed on the display 2, the marker, and the background from the position where the viewer 9 views the image. That is, unlike the imaging unit 4 in FIG. 1, the imaging unit 4C in FIG. 14 performs imaging in real time. Here, the photographing means 4C is a camera in which a small CCD camera mounted on a tripod is arranged at a position where the viewer 9 views a video.

  The storage means 6 stores the video displayed on the display 2 and the display time when the video is displayed. Here, the storage means 6 is built in the display 2. Further, the storage unit 6 may store a function and a weighting coefficient for converting the above-described gradation value into luminance and chromaticity.

  Hereinafter, with reference to FIG. 15, the structure of the display control means in 3rd Embodiment of this invention is demonstrated. FIG. 15 is a block diagram showing the configuration of the display control means of FIG.

[Configuration of display control means]
As shown in FIG. 15, the display control means 5C includes a captured image conversion means 501B, a brightness image conversion means 511, a background brightness image generation means 512, a display brightness image conversion means 521, and a brightness image composition. Means 522, optimum luminance image conversion means 523, luminance control means 524, perceptual color image conversion means 515, background perception color image generation means 516, display perception color image conversion means 525, and perception color image synthesis means 526 And an optimum chromaticity image conversion means 527 and a chromaticity control means 528.

  The captured image conversion means 50B, brightness image conversion means 511, background brightness image generation means 512, perceptual color image conversion means 515, and background perception color image generation means 516 in FIG. 15 are the same as those in FIG. .

  The display brightness image converting means 521 reads from the storage means 6 a frame constituting a moving image at a display time that coincides with the photographing time when the photographing means 4C photographed the marker-added photographed image, and displays the frame based on the weighting coefficient. Wavelet transform to brightness image. Here, the display brightness image conversion means 521 performs wavelet conversion by the same method as that shown in FIGS.

  The brightness image composition unit 522 synthesizes the display brightness image converted by the display brightness image conversion unit 521 and the background brightness image generated by the background brightness image generation unit 512 to generate a composite brightness image. Is. That is, the brightness image composition unit 522 synthesizes the viewing environment (background brightness image) of the viewer and the video (display brightness image) intended by the video producer.

  The optimum luminance image conversion unit 523 performs inverse wavelet transform of the combined brightness image generated by the brightness image synthesis unit 522 into an optimum luminance image based on the weighting coefficient. Details of the inverse wavelet transform will be described later.

  The luminance control unit 524 calculates a luminance range between the minimum luminance and the maximum luminance in the optimal luminance image obtained by inverse wavelet conversion by the optimal luminance image conversion unit 523, and sets the luminance range in advance between the minimum luminance and the maximum luminance of the display 2. The luminance of the display 2 is sequentially controlled by normalizing the luminance characteristic range. Here, the luminance control means 524 calculates the luminance range by performing the brightest point detection process and the darkest point detection process, and outputs the normalized luminance range signal to the display 2. The display 2 changes the luminance based on the luminance range signal input from the luminance control means 524.

  The display perceptual color image conversion means 525 reads from the storage means 6 a frame that constitutes a moving image at a display time that coincides with the photographing time when the photographing means 4C photographed the marker-added photographing image, and displays the frame based on the weighting coefficient. Wavelet transform to perceptual color image. Here, the display perceptual color image conversion means 525 performs wavelet conversion by the same method as that shown in FIGS.

  The perceptual color image synthesizing unit 526 synthesizes the display perceived color image wavelet transformed by the display perceptual color image converting unit 525 and the background perceived color image generated by the background perceived color image generating unit 516 to generate a synthesized perceptual color image To do. That is, the perceptual color image synthesizing unit 526 synthesizes the viewer's viewing environment (background perceptual color image) and the video intended by the video producer (display perceptual color image).

  The optimum chromaticity image conversion unit 527 performs wavelet inverse transformation of the combined perceptual color image generated by the perceptual color image synthesis unit 526 into an optimal chromaticity image based on the weighting coefficient.

  The chromaticity control unit 528 calculates a chromaticity range between the minimum chromaticity and the maximum chromaticity in the optimal chromaticity image obtained by inverse wavelet conversion by the optimal chromaticity image conversion unit 527, and sets the chromaticity range as the minimum color of the display 2. The chromaticity of the display 2 is sequentially controlled by normalizing within a preset chromaticity characteristic range of the degree and the maximum chromaticity. Here, the chromaticity control means 528 outputs the normalized chromaticity range signal to the display 2. Then, the display 2 changes the luminance based on the luminance range signal input from the chromaticity control means 528.

[Details of inverse wavelet transform]
Hereinafter, the details of the wavelet transform will be described with reference to FIGS. FIG. 16 is an explanatory diagram for explaining the details of the wavelet inverse transform in the present invention.

  As shown in FIG. 16, the wavelet inverse transformation may be performed in the opposite process to the wavelet transformation. Specifically, the optimum luminance image conversion means 523 generates a plurality of levels of images by wavelet decomposition of the combined brightness image (brightness image). Then, as shown in FIG. 12, the optimum luminance image converting means 523 divides the image of each level by the weighting coefficient (coefficient) for each level, and wavelet synthesizes the image of each level to obtain the optimum luminance image ( Brightness image). In other words, the wavelet inverse transform is wavelet decomposition, and thereafter, a weighting coefficient (coefficient) for each level is divided to synthesize the image of each level with wavelet.

  Further, the optimum chromaticity image conversion means 527 performs the wavelet decomposition and the two combined perceptual color images (perception color image (RG) and perception color image (YB)) as in the optimum luminance image conversion means 523. Wavelet synthesis is performed to generate two optimal chromaticity images (chromaticity image (a image)) and optimal chromaticity image (chromaticity image (b image)). In this case, the chromaticity control means 528 performs control of red-green (a axis) using the optimal chromaticity image (chromaticity image (a image)), and the optimal chromaticity image (chromaticity image (b image). )) Is used to control yellow-blue (b-axis).

[Operation of display control means]
Hereinafter, the operation of the display control means will be described with reference to FIG. 17 (see FIG. 15 as appropriate). FIG. 17 is a flowchart showing the operation of the display control means of FIG. Here, it is assumed that the imaging unit 4C sequentially captures the marker-added captured image and sequentially transmits it to the captured image conversion unit 501B.

  The display control means 5C uses the captured image conversion means 501B to convert the marker-added captured image into a marker-added luminance image based on a preset function for converting the gradation value into luminance, and convert the gradation value into chromaticity. Based on a preset function to convert to (2), the image is converted into a marker-added chromaticity image (step S101).

  Subsequent to step S101, the display control unit 5C uses the brightness image conversion unit 511 to wavelet transform the marker-added luminance image into a marker-added brightness image based on a preset weighting coefficient, and perform perceptual color image conversion. The means 515 wavelet transforms the marker-added chromaticity image into a marker-added perceptual color image based on the weighting coefficient (step S102).

  Subsequent to step S102, the display control unit 5C uses the background brightness image generation unit 512 to cut out the background from the marker-added brightness image based on the position of the marker included in the marker-added brightness image. The background perceptual color image generation means 516 cuts out the background from the marker-added perceptual color image based on the position of the marker included in the marker-added perceptual color image and generates a background perceptual color image (step S103).

Subsequent to step S103, the display control means 5C causes the display brightness image conversion means 521 to read out the frame constituting the moving image at the display time that matches the shooting time from the storage means 6, and the frame is based on the weighting coefficient. Wavelet transform to display brightness image.
Also, the display control means 5C causes the display perceptual color image conversion means 525 to read out the frame constituting the moving image at the display time that coincides with the photographing time from the storage means 6, and the display perceptual color image based on the weighting coefficient. Is subjected to wavelet transform (step S104).

  Subsequent to step S104, the display control unit 5C generates a combined brightness image by combining the display brightness image and the background brightness image by the brightness image combining unit 522, and the perceptual color image combining unit 526 The display perceived color image and the background perceived color image are synthesized to generate a synthesized perceived color image (step S105).

  Subsequent to step S105, the display control unit 5C performs wavelet inverse transform of the combined brightness image into the optimum luminance image based on the weighting coefficient by the optimum luminance image conversion unit 523, and the optimum chromaticity image conversion unit 527 performs The composite perceptual color image is inversely wavelet transformed into an optimal chromaticity image based on the weighting coefficient (step S106).

  Subsequent to step S106, the display control unit 5C determines whether or not the luminance of the display 2 needs to be controlled by the luminance control unit 524, and controls the chromaticity of the display 2 by the chromaticity control unit 529. It is determined whether or not it is necessary (step S107).

When it is determined that the luminance of the display 2 needs to be controlled (Yes in step S107), the display control unit 5C calculates the luminance range between the minimum luminance and the maximum luminance in the optimum luminance image by the luminance control unit 524. The brightness range is normalized with a preset brightness characteristic range of the minimum brightness and the maximum brightness of the display 2, and the brightness of the display 2 is sequentially controlled.
If it is determined that the chromaticity of the display 2 needs to be controlled, the display control means 5C causes the chromaticity control means 529 to set the chromaticity range between the minimum chromaticity and the maximum chromaticity in the optimum chromaticity image. The chromaticity range is calculated and normalized with a preset chromaticity characteristic range of the minimum chromaticity and the maximum chromaticity of the display 2, and the chromaticity of the display 2 is sequentially controlled (step S108).

  On the other hand, when it is determined that it is not necessary to control the luminance of the display 2 (Yes in step S107), the display control unit 5C ends the process without controlling the luminance of the display 2. If it is determined that it is not necessary to control the chromaticity of the display 2, the process ends without controlling the chromaticity of the display 2.

Here, the video producer uses the master monitor to produce the video in a visual environment where he / she wants to watch the video. That is, it can be said that the video displayed on the master monitor is optimal in the visual environment when the video producer produces the video. However, the viewing environment of the viewer is different from the viewing environment of the video producer, and the characteristics of the viewer's display 2 are also different from the characteristics of the master monitor of the video producer. It was difficult to let them watch.
On the other hand, since the display control device 1C sequentially controls the luminance and chromaticity of the display 2 in consideration of the content of the video displayed on the display 2 in addition to the viewing environment of the viewer, the video producer intends. It is possible to allow the viewer to view a video close to the video.

  In the third embodiment, the example in which the luminance and chromaticity of the display 2 are controlled has been described. However, the display control device 1C may control only the luminance of the display 2. In this case, the display control means 5C in FIG. 15 includes a captured image conversion means 501B, a brightness image conversion means 511, a background brightness image generation means 512, a display brightness image conversion means 521, and a brightness image composition means. 522, optimum luminance image conversion means 523, and luminance control means 524.

  In each embodiment of the present invention, the video viewed by the viewer 9, that is, the video displayed on the display 2 has been described as the video of the received television broadcast wave, but this video is not particularly limited. For example, the display control apparatus according to each embodiment of the present invention requires strict color reproduction with respect to a real image such as a recorded image such as a DVD, a color calibration image of a printed matter, or a remote medical image. It can also be used for video.

It is a schematic block diagram of the display control apparatus which concerns on 1st and 2nd embodiment of this invention. It is explanatory drawing explaining another structure of the marker display means of FIG. It is explanatory drawing explaining the some image by which the aperture_diaphragm | restriction imaged with the imaging | photography means of FIG. It is a block diagram which shows the structure of the display control means 5 of FIG. It is a graph which shows the correspondence of the set brightness | luminance of a display, and an average brightness | luminance. It is a flowchart which shows operation | movement of the display control means of FIG. It is a block diagram which shows the structure of the display control means 5B of FIG. It is explanatory drawing explaining the brightness scale in this invention. It is explanatory drawing explaining the color sense scale in this invention, (a) shows perceptual saturation, (b) shows an opposite color type | mold hue ring. It is the schematic of the rating apparatus which makes a test subject evaluate the brightness scale and color sense scale in this invention. It is explanatory drawing explaining the wavelet transformation in this invention. It is explanatory drawing explaining the bidirectional | two-way conversion of the luminance image and the brightness image in this invention. It is a flowchart which shows operation | movement of the display control means of FIG. It is a schematic block diagram of the display control apparatus which concerns on 3rd Embodiment of this invention. It is a block diagram which shows the structure of the display control means of FIG. It is explanatory drawing explaining the detail of wavelet inverse transformation in this invention. It is a flowchart which shows operation | movement of the display control means of FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Display control apparatus 1B Display control apparatus 1C Display control apparatus 2 Display 3 Marker display means 4, 4c Shooting means 5 Display control means 5B Display control means 5C Display control means 501 Captured image conversion means 501B Captured image conversion means 502 Image area brightness | luminance image Generation means 503 Setting brightness calculation means 504 Brightness control means 504B Brightness control means 511 Brightness image conversion means 512 Background brightness image generation means 513 Brightness scale range calculation means 514 Brightness range conversion means 515 Perception color image conversion means 516 Background perception color Image generation means 517 Chromaticity scale range calculation means 518 Chromaticity range conversion means 519 Chromaticity control means 521 Display brightness image conversion means 522 Brightness image composition means 523 Optimal luminance image conversion means 5 4 luminance control unit 525 displays perceived color image converting unit 526 perceived color image synthesizing means 527 optimal chromaticity image converting unit 528 chromaticity control means 9 viewers

Claims (8)

In a display control device that controls the luminance of a display that displays the video according to the viewing environment when the viewer views the video,
Marker display means for displaying a marker indicating a video area of the display;
Image capturing means for capturing a marker-added captured image including an image displayed on the display, the marker, and a background from a position where the viewer views the image;
A captured image conversion means for converting the marker-added captured image into a marker-added luminance image in which each pixel indicates luminance based on a preset function for converting a gradation value into luminance;
Video area luminance image generation means for generating a video area luminance image by cutting out the video area from the marker additional luminance image based on the position of the marker included in the marker additional luminance image;
A set brightness calculating means for calculating an average brightness of the video area brightness image and calculating a set brightness from the calculated average brightness based on a preset correspondence between the set brightness of the display and the average brightness;
Brightness control means for controlling the brightness of the display based on the set brightness;
A display control apparatus comprising: In a display control device that controls at least the luminance of a display that displays the video according to the viewing environment when the viewer views the video,
Marker display means for displaying a marker indicating a video area of the display;
Image capturing means for capturing a marker-added captured image including an image displayed on the display, the marker, and a background from a position where the viewer views the image;
A captured image conversion means for converting the marker-added captured image into a marker-added luminance image in which each pixel indicates luminance based on a preset function for converting a gradation value into luminance;
Brightness image conversion means for wavelet transforming the marker-added luminance image into a marker-added brightness image in which each pixel indicates a brightness scale based on a preset weighting coefficient;
A background brightness image generating means for generating a background brightness image by cutting out a background from the marker added brightness image based on the position of the marker included in the marker added brightness image;
A brightness scale range calculating means for calculating a brightness scale range indicating a range between a minimum value and a maximum value of the brightness scale in the background brightness image;
A brightness range conversion means for converting the brightness scale range into a brightness range indicating a range between a minimum value and a maximum value of brightness based on the weighting coefficient;
Normalizing the luminance range with a predetermined luminance characteristic range of a minimum luminance and a maximum luminance of the display, and a luminance control means for controlling the luminance of the display;
A display control apparatus comprising: The captured image conversion means converts the marker-added captured image into a marker-added chromaticity image in which each pixel indicates chromaticity based on a preset function for converting a gradation value into chromaticity,
Perceptual color image conversion means for wavelet transforming the marker-added chromaticity image into a marker-added perceptual color image in which each pixel indicates a color scale, based on the weighting coefficient;
A background perceived color image generating means for generating a background perceived color image by cutting out the background from the marker added perceived color image based on the position of the marker included in the marker added perceived color image;
A color sensation scale range calculating means for calculating a color sensation scale range indicating a range between a minimum value and a maximum value of the color sensation scale in the background perceived color image;
A chromaticity range conversion means for converting the chromaticity scale range into a chromaticity range indicating a range between a minimum value and a maximum value of chromaticity based on the weighting coefficient;
Chromaticity control means for normalizing the chromaticity range with a preset chromaticity characteristic range of a minimum chromaticity and a maximum chromaticity of the display to control the chromaticity of the display;
The display control apparatus according to claim 2, further comprising: In a display control device that controls at least the luminance of a display that displays the video according to the viewing environment when the viewer views the video,
Storage means for storing the video and a display time when the video is displayed;
Marker display means for displaying a marker indicating a video area of the display;
Image capturing means for sequentially capturing a marker-added captured image including the image displayed on the display, the marker, and a background from a position where the viewer views the image;
A captured image conversion means for converting the marker-added captured image captured sequentially, into a marker-added luminance image in which each pixel indicates luminance based on a preset function for converting a gradation value into luminance;
Brightness image conversion means for wavelet transforming the marker-added luminance image into a marker-added brightness image in which each pixel indicates a brightness scale based on a preset weighting coefficient;
A background brightness image generating means for generating a background brightness image by cutting out a background from the marker added brightness image based on the position of the marker included in the marker added brightness image;
A display brightness image converting means for reading out a frame constituting the moving image at the display time corresponding to the shooting time from the storage means, and wavelet transforming the frame into a display brightness image based on the weighting coefficient;
A brightness image combining means for combining the display brightness image and the background brightness image to generate a combined brightness image;
An optimal luminance image converting means for inversely transforming the composite brightness image into an optimal luminance image based on the weighting coefficient;
In the optimum luminance image, a luminance range between the minimum luminance and the maximum luminance is calculated, the luminance range is normalized with a predetermined luminance characteristic range of the minimum luminance and the maximum luminance of the display, and the luminance of the display is calculated. Brightness control means for sequentially controlling;
A display control apparatus comprising: The captured image conversion means converts the marker-added captured image into a marker-added chromaticity image in which each pixel indicates chromaticity based on a preset function for converting a gradation value into chromaticity,
Perceptual color image conversion means for wavelet transforming the marker-added chromaticity image into a marker-added perceptual color image in which each pixel indicates a color scale, based on the weighting coefficient;
A background perceived color image generating means for generating a background perceived color image by cutting out the background from the marker added perceived color image based on the position of the marker included in the marker added perceived color image;
A display perceptual color image converting means for reading out a frame constituting the moving image at the display time corresponding to the photographing time from the storage means, and wavelet transforming the frame into a display perceptual color image based on the weighting coefficient;
A perceptual color image synthesizing unit that synthesizes the display perceived color image and the background perceived color image to generate a synthesized perceived color image;
An optimal chromaticity image converting means for inversely transforming the composite perceptual color image into an optimal chromaticity image based on the weighting coefficient;
In the optimum chromaticity image, a chromaticity range between the minimum chromaticity and the maximum chromaticity is calculated, and the chromaticity range is normalized with a preset chromaticity characteristic range between the minimum chromaticity and the maximum chromaticity of the display. Chromaticity control means for sequentially controlling the chromaticity of the display,
The display control apparatus according to claim 4, further comprising:   A plurality of the marker display means are arranged on the display frame so as to face the imaging means, and are light emitting elements that emit light when the imaging means captures the marker-added captured image. The display control apparatus according to any one of claims 1 to 5.   6. The marker display unit according to claim 1, wherein the marker display unit displays the marker having a predetermined color and a rectangular shape along a frame of the display so as to overlap the image. The display control apparatus according to 1. The photographing means photographs a plurality of images with different apertures substantially simultaneously,
The display control device according to claim 1, wherein the captured image conversion unit generates a plurality of images with different apertures as the marker-added captured image. .