JP2015176055A - Display device, control method of display device, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technology capable of suppressing a visual change in an input image while inhibiting degradation in discernment of a graphic image in a case where light emission of a light source is controlled based on a synthetic image having the graphic image superposed on the input image.SOLUTION: A display device of the present invention includes light emission means, display means, synthesis means that produces a synthetic image having a graphic image superposed on an input image, acquisition means that acquires the feature quantity of the synthetic image as a first quantity, memory means in which the feature quantity of the graphic image is stored as a second feature quantity in advance, determination means that determines a degree of influence of the second feature quantity on the first feature quantity on the basis of the first feature quantity and second feature quantity, adjustment means that adjusts the graphic image with an adjustment quantity, which is equal to or smaller than a second threshold, so that the degree of influence becomes equal to or smaller than a first threshold in a case where the degree of influence is larger than the first threshold, and control means that controls light emission of the light emission means on the basis of the first feature quantity.

Description

  The present invention relates to a display device, a display device control method, and a program.

  In recent years, as a technique related to a liquid crystal display device, a technique for controlling the light emission luminance of a backlight according to the brightness of an image (image data) has been proposed. If such a technique is used, the contrast of the display image (image displayed on the screen) can be improved, and the power consumption of the display device can be reduced. In addition, using multiple light sources that can individually control the light emission brightness as the light source of the backlight, the light emission brightness of the light source is controlled according to the brightness of the image in the area on the screen that corresponds to that light source. Techniques to do this have also been proposed. Such control is called local dimming control. By performing local dimming control, the contrast of the display image can be further improved.

  In order to control the light emission luminance of the backlight according to the brightness of the image, it is necessary to constantly detect the brightness of the image. However, the processing amount of such detection processing is large, and the processing amount of detection processing for local dimming control (processing for detecting brightness for each screen area) is particularly large. Therefore, these detection processes are generally performed not by software but by hardware.

  In addition, the display device may display a composite image in which a graphic image is superimposed on an input image. When displaying the composite image and controlling the light emission luminance of the backlight based on the input image, the visibility of the graphic image may be lowered. For example, a graphic image may be displayed extremely dark or extremely bright.

Conventional techniques for improving the visibility of a graphic image are disclosed in Patent Documents 1 and 2, for example.
In the technique disclosed in Patent Document 1, a light source corresponding to a graphic image display area (an area on the screen where a graphic image is displayed) is caused to emit light with a predetermined light emission luminance suitable for the graphic image. Then, the other light sources are caused to emit light with the light emission luminance set according to the user operation.
Further, in the technology disclosed in Patent Document 2, the light emission luminance of the backlight is controlled based on the input image, and the graphic image is reduced so that the change in display luminance (brightness on the screen) due to the change in the light emission luminance of the backlight is reduced. Are adjusted.

JP 2011-186237 A JP 2008-116555 A

However, when local dimming control is performed using the technique disclosed in Patent Document 1, both the graphic image and the input image may be included in the composite image in the region corresponding to the light source. Image quality) may be reduced. Specifically, the light emission luminance of the light source corresponding to the region (mixed region) where both the graphic image and the input image are displayed is controlled to the light emission luminance suitable for the graphic image. As a result, the input image in the mixed area is displayed with a brightness greatly different from that when the graphic image is not displayed. For example, when the light emission luminance for brightly displaying the graphic image is predetermined as the light emission luminance suitable for the graphic image, the input image in the mixed area is displayed brighter than when the graphic image is not displayed. The change in the appearance of the input image described above hinders the adjustment work for adjusting the image quality such as the hue and color density of the input image.

  Depending on the hardware used, a composite image may be used as an image for controlling the light emission luminance of the backlight. When such hardware is used, the technique disclosed in Patent Document 2 cannot be used, but the luminance of the backlight is controlled based on the composite image, so that the visibility of the graphic image is reduced. Can be suppressed. However, if the backlight luminance is controlled based on the composite image, the luminance is affected by the graphic image, so the input image is displayed with a brightness that is significantly different from when the graphic image is not displayed. End up. When the graphic image is adjusted in consideration of only the improvement in the visibility of the graphic image, the light emission luminance of the backlight changes due to the change in the composite image, and thus the appearance change of the input image described above may increase.

  The present invention suppresses a change in the appearance of an input image while suppressing a decrease in the visibility of the graphic image when controlling the light emission of the light source based on a composite image in which the graphic image is superimposed on the input image. The purpose is to provide technology that can be used.

The first aspect of the present invention is:
Light emitting means;
Display means for displaying an image on a screen by modulating light from the light emitting means;
Synthesizing means for synthesizing the input image and a predetermined graphic image to generate a composite image in which the predetermined graphic image is superimposed on the input image;
Acquisition means for acquiring, from the composite image, a feature amount of the composite image as a first feature amount;
Storage means in which a feature amount of the predetermined graphic image is recorded in advance as a second feature amount;
Determining means for determining the degree of influence of the second feature quantity on the first feature quantity based on the first feature quantity and the second feature quantity;
An adjusting unit that adjusts the predetermined graphic image with an adjustment amount equal to or less than a second threshold so that the influence degree is equal to or less than the first threshold when the influence is greater than a first threshold;
A control unit that controls light emission of the light-emitting unit based on the first feature amount, and in the case where the degree of influence is greater than a first threshold value, a composite image on which the graphic image adjusted by the adjustment unit is superimposed Control means for controlling the light emission of the light emitting means based on the feature amount of
It is a display device characterized by having.

The second aspect of the present invention is:
Light emitting means;
Display means for displaying an image on a screen by modulating light from the light emitting means;
Image acquisition means for acquiring a composite image on which a predetermined graphic image is superimposed from an external device;
First acquisition means for acquiring, as a first feature amount, a feature amount of the composite image from the composite image;
Second acquisition means for acquiring a feature amount of the predetermined graphic image as a second feature amount from the external device;
Determining means for determining the degree of influence of the second feature quantity on the first feature quantity based on the first feature quantity and the second feature quantity;
An adjustment instruction for adjusting the predetermined graphic image by an adjustment amount equal to or less than a second threshold so that the influence degree is equal to or less than the first threshold when the influence is greater than a first threshold; Output means for outputting to an external device;
Control means for controlling the light emission of the light emitting means based on the first feature amount, and after the adjustment performed by the external device according to the adjustment instruction when the degree of influence is greater than a first threshold value Control means for controlling the light emission of the light emitting means based on the feature amount of the composite image on which the graphic image is superimposed;
It is a display device characterized by having.

The third aspect of the present invention is:
Light emitting means;
Display means for displaying an image on a screen by modulating light from the light emitting means;
Storage means in which a feature amount of a predetermined graphic image is recorded in advance as a second feature amount;
A display device control method comprising:
Synthesizing the input image and the predetermined graphic image to generate a composite image in which the predetermined graphic image is superimposed on the input image; and
An acquisition step of acquiring the feature amount of the composite image as a first feature amount from the composite image;
A determination step of determining an influence degree of the second feature amount with respect to the first feature amount based on the first feature amount and the second feature amount;
An adjustment step of adjusting the predetermined graphic image with an adjustment amount equal to or less than a second threshold so that the influence degree is equal to or less than the first threshold when the influence is greater than a first threshold;
A control step for controlling the light emission of the light emitting means based on the first feature amount, wherein the graphic image adjusted by the adjustment step is superimposed when the degree of influence is greater than a first threshold value A control step of controlling the light emission of the light emitting means based on the feature amount of
A control method for a display device, comprising:

The fourth aspect of the present invention is:
Light emitting means;
Display means for displaying an image on a screen by modulating light from the light emitting means;
A display device control method comprising:
An image acquisition step of acquiring a composite image on which a predetermined graphic image is superimposed from an external device;
A first acquisition step of acquiring a feature amount of the composite image as a first feature amount from the composite image;
A second acquisition step of acquiring the feature quantity of the predetermined graphic image as the second feature quantity from the external device;
A determination step of determining an influence degree of the second feature amount with respect to the first feature amount based on the first feature amount and the second feature amount;
An adjustment instruction for adjusting the predetermined graphic image by an adjustment amount equal to or less than a second threshold so that the influence degree is equal to or less than the first threshold when the influence is greater than a first threshold; An output step for outputting to an external device;
A control step of controlling light emission of the light emitting means based on the first feature amount, and when the degree of influence is greater than a first threshold value, after the adjustment performed by the external device according to the adjustment instruction A control step of controlling the light emission of the light emitting means based on the feature amount of the composite image on which the graphic image is superimposed;
A control method for a display device, comprising:

  According to a fifth aspect of the present invention, there is provided a program that causes a computer to execute each step of the above-described display device control method.

  According to the present invention, in the case where light emission of a light source is controlled based on a composite image in which a graphic image is superimposed on an input image, a change in the appearance of the input image is suppressed while suppressing a decrease in the visibility of the graphic image. be able to.

1 is a block diagram illustrating a schematic configuration of a display device according to a first embodiment. The figure which shows an example of the acquisition area | region and graphic image which concern on Example 1. FIG. 7 is a flowchart illustrating an example of a process flow of the display device according to the first embodiment. FIG. 10 is a diagram illustrating an example of a graphic image after adjustment processing according to the first embodiment. The figure which shows an example of the acquisition area and graphic image which concern on Example 2. FIG. 10 is a diagram illustrating an example of a graphic image after adjustment processing according to the first embodiment. 10 is a flowchart illustrating an example of a flow of adjustment processing according to the second embodiment. The figure which shows an example of the graphic image after the adjustment process which concerns on Example 2. FIG. FIG. 6 is a block diagram illustrating a schematic configuration of a display device according to a third embodiment.

Hereinafter, a display device, a control method for the display device, and a program according to the present embodiment will be described.
In the following, an example in which the display device according to the present embodiment is a transmissive liquid crystal display device will be described, but the display device according to the present embodiment is not limited thereto. The display device according to the present embodiment may be a display device that displays an image on a screen by modulating light from the light source device. For example, the display device according to the present embodiment may be a reflective liquid crystal display device. In addition, the display device according to the present embodiment may be a MEMS shutter type display using a MEMS (Micro Electro Mechanical System) shutter instead of the liquid crystal element.

<Example 1>
FIG. 1 is a block diagram illustrating a schematic configuration of a display device 101 according to the first embodiment of the invention.
As shown in FIG. 1, the display device 101 includes a control unit 102, a graphic selection unit 103, an image input unit 104, a synthesis unit 105, an image analysis unit 106, a display unit 107, a backlight unit 108, and the like.

The control unit 102 controls each functional unit of the display device 101 according to a user operation. Specifically, when a user operation is performed, a user operation signal corresponding to the user operation is input to the control unit 102. The user operation is an operation of the display device by the user, for example, pressing a button on the display device. The control unit 102 controls each functional unit of the display device 101 according to the input user operation signal. For example, when a user operation for displaying an image quality adjustment menu (graphic image used for adjusting an input image, screen brightness, or the like) is performed, the control unit 102 adjusts the image quality to the graphic selection unit 103. Instructs to select a menu.
The control unit 102 performs various processes in addition to the above processes (details will be described later).

In the graphic selection unit 103, a plurality of graphic images are recorded in advance. Then, the graphic selection unit 103 selects one or more of a plurality of graphic images in response to an instruction from the control unit 102, and outputs the selected graphic image to the synthesis unit 105.
A plurality of graphic images may be recorded in advance in a functional unit other than the graphic selection unit 103. The display device 101 may include a storage unit in which a plurality of graphic images are recorded in advance. Then, the graphic selection unit 103 may acquire a graphic image from the storage unit in response to an instruction from the control unit 102.

The image input unit 104 acquires an input image from an external device. In this embodiment, the image input unit 104 is connected to an external device using a cable such as DVI (Digital Video Interface), and acquires an input image from the external device via the cable. The image input unit 104 outputs the acquired input image to the synthesis unit 105.
Note that the display device may be connected to an external device wirelessly. And an input image may be acquired by wireless communication.
Note that the display device 101 may include a storage unit that stores images (image data). Then, an input image may be acquired from the storage unit of the display device 101.

  The synthesizing unit 105 synthesizes the graphic image output from the graphic selection unit 103 and the input image output from the image input unit 104, thereby generating a composite image in which the graphic image is superimposed on the input image. Then, the synthesis unit 105 outputs the generated synthesized image to the image analysis unit 106.

The image analysis unit 106 analyzes the combined image output from the combining unit 105 and acquires the feature amount of the combined image as the first feature amount. In the present embodiment, the image analysis unit 106 acquires, for each acquisition region, the feature amount of the composite image in the acquisition region as the first feature amount. The acquisition area is an area on the screen and is an area corresponding to a light source included in the backlight unit 108. In the present embodiment, the backlight unit 108 has a plurality of light sources that can individually control light emission, and a plurality of acquisition regions corresponding to the plurality of light sources are determined in advance. In this embodiment, an average luminance value is acquired as the feature amount. The image analysis unit 106 outputs the first feature amount of each acquisition region to the control unit 102, and outputs the composite image to the display unit 107.
The feature amount is not limited to the average luminance value. For example, the feature value may be a representative value of luminance values, a representative value of pixel values, a histogram of luminance values, or a histogram of pixel values. . The representative value is an average value, a mode value, an intermediate value, or the like.

  The display unit 107 is a display panel that displays an image on a screen by transmitting light from the backlight unit 108. In this embodiment, the display unit 107 is a liquid crystal panel having a plurality of liquid crystal elements. The display unit 107 controls the transmittance of each liquid crystal element according to the composite image. Thereby, the composite image is displayed on the screen.

The backlight unit 108 is a light emitting unit that irradiates light to the back surface of the display unit 107. In the present embodiment, the control unit 102 controls the light emission of the backlight unit 108 based on the first feature amount output from the image analysis unit 106. Specifically, for each light source, the control unit 102 controls the light emission of the light source based on the first feature amount of the acquisition region corresponding to the light source. More specifically, the control unit 102 performs a process of determining the light emission luminance based on the first feature amount and notifying the backlight unit 108 of the determined light emission luminance for each light source. Then, the backlight unit 108 causes each light source to emit light with the notified light emission luminance. The light source has one or more light emitting elements. As the light emitting element, an LED element, an organic EL element, a cold cathode tube element, or the like can be used.
A graphic image can be displayed with high visibility by controlling the light emission luminance of the backlight based on the composite image.
Note that the emission color of the light source may be controlled based on the first feature amount. Both the light emission luminance and the light emission color of the light source may be controlled based on the first feature amount.

FIG. 2 is a diagram illustrating an example of an acquisition area and a graphic image according to the present embodiment.
In this embodiment, it is assumed that a plurality of light sources are arranged in a matrix and a plurality of acquisition areas arranged in a matrix are set in advance. Specifically, the backlight unit 108 has a total of 12 light sources in 3 rows and 4 columns. As shown in FIG. 2, a total of twelve acquisition areas 201 in 3 rows and 4 columns constituting the area of the screen are preset. For example, the light source is provided near the center of the acquisition region.
Reference numeral 202 denotes a graphic image. The graphic image 202 is a GUI image used for adjusting the input image and the brightness of the screen.

In this embodiment, the screen area is composed of a plurality of acquisition areas, but the acquisition area is not limited to this. As the acquisition area, an area overlapping with an acquisition area corresponding to another light source may be set, or an area not in contact with the acquisition area corresponding to another light source may be set. As the acquisition area, the same area as the acquisition area corresponding to another light source may be set.
In the present embodiment, a plurality of light sources are arranged in a matrix, but the present invention is not limited to this. For example, the plurality of light sources may be arranged side by side only in one direction such as a row direction or a column direction. And the number of light sources may be more or less than twelve. The number of light sources may be one.
The graphic image is not limited to the GUI image. For example, the graphic image may be a mouse cursor, an icon, an illustration, or the like. The graphic image may not be an image displayed in response to a user operation.

  FIG. 3 shows an example of the flow of processing of the display apparatus according to the present embodiment (processing for suppressing the change in the appearance of the input image due to the graphic image being displayed while suppressing the decrease in the visibility of the graphic image). It is a flowchart. The flowchart of FIG. 3 is executed for each frame of image data, for example. In this embodiment, the image analysis unit 106 analyzes an input image (specifically, a signal added to the input image) and instructs the control unit 102 to start processing at the timing of the vertical synchronization signal of the input image. Thus, the flowchart of FIG. 3 is started.

  First, the control unit 102 determines whether or not a graphic image is displayed (S301). If the graphic image is displayed, the process proceeds to S302. If the graphic image is not displayed, the process proceeds to S305. Whether or not a graphic image is displayed is determined based on, for example, a user operation.

Next, the control unit 102 determines the degree of influence of the second feature amount on the first feature amount based on the first feature amount and the feature amount (second feature amount) of the graphic image (S302). In this embodiment, the degree of influence is determined for each acquisition area. In the present embodiment, each of a plurality of feature amounts (feature amounts of graphic images) corresponding to a plurality of graphic images recorded in advance in the graphic selection unit 103 is recorded in the control unit 102 in advance as a second feature amount. Yes. The control unit 102 determines the degree of influence using the second feature amount that is the feature amount of the graphic image to be displayed. In this embodiment, the feature amount of the entire graphic image is prepared in advance as the second feature amount.
Note that the plurality of second feature amounts may be recorded in advance in a functional unit other than the control unit 102. The display device 101 may include a storage unit in which a plurality of second feature values are recorded in advance. And the control part 102 may acquire the 2nd feature-value used in order to determine an influence degree from a memory | storage part.
For each acquisition region, the feature amount of the graphic image in the acquisition region may be prepared in advance as the second feature amount.

A specific example of the method of acquiring the influence level will be described.
In the following description, one acquisition area will be described, and the other acquisition areas are the same and will not be described.

First, the control unit 102 estimates the feature amount of the input image based on the first feature amount and the second feature amount. Specifically, the feature amount of the input image included in the composite image in the acquisition area is estimated.
The size of the acquisition region is S, the first feature amount (average luminance value) of the acquisition region is Y, the size of the graphic image in the acquisition region is Sg, the second feature amount (average luminance value) is Yg, and the input image in the acquisition region When the feature amount (average luminance value) is Yv, the following formula 1 is established. And the following formula 2 is obtained by transforming the formula 1.

S * Y = Sg * Yg + (S-Sg) * Yv (Formula 1)
Yv = (S * Y-Sg * Yg) / (S-Sg) (Formula 2)

The control unit 102 calculates the average luminance value Yv using Equation 2.
And the control part 102 judges the value according to the difference (absolute value) of the average luminance value Yv and the average luminance value Y as an influence degree. In this embodiment, the difference between the average luminance value Yv and the average luminance value Y is calculated as the influence degree. A value different from the difference between the average luminance value Yv and the average luminance value Y may be determined as the degree of influence.

  It is assumed that the acquisition area is 256 pixels in the horizontal direction × 256 pixels in the vertical direction, the brightness value of the image is an 8-bit precision value of 0 to 255, and the average brightness value of the composite image in the acquisition area is 100. Assume that the size of the graphic image in the acquisition area is 200 pixels in the horizontal direction × 100 pixels in the vertical direction, and the average luminance value of the graphic image is 200. In this case, the average luminance value Yv = (256 × 256 × 100−200 × 100 × 200) / (256 × 256-200 × 100) = 56 of the input image is obtained from Equation 2. Then, 44 (= | 100−56 |) is obtained as the degree of influence.

Even when a mode value or an intermediate value is used as a feature amount, the degree of influence can be obtained by the above method. However, it can be expected that the use of the average value as the feature amount will obtain a higher degree of influence (specifically, the feature amount of the input image) than when the mode value or the intermediate value is used.
When the feature amount is a histogram, the feature amount of the input image can be estimated by subtracting the second feature amount from the first feature amount.
Note that the definition of the degree of influence is not limited to that described above. For example, the degree of influence may be (Sg × Yg) ÷ (S × Y).

Returning to the description of FIG.
Following S302, the control unit 102 determines whether or not the degree of influence obtained in S302 is greater than the first threshold (S303). In this embodiment, it is determined for each acquisition area whether or not the influence degree is greater than the first threshold value. An acquisition area whose influence degree is larger than the first threshold is determined to have a large change in the appearance of the input image due to the display of the graphic image, and an acquisition area whose influence degree is less than or equal to the first threshold is input by the display of the graphic image It is determined that there is almost no change in the appearance of the image. Then, if there is an acquisition area with an influence degree greater than the first threshold, the process proceeds to S304. If there is no acquisition area with an influence degree greater than the first threshold, the process proceeds to S305. It is done.
For example, when the first threshold value is 10, it is determined that the change in the appearance of the input image due to the display of the graphic image is unacceptable for an acquisition region having an influence degree greater than 10. In addition, it is determined that an acquisition area having an influence degree of 10 or less is small enough to allow an appearance change of the input image due to the display of the graphic image. If there is an acquisition area with an influence degree greater than 10, the process proceeds to S304. If there is no acquisition area with an influence degree greater than 10, the process proceeds to S305.
Note that the first threshold value may be a fixed value determined in advance by the manufacturer, or may be a value that can be changed by the user. The first threshold value may be dynamically determined according to an input image, a graphic image, an installation environment of the display device 101, a purpose of use of the display device 101, and the like.

In S304, the control unit 102 adjusts the graphic image in the acquisition area with an adjustment amount equal to or less than the second threshold so that the influence degree of the acquisition area where the influence degree is greater than the first threshold is equal to or less than the first threshold. To do. Hereinafter, an acquisition area whose influence degree is larger than the first threshold is referred to as an “adjustment target area”.
Note that the graphic image may be adjusted so that the degree of influence of the adjustment target area matches the first threshold value. According to such adjustment, it is possible to minimize a decrease in the visibility of the graphic image.
In this embodiment, an example in which only the graphic image in the adjustment target area is adjusted will be described. However, the entire graphic image may be adjusted.
The second threshold value may be a fixed value determined in advance by the manufacturer, or may be a value that can be changed by the user. The first threshold value may be dynamically determined according to an input image, a graphic image, an installation environment of the display device 101, a purpose of use of the display device 101, and the like.

The process (adjustment process) of S304 will be specifically described.
If the brightness, color, size, transparency, etc. of the graphic image are changed, the first feature value changes, so the influence level also changes. Therefore, the degree of influence can be reduced by adjusting at least one of the brightness, color, size, transparency, etc. of the graphic image. Hereinafter, an example will be described in which the graphic image is brighter than the input image, and the brightness, size, and transparency of the graphic image are adjusted in that order. In the following, an adjustment process for one adjustment target area will be described. When there are a plurality of adjustment target areas, the following adjustment processing is performed on all the adjustment target areas.

First, the control unit 102 reduces the brightness of the graphic image (first adjustment process). In this embodiment, the brightness of the graphic image is reduced to a maximum of half the initial brightness (initial luminance) of the graphic image. That is, the lower limit (lower limit luminance) of the brightness of the graphic image is half the initial luminance. The brightness of the graphic image can be reduced by reducing the pixel value of the graphic image. For example, when the pixel value is an RGB value, the brightness can be reduced by reducing (R value, G value, B value) = (255, 255, 255) to (100, 100, 100). it can.
In the first adjustment process, the degree of influence is repeatedly acquired while gradually reducing the brightness of the graphic image. Then, the first adjustment process is terminated at the earlier timing of the timing when the influence level becomes equal to or lower than the first threshold and the timing when the brightness of the graphic image reaches the lower limit luminance.
When the degree of influence is equal to or less than the first threshold value due to the first adjustment process, the adjustment process is terminated.
When the graphic image is darker than the input image, a process for increasing the brightness of the graphic image may be performed as the first adjustment process.

Even if the brightness of the graphic image is reduced to the lower limit luminance, if the degree of influence is larger than the first threshold, the control unit 102 reduces the graphic image (second adjustment process). In this embodiment, the graphic image is reduced to a size that is at most half the initial value (initial size) of the size of the graphic image. That is, the lower limit value (lower limit size) of the size of the graphic image is half the initial size.
In the second adjustment process, the degree of influence is repeatedly acquired while gradually reducing the graphic image. Then, the second adjustment process is terminated at the earlier timing of the timing when the influence degree becomes equal to or less than the first threshold and the timing when the size of the graphic image reaches the lower limit size, whichever is earlier.
When the degree of influence is equal to or less than the first threshold value by the second adjustment process, the adjustment process is terminated.
Even when the graphic image is reduced to the lower limit size, if the degree of influence is larger than the first threshold, the control unit 102 increases the transparency of the graphic image (third adjustment process). Since the difference between the third adjustment process and the first and second adjustment processes is only the parameter to be used, detailed description of the third adjustment process is omitted.

If the influence degree of all the adjustment target areas is equal to or less than the first threshold value, the process proceeds to S305.
FIG. 4 shows an example of the graphic image after the adjustment process.
FIG. 4 shows an example when the graphic image shown in FIG. 2 is adjusted. 2 and 4, it can be seen that the color of the adjustment bar is adjusted from white to black, and the brightness of the background portion (portion other than the adjustment bar) is reduced. As described above, in the adjustment process, the adjustment can be performed for each part constituting the graphic image.

Returning to the description of FIG.
In step S <b> 305, the control unit 102 controls the light emission luminance of the backlight unit 108 in accordance with the first feature amount output from the image analysis unit 106. In the present embodiment, for each acquisition region, the light emission luminance of the light source corresponding to the acquisition region is controlled based on the first feature amount of the acquisition region. When the graphic image is adjusted, the light emission luminance is controlled based on the feature amount of the composite image obtained by superimposing the adjusted graphic image on the input image.

  As described above, according to the present embodiment, in the case of controlling the light emission of the light source based on the composite image in which the graphic image is superimposed on the input image, the input image is suppressed while suppressing a decrease in the visibility of the graphic image. It is possible to suppress changes in the appearance. Specifically, when the influence degree of the second feature amount with respect to the first feature amount is larger than the first threshold value, the graphic image is adjusted so that the influence degree becomes equal to or less than the first threshold value. Changes in appearance can be suppressed. Further, by limiting the adjustment amount of the graphic image to the second threshold value or less, it is possible to suppress a decrease in the visibility of the graphic image.

In this embodiment, an example in which a plurality of parameters (brightness, color, size, transparency, etc. of a graphic image) are adjusted in order has been described. However, two or more parameters are adjusted at a time. Also good.
In addition, although the process which judges the influence degree, the process which compares an influence degree with a threshold value, the process which adjusts a graphic image, and the process which controls the light emission luminance of a backlight were demonstrated in the control part 102, this was demonstrated. Not limited to. For example, the display device may include a determination unit that determines the degree of influence, a comparison unit that compares the degree of influence with a threshold, an adjustment unit that adjusts a graphic image, and the like.

<Example 2>
In the first embodiment, the example in which the graphic image in the acquisition region whose influence degree is larger than the first threshold is adjusted has been described. However, when such adjustment is performed, when the graphic image crosses the boundary between the acquisition regions, the graphic image becomes discontinuous between the acquisition regions, and the image quality and visibility of the graphic image may be greatly reduced. . Therefore, in the second embodiment, a method will be described in which, even when a graphic image straddles the boundary between acquisition areas, a change in the appearance of the input image can be suppressed while suppressing a decrease in the visibility of the graphic image.
In the adjustment process according to the first embodiment, if the entire graphic image is adjusted, the image quality and visibility of the graphic image described above are not significantly reduced.
The display device according to the second embodiment and the configuration thereof are the same as the configuration of the first embodiment (FIG. 1), and thus the description thereof is omitted.

FIG. 5 shows an example of an acquisition area and a graphic image according to the present embodiment.
The graphic image shown in FIG. 5 is a marker displayed on a display device for image production or the like. In FIG. 5, the marker is an image including four lines in the vertical direction and three lines in the horizontal direction.
FIG. 6 shows an example of a result of applying the adjustment processing (processing for adjusting the graphic image for each acquisition area) according to the first embodiment to the graphic image of FIG.
When a graphic image crosses the boundary between acquisition areas, the degree of influence may differ between acquisition areas. For this reason, as shown in FIG. 6, the size of the graphic image may be partially reduced, or the color of the graphic image may be partially changed. When such a partial adjustment occurs, it becomes difficult to see the graphic image.

Therefore, in the present embodiment, after the adjustment processing according to the first embodiment, the graphic image in each acquisition region is set such that the degree of continuity between the graphic image in the acquisition region and the graphic image in the adjacent acquisition region is equal to or greater than the third threshold. Adjust individually. Specifically, each acquisition area is set such that a difference in at least one of brightness, color, size, and transparency between the graphic image in the acquisition area and the graphic image in the adjacent acquisition area is equal to or less than a fourth threshold value. Adjust the graphic image at.
Note that the third threshold value and the fourth threshold value may be fixed values predetermined by the manufacturer, or may be values that can be changed by the user. The first threshold value may be dynamically determined according to an input image, a graphic image, an installation environment of the display device 101, a purpose of use of the display device 101, and the like.
It should be noted that a value different from the difference in parameters (brightness, color, size, transparency, etc.) is calculated as the continuous degree, and the graphic image in each acquisition region is such that the calculated continuous degree is equal to or less than the third threshold value. It may be adjusted. For example, the reciprocal of the above parameter may be calculated as the degree of continuity.

FIG. 7 is a flowchart illustrating an example of the flow of adjustment processing according to the present embodiment. The flowchart of FIG. 7 is executed in S304 of FIG.
First, in S701, the adjustment process according to the first embodiment is executed.

Next, the control unit 102 determines whether or not the continuity of the graphic image is maintained between the acquisition areas for each combination of two acquisition areas adjacent to each other (S702). If there is a combination that does not maintain continuity, the process proceeds to S703. If continuity is maintained for all combinations, this flow ends (the process proceeds to S305).
In S702, for example, it is determined whether or not a difference in at least one of brightness, color, size, and transparency is equal to or smaller than a fourth threshold value. Then, it is determined that continuity is not maintained for a combination having a parameter difference greater than the fourth threshold, and continuity is maintained for a combination having a parameter difference greater than the fourth threshold. It is judged that

In S703, the control unit 102 adjusts the graphic image in each acquisition region so that continuity is maintained for all combinations. At this time, the graphic image is adjusted so that the influence degree does not exceed the first threshold value.
FIG. 8 shows an example of the result of the adjustment process according to the present embodiment. FIG. 8 shows the result of adjusting the graphic image of FIG. 6 so that the graphic image does not become discontinuous between the acquisition regions. From FIG. 8, it can be seen that the continuity of the graphic image is maintained and the visibility of the graphic image is improved in all combinations of two acquisition regions adjacent to each other.

As described above, according to the present embodiment, since the graphic image is adjusted in consideration of the continuity of the graphic image between the acquisition regions, it is possible to further suppress the decrease in the visibility of the graphic image.
In this embodiment, the example in which the two-stage process of the adjustment process for reducing the influence degree and the adjustment process for increasing the continuity degree has been described. However, it is not necessary to perform the adjustment process of a plurality of stages. One-stage processing for individually adjusting graphic images in each acquisition region may be performed so that the degree of influence is reduced and the degree of continuity is not reduced.

<Example 3>
In the first and second embodiments, the example in which the graphic image is generated in the display device has been described. In the third embodiment, an image output device (external device) such as a personal computer is connected to a display device, a composite image is generated by the image output device, and a composite image is output from the image output device to the display device. explain.

FIG. 9 is a block diagram illustrating a schematic configuration of the display device 101 according to the present embodiment.
As shown in FIG. 9, an image output device 901 is connected to the display device 101 according to the present embodiment. The image output device 901 is a personal computer or the like, and includes an application control unit 902, an image output unit 903, and the like.

The application control unit 902 executes an application in response to a user operation on the image output device 901. The application control unit 902 generates a composite image on which a graphic image (predetermined graphic image) used in the application is superimposed, and outputs the generated composite image to the image output unit 903. When the graphic image is not used, the application control unit 902 generates an image on which the graphic image is not superimposed (input image of the first embodiment), and outputs the generated composite image to the image output unit 903.
Further, the application control unit 902 outputs image information related to the graphic image to the display device 101 (control unit 102). The image information includes whether or not a composite image has been generated (whether or not a graphic image is displayed), area information of the graphic image, a second feature amount, and the like. In this embodiment, the application control unit 902 is connected to the display device 101 using a cable such as a USB (Universal Serial Bus), and outputs image information to the display device 101 via the cable. Further, the application control unit 902 acquires information (instructions) from the display device 101 via a cable.
In addition, when an adjustment instruction for adjusting a graphic image is notified from the control unit 102, the application control unit 902 adjusts the graphic image according to the adjustment instruction, and regenerates a composite image. The method for adjusting the graphic image is the same as in the first embodiment.

The image output unit 903 outputs the image (composite image or input image) output from the application control unit 902 to the display device 101 (image input unit 104). In this embodiment, the image output unit 903 is connected to the display device 101 using a cable such as DVI, and outputs an image to the display device 101 via the cable.
Note that the external device may be connected to the display device wirelessly. And an image and image information may be output by wireless communication.

  As shown in FIG. 9, the display apparatus 101 according to the present embodiment includes a control unit 102, an image input unit 104, an image analysis unit 106, a display unit 107, a backlight unit 108, and the like.

The control unit 102 has the same function as in the first embodiment.
However, in this embodiment, the control unit 102 does not adjust the graphic image and instructs the application control unit 902 to adjust the graphic image. Further, the control unit 102 determines, based on the image information from the application control unit 902, whether or not a graphic image is displayed, a region of the graphic image, a second feature amount, and the like.
Note that the process for instructing adjustment of the graphic image and the process for acquiring the second feature amount (second acquisition process) may be executed by different functional units. For example, the display device 101 may include an output unit that outputs an adjustment instruction for adjusting a graphic image to an external device, and an acquisition unit that acquires a second feature amount from the external device.
The image input unit 104 (image acquisition unit) acquires an image (a composite image or an input image) from the image output unit 903 and outputs the acquired image to the image analysis unit 106.
Similar to the first embodiment, the image analysis unit 106 performs processing (first acquisition processing) for acquiring the first feature amount from the composite image.
The display unit 107 and the backlight unit 108 are the same as those in the first embodiment.

The processing flow of the display device according to the present embodiment is the same as that of the first embodiment (FIG. 3).
However, in S304, the control unit 102 does not adjust the graphic image and instructs the application control unit 902 to adjust the graphic image. Then, the graphic image is adjusted by the application control unit 902 as in the first and second embodiments.

  As described above, according to the present embodiment, when the influence degree of the second feature amount with respect to the first feature amount is larger than the first threshold value, the external device that generates the composite image is instructed to adjust the graphic image. The graphic image is adjusted by the external device. Thereby, even when a graphic image or a composite image is generated by an external device, the same effects as those of the first and second embodiments can be obtained.

<Other examples>
The present invention can also be implemented by a system (or a device such as a CPU or MPU) of a system or apparatus that implements the functions of the above-described embodiments by reading and executing a program recorded in a storage device. The present invention can also be implemented by a method comprising steps executed by a computer of a system or apparatus that implements the functions of the above-described embodiments by reading and executing a program recorded in a storage device, for example. . For this purpose, the program is stored in the computer from, for example, various types of recording media that can serve as the storage device (ie, computer-readable recording media that holds data non-temporarily). Provided to. Therefore, the computer (including devices such as CPU and MPU), the method, the program (including program code and program product), and the computer-readable recording medium that holds the program non-temporarily are all present. It is included in the category of the invention.

DESCRIPTION OF SYMBOLS 101 Display apparatus 102 Control part 105 Composition part 106 Image analysis part 107 Display part 108 Backlight part

Claims (17)

Light emitting means;
Display means for displaying an image on a screen by modulating light from the light emitting means;
Synthesizing means for synthesizing the input image and a predetermined graphic image to generate a composite image in which the predetermined graphic image is superimposed on the input image;
Acquisition means for acquiring, from the composite image, a feature amount of the composite image as a first feature amount;
Storage means in which a feature amount of the predetermined graphic image is recorded in advance as a second feature amount;
Determining means for determining the degree of influence of the second feature quantity on the first feature quantity based on the first feature quantity and the second feature quantity;
An adjusting unit that adjusts the predetermined graphic image with an adjustment amount equal to or less than a second threshold so that the influence degree is equal to or less than the first threshold when the influence is greater than a first threshold;
A control unit that controls light emission of the light-emitting unit based on the first feature amount, and in the case where the degree of influence is greater than a first threshold value, a composite image on which the graphic image adjusted by the adjustment unit is superimposed Control means for controlling the light emission of the light emitting means based on the feature amount of
A display device comprising: The determination means includes
Based on the first feature amount and the second feature amount, the feature amount of the input image is estimated,
The display device according to claim 1, wherein a value corresponding to a difference between the feature amount of the input image and the first feature amount is determined as the degree of influence. The display device according to claim 2, wherein the determination unit calculates a difference between the feature amount of the input image and the first feature amount as the degree of influence. The display device according to claim 1, wherein the adjustment unit adjusts at least one of brightness, color, size, and transparency of the predetermined graphic image. The light emitting means has a plurality of light sources capable of individually controlling light emission,
The acquisition means acquires, for each of a plurality of acquisition areas on the screen corresponding to the plurality of light sources, a feature quantity of a composite image in the acquisition area as a first feature quantity,
The determination means determines the degree of influence for each acquisition area,
The said adjustment means adjusts the said predetermined graphic image so that the said influence degree of the acquisition area where the said influence degree is larger than the said 1st threshold value becomes below the said 1st threshold value. 5. The display device according to any one of 4. The adjusting means is configured such that the influence degree of the acquisition area where the influence degree is larger than the first threshold is equal to or less than the first threshold, and the predetermined area in the acquisition area adjacent to the predetermined graphic image in the acquisition area. The display device according to claim 5, wherein the predetermined graphic image in each acquisition region is individually adjusted so that the continuity with the graphic image is equal to or greater than a third threshold value. The adjusting means is configured such that the influence degree of the acquisition area where the influence degree is larger than the first threshold is equal to or less than the first threshold, and the predetermined area in the acquisition area adjacent to the predetermined graphic image in the acquisition area. The predetermined graphic image in each acquisition region is individually adjusted so that at least one of the brightness, color, size, and transparency of the graphic image is equal to or less than the fourth threshold value. The display device according to claim 5 or 6. Light emitting means;
Display means for displaying an image on a screen by modulating light from the light emitting means;
Image acquisition means for acquiring a composite image on which a predetermined graphic image is superimposed from an external device;
First acquisition means for acquiring, as a first feature amount, a feature amount of the composite image from the composite image;
Second acquisition means for acquiring a feature amount of the predetermined graphic image as a second feature amount from the external device;
Determining means for determining the degree of influence of the second feature quantity on the first feature quantity based on the first feature quantity and the second feature quantity;
An adjustment instruction for adjusting the predetermined graphic image by an adjustment amount equal to or less than a second threshold so that the influence degree is equal to or less than the first threshold when the influence is greater than a first threshold; Output means for outputting to an external device;
Control means for controlling the light emission of the light emitting means based on the first feature amount, and after the adjustment performed by the external device according to the adjustment instruction when the degree of influence is greater than a first threshold value Control means for controlling the light emission of the light emitting means based on the feature amount of the composite image on which the graphic image is superimposed;
A display device comprising: Light emitting means;
Display means for displaying an image on a screen by modulating light from the light emitting means;
Storage means in which a feature amount of a predetermined graphic image is recorded in advance as a second feature amount;
A display device control method comprising:
Synthesizing the input image and the predetermined graphic image to generate a composite image in which the predetermined graphic image is superimposed on the input image; and
An acquisition step of acquiring the feature amount of the composite image as a first feature amount from the composite image;
A determination step of determining an influence degree of the second feature amount with respect to the first feature amount based on the first feature amount and the second feature amount;
An adjustment step of adjusting the predetermined graphic image with an adjustment amount equal to or less than a second threshold so that the influence degree is equal to or less than the first threshold when the influence is greater than a first threshold;
A control step for controlling the light emission of the light emitting means based on the first feature amount, wherein the graphic image adjusted by the adjustment step is superimposed when the degree of influence is greater than a first threshold value A control step of controlling the light emission of the light emitting means based on the feature amount of
A control method for a display device, comprising: In the determination step,
Based on the first feature amount and the second feature amount, the feature amount of the input image is estimated,
The method according to claim 9, wherein a value corresponding to a difference between the feature amount of the input image and the first feature amount is determined as the degree of influence. The method according to claim 10, wherein, in the determination step, a difference between the feature amount of the input image and the first feature amount is calculated as the degree of influence. 12. The display device control according to claim 9, wherein in the adjustment step, at least one of brightness, color, size, and transparency of the predetermined graphic image is adjusted. Method. The light emitting means has a plurality of light sources capable of individually controlling light emission,
In the acquisition step, for each of a plurality of acquisition regions on the screen corresponding to the plurality of light sources, a feature amount of a composite image in the acquisition region is acquired as a first feature amount,
In the determination step, the influence degree is determined for each acquisition area,
The adjustment step adjusts the predetermined graphic image so that the influence degree of the acquisition region where the influence degree is larger than the first threshold value is equal to or less than the first threshold value. 13. A method for controlling a display device according to any one of 12 above. In the adjustment step, the predetermined degree in the acquisition area adjacent to the predetermined graphic image in the acquisition area and the influence degree of the acquisition area in which the influence degree is greater than the first threshold is equal to or less than the first threshold. The display device control method according to claim 13, wherein the predetermined graphic image in each acquisition region is individually adjusted so that a degree of continuity with the graphic image is equal to or greater than a third threshold value. In the adjustment step, the predetermined degree in the acquisition area adjacent to the predetermined graphic image in the acquisition area and the influence degree of the acquisition area in which the influence degree is greater than the first threshold is equal to or less than the first threshold. The predetermined graphic image in each acquisition region is individually adjusted so that at least one of the brightness, color, size, and transparency of the graphic image is equal to or less than the fourth threshold value. The method for controlling a display device according to claim 13 or 14. Light emitting means;
Display means for displaying an image on a screen by modulating light from the light emitting means;
A display device control method comprising:
An image acquisition step of acquiring a composite image on which a predetermined graphic image is superimposed from an external device;
A first acquisition step of acquiring a feature amount of the composite image as a first feature amount from the composite image;
A second acquisition step of acquiring the feature quantity of the predetermined graphic image as the second feature quantity from the external device;
A determination step of determining an influence degree of the second feature amount with respect to the first feature amount based on the first feature amount and the second feature amount;
An adjustment instruction for adjusting the predetermined graphic image by an adjustment amount equal to or less than a second threshold so that the influence degree is equal to or less than the first threshold when the influence is greater than a first threshold; An output step for outputting to an external device;
A control step of controlling light emission of the light emitting means based on the first feature amount, and when the degree of influence is greater than a first threshold value, after the adjustment performed by the external device according to the adjustment instruction A control step of controlling the light emission of the light emitting means based on the feature amount of the composite image on which the graphic image is superimposed;
A control method for a display device, comprising:   A program that causes a computer to execute each step of the display device control method according to any one of claims 9 to 16.

Images