JP2019109279A - Processing method, display device, and information processing device - Google Patents

Abstract

To provide a technology capable of suitably performing image quality adjustment according to the intention of an image producer according to a user operation with respect to a display device.SOLUTION: A processing method includes: an acquisition step of a display device acquiring an adjustment parameter for adjusting each gradation value of image data according to a user operation with respect to the display device; a determination step of the display device determining whether or not a specific image whose maximum luminance of a luminance range is equal to or greater than a threshold value is arranged in the image based on the image data; and a conversion step of, in the case where the specific image is determined to be arranged, the display device performing gradation conversion processing for converting each gradation value of the image data by using a gradation conversion characteristic corresponding to the specific image based on the adjustment parameter.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a processing method, a display device, and an information processing apparatus.

  In recent years, with the improvement of the performance of imaging sensors, the advancement of technology relating to image processing, and the like, HDR image data has begun to spread. HDR image data is image data corresponding to a wide dynamic range (HDR). For example, HDR image data is image data whose color depth is larger than 8 bits. The dynamic range is, for example, a range of gradation values, a range of luminance, or the like.

With the improvement of the performance of display devices, techniques for realizing high-luminance display are beginning to be proposed. For example, with the improvement of the performance of an LED (Light Emitting Diode) used as a light source of a backlight portion of a liquid crystal display device, a technology capable of realizing high-luminance display by controlling the light emission luminance of the backlight portion is proposed. It is beginning to be done. OLED (Organic
There has also been proposed a technology capable of individually realizing high-luminance display for each of a plurality of pixels using a light emitting diode (organic EL (Electro Luminescence) element).

  For example, when an HDR image creator creates HDR image data assuming display on a display device capable of achieving high luminance display, the HDR image data is displayed so that a small-sized white image stands out on the display surface. create. Specifically, the image creator changes the brightness between frames, changes in brightness between scenes, the maximum brightness of each frame, the maximum brightness of each scene, and so on, the small white image on the display surface stands out. Decide etc. The image creator creates such information on luminance as metadata of HDR image data.

  And in the future, the spread of HDR image data supposing the display by the display apparatus which can implement | achieve a high-intensity display is anticipated. Hereinafter, HDR image data assumed to be displayed on a display device capable of realizing high luminance display is described as “high luminance HDR image data” to be distinguished from other HDR image data. There are various contents as contents of the high brightness HDR image data. For example, there is content (such as a movie) to which the intention of an image creator (content creator) such as the information described above is added as metadata. There are also contents (games, contents photographed and generated by a general user, etc.) in which the intention of the image creator is not added as metadata. These contents are, for example, provided to the user using a network, or recorded on a Blu-ray disc or the like to be provided to the user. As the opportunity for providing high brightness HDR image data to the user increases, the opportunity for the HDR image data to be displayed on the display also increases.

  There is a system in which a PC monitor (display device) is connected to a PC (Personal Computer), and the PC monitor displays image data output from the PC. In such a system, the user performs a user operation (image quality adjustment operation) for image quality adjustment such as brightness adjustment and color adjustment using a UI (User Interface) of the PC monitor.

  A technique relating to image quality adjustment operation is disclosed, for example, in Patent Document 1. In the technology disclosed in Patent Document 1, the developing device generates a development parameter from the image quality parameter corresponding to the image quality adjustment operation on the display device, and performs redevelopment.

JP 2012-147303 A

  However, with the technology disclosed in Patent Document 1, it is not confirmed whether the metadata regarding the display luminance and the like intended by the image creator is added to the content to be displayed. Therefore, in accordance with the image quality adjustment operation, the image quality adjustment which does not conform to the intention of the image creator may be performed, and the image may be displayed with a luminance distribution or a color distribution which does not conform to the intention of the image creator.

  An object of the present invention is to provide a technology capable of suitably performing the image quality adjustment in accordance with the intention of the image creator in accordance with the user's operation on the display device.

The first aspect of the present invention is
An acquiring step of acquiring an adjustment parameter for adjusting each gradation value of the image data in response to a user operation on the display device;
A determination step in which the display device determines whether or not a specific image whose maximum luminance in the luminance range is equal to or greater than a threshold is disposed in an image based on the image data;
When it is determined that the specific image is arranged, the display device converts each gradation value of the image data based on the adjustment parameter and using the gradation conversion characteristic corresponding to the specific image. A conversion step for performing gradation conversion processing;
It is a processing method characterized by having.

The second aspect of the present invention is
A processing method of the information processing apparatus;
Whether the state of the information processing apparatus is in a specific state where it is possible to output image data whose maximum luminance in the luminance range is equal to or greater than the threshold value to a display device that performs gradation conversion processing that converts each gradation value of image data A determination step in which the information processing apparatus determines whether or not
An acquisition step of acquiring, from the display device, adjustment parameters for adjusting each gradation value of the image data after it is determined that the state of the information processing device has become the specific state;
A determination step of determining the gradation conversion characteristic of the gradation conversion processing based on the adjustment parameter;
It is a processing method characterized by having.

The third aspect of the present invention is
Acquisition means for acquiring adjustment parameters for adjusting each tone value of the image data in accordance with user operation;
Determining means for determining whether or not a specific image having the maximum luminance of the luminance range equal to or greater than a threshold is disposed in the image based on the image data;
A tone conversion process of converting each tone value of the image data based on the adjustment parameter and using the tone conversion characteristic corresponding to the specific image when it is determined that the specific image is arranged Conversion means to perform
And a display device characterized by comprising:

The fourth aspect of the present invention is
An information processing apparatus,
Whether the state of the information processing apparatus is in a specific state where it is possible to output image data whose maximum luminance in the luminance range is equal to or greater than the threshold value to a display device that performs gradation conversion processing that converts each gradation value of image data Judging means for judging whether or not
An acquisition unit configured to acquire, from the display device, adjustment parameters for adjusting each gradation value of the image data after it is determined that the state of the information processing apparatus is in the specific state;
Determining means for determining tone conversion characteristics of the tone conversion processing based on the adjustment parameter;
An information processing apparatus characterized by comprising:

  A fifth aspect of the present invention is a program for causing a computer to execute each step of the processing method described above.

  According to the present invention, it is possible to preferably perform the image quality adjustment in accordance with the intention of the image creator in accordance with the user operation on the display device.

Schematic diagram showing a configuration example of a display system according to the first embodiment A flowchart showing an example of the processing flow of the tone map control unit according to the first embodiment Flowchart showing an example of the processing flow of the image quality adjustment judgment unit according to the first embodiment FIG. 6 is a diagram showing an example of the correspondence between tone values and display luminance according to the first embodiment. The figure which shows an example of the screen which concerns on Example 1. Flow chart showing an example of processing flow according to the first embodiment The schematic diagram which shows the structural example of the display apparatus which concerns on Example 2. The figure which shows an example of the change method of the tone map function which concerns on Example 2. The figure which shows an example of the change method of the tone map function which concerns on Example 2. The schematic diagram which shows the structural example of the display system which concerns on Example 3. Flowchart showing an exemplary processing flow of initialization according to the third embodiment

Example 1
Hereinafter, Example 1 of the present invention will be described. FIG. 1 is a schematic view showing a configuration example of a display system according to the present embodiment. The display system according to the present embodiment includes an information processing apparatus (image output apparatus) 100 and a display apparatus 120. The information processing device 100 and the display device 120 are connected to each other according to DP (Display Port) standard, HDMI (High-Definition Multimedia Interface) standard, or the like.

  The information processing apparatus 100 is a PC (Personal Computer), a playback apparatus (for example, a Blu-ray disc player), a server apparatus, or the like, and can determine a tone map function (tone conversion characteristic) in accordance with the intention of the image creator. The information processing apparatus 100 acquires various image data (such as HDR image data) from the cloud (such as a server device) 200 using cloud computing. HDR image data is image data in which the maximum luminance of the dynamic range (luminance range) is equal to or higher than a threshold. HDR image data can also be said to be “image data corresponding to a high dynamic range (HDR)”. Specifically, HDR image data is image data conforming to ST2084, information regarding display luminance (luminance of display surface on which the image is displayed), information indicating compliance with ST2084, etc. are metadata. Image data added as. The gradation value of the HDR image data is a 10-bit value (0 to 1023). A dynamic range narrower than HDR is called "SDR (Standard Dynamic Range)" or the like, and image data corresponding to SDR is called "SDR image data" or the like.

The cloud 200 may be a playback device such as a Blu-ray disc player. The information processing apparatus 100 may have a storage device (hard disk drive, Blu-ray disc drive, etc.), and may read image data from the storage device. The data format of the HDR image data is not particularly limited. The number of bits of HDR image data may be higher or lower than 10 bits. For example, the number of bits of HDR image data may be 12 bits, 16 bits, 32 bits, and so on. Metadata may not be added to the HDR image data.

  The display device 120 is a PC monitor, a projector, a television device, or the like, and can perform tone map processing (tone conversion processing) using the set tone map function. The display device 120 can realize display luminance up to 2000 nit, and can display HDR image data in HDR. Note that the upper limit (peak luminance) of display luminance that can be realized by the display device 120 may be higher or lower than 2000 nit.

  The information processing apparatus 100 includes a content acquisition unit 101, a metadata analysis unit 102, an operation unit 103, a layout unit 104, a tone map control unit 105, a content output unit 109, an EDID analysis unit 110, and an auxiliary data control unit 111. .

  The content acquisition unit 101 acquires image data (content) to be displayed. In the present embodiment, the content acquisition unit 101 acquires image data from the cloud 200. The content acquisition unit 101 outputs the acquired image data to the layout unit 104. In the present embodiment, the content acquisition unit 101 may acquire image data to which metadata is added (for example, the above-described HDR image data). When the image data to which the metadata is added is acquired, the content acquisition unit 101 outputs the metadata to the metadata analysis unit 102.

  The content acquisition unit 101 may have a decoding function. For example, the content acquisition unit 101 may convert a TMDS signal according to the HDMI standard or the like into image data such as RGB data, YCbCr data, or the like. The image data (including HDR image data) acquired by the content acquisition unit 101 may be still image data or moving image data.

  The metadata analysis unit 102 analyzes the metadata output from the content acquisition unit 101. For example, the metadata analysis unit 102 determines whether or not information related to display brightness is included in the metadata, and when the information is included in the metadata, the tone map is used as the tone map brightness information. Output to control unit 105. The tone map luminance information is, for example, information indicating a peak luminance, information indicating a toe map function (correspondence between a gradation value and display luminance), and the like.

  The operation unit 103 is a mouse, a keyboard, or the like, receives a user operation related to display, and outputs operation information according to the user operation to the layout unit 104. For example, the operation unit 103 receives a user operation for changing the size and position of an image based on image data acquired by the content acquisition unit 101, a window in which the image is arranged, and the like. The operation unit 103 may or may not be detachable from the information processing apparatus 100.

The layout unit 104 generates screen data representing one screen using the image data output from the content acquisition unit 101 in accordance with the operation information output from the operation unit 103. Then, the layout unit 104 outputs the screen data to the tone map control unit 105. In the screen data, an image based on the image data output from the content acquisition unit 101 is arranged in the screen. The content acquisition unit 101 may acquire a plurality of image data, and a plurality of images respectively corresponding to the plurality of image data may be arranged in the screen. A window may be placed in the screen, and one or more images may be placed in the window. A plurality of windows may be arranged in the screen, and applications corresponding to the windows may be the same or different among the plurality of windows.

  When the layout unit 104 detects operation information from the operation unit 103, the layout unit 104 generates layout information on the layout of an image or window on the screen, and outputs the layout information to the tone map control unit 105. The layout information includes, for example, whether or not an image (HDR image) based on HDR image data is arranged, an ID of an image or window, a state of the image or window (active state / inactive state), a size of the image or window, Indicates the position of an image or window, etc.

  The tone map control unit 105 determines a tone map function to be set for the display device 120, and outputs tone map control information for setting the tone map function to the content output unit 109. Details of the processing of the tone map control unit 105 will be described later. The tone map control unit 105 may be configured by hardware or may be configured by software.

  The content output unit 109 converts the screen data output from the layout unit 104 and the tone map control information output from the tone map control unit 105 into a signal of a transmission format corresponding to the DP standard, HDMI standard, etc. , Output to the display device 120. For example, toe map control information is added to the screen data as metadata and is output. The content output unit 109 superimposes the auxiliary data generated by the auxiliary data control unit 111 on an AUX signal of DisplayPort standard, a CEC signal of HDMI standard, and the like, and outputs the superimposed data to the display device 120. Here, the AUX signal, the CEC signal, etc. are auxiliary signals for device control by bi-directional communication between devices. The content output unit 109 acquires an AUX signal, a CEC signal, and the like from the display device 120. Data of the performance or state of the display device 120, control data for controlling the information processing device 100, and the like are superimposed as auxiliary data on the AUX signal, CEC signal, etc. obtained from the display device 120.

  The EDID analysis unit 110 acquires auxiliary display identification data (EDID) from the display device 120 via the content output unit 109. Then, the EDID analysis unit 110 analyzes the acquired EDID. The EDID includes display performance information on display luminance that can be realized by the display device 120. The display performance information indicates, for example, peak luminance that can be realized by the display device 120, whether the display device 120 supports HDR, and the like, and is recorded in advance in the EDID ROM of the display device 120. The EDID analysis unit 110 outputs the display brightness performance information included in the acquired EDID to the tone map control unit 105.

  The auxiliary data control unit 111 generates auxiliary data to be output to the display device 120, analyzes auxiliary data output from the display device 120, and the like. For example, the auxiliary data control unit 111 generates control data for controlling the display device 120 as auxiliary data. The auxiliary data control unit 111 outputs the generated auxiliary data to the display device 120 via the content output unit 109. The auxiliary data control unit 111 acquires auxiliary data output from the display device 120 from the display device 120 via the content output unit 109.

  The display device 120 includes a content acquisition unit 121, an EDID ROM 122, a tone map processing unit 123, an image processing unit 124, a display unit 125, an image quality adjustment operation unit 126, an image quality adjustment determination unit 127, and an auxiliary data control unit 132.

  The content acquisition unit 121 acquires screen data and tone map control information output from the information processing apparatus 100, outputs the screen data to the tone map processing unit 123, and the tone map processing unit 123 and the image quality adjustment. It is output to the determination unit 127. The content acquisition unit 121 acquires an AUX signal, a CEC signal, and the like from the information processing apparatus 100. The content acquisition unit 121 superimposes the auxiliary data generated by the auxiliary data control unit 132 on the AUX signal, the CEC signal, and the like, and outputs the auxiliary data to the information processing apparatus 100. Similar to the content acquisition unit 101, the content acquisition unit 121 may have a decoding function.

  The EDID ROM 122 is a ROM in which the display performance information described above is recorded in advance.

  The tone map processing unit 123 performs tone map processing for converting each tone value of the screen data output from the content acquisition unit 121 using the tone map function according to the tone map control information output from the content acquisition unit 121. Do. Then, the tone map processing unit 123 outputs tone map data, which is screen data after tone map processing, to the image processing unit 124. When the content acquisition unit 121 does not acquire tone map control information, the tone map processing unit 123 performs tone map processing using a tone map function set in advance for the display device 120. The preset tone map function is, for example, a tone map function conforming to ST2084, a tone map function unique to the display apparatus 120, or the like. The preset tone map function may be a tone map function that does not conform to the intention of the creator of the image data to be displayed.

  The image processing unit 124 can execute image processing different from tone map processing as image processing for converting each tone value of image data. The image processing of the image processing unit 124 includes, for example, at least one of contrast adjustment processing, brightness adjustment processing, color adjustment processing, color temperature adjustment processing, gain adjustment processing, and gamma conversion processing. The image processing unit 124 performs image processing on the tone map data output from the tone map processing unit 123 as necessary. When the image processing of the image processing unit 124 is performed, the image processing unit 124 outputs the tone map data after the image processing to the display unit 125 as display data. When the image processing of the image processing unit 124 is not performed, the image processing unit 124 outputs the tone map data output from the tone map processing unit 123 to the display unit 125 as display data.

The display unit 125 displays a screen (image) based on the display data output from the image processing unit 124 on the display surface. The display unit 125 is, for example, a liquid crystal panel, an organic EL (Electro
Luminescence) panel, etc.

  The image quality adjustment operation unit 126 receives a user operation (image quality adjustment operation) for adjusting the image quality of the image displayed on the display unit 125, and outputs operation information according to the user operation to the image quality adjustment determination unit 127. When the display device 120 is a PC monitor, generally, an operation unit (button group) which is the image quality adjustment operation unit 126 is provided in the lower part of the bezel surrounding the display surface.

The image quality adjustment determination unit 127 determines whether to reflect operation information output from the image quality adjustment operation unit 126 in tone map processing of the tone map processing unit 123 or in image processing of the image processing unit 124. When tone map processing according to the tone map control information is performed, if the operation information is reflected in the tone map processing, the intention of the producer of the image data to be displayed is adjusted as the image quality adjustment according to the image quality adjustment operation. Image quality adjustment can be realized along with. However, the display device 120 can not reflect the operation information in tone map processing. Therefore, in the present embodiment, the information processing apparatus 100 reflects the operation information in the tone map processing by reflecting the operation information in the tone map function as necessary. Details of the processing of the image quality adjustment determination unit 127 will be described later. Note that the image quality adjustment determination unit 127 may be configured by hardware or may be configured by software.

  The auxiliary data control unit 132 performs analysis of auxiliary data output from the information processing apparatus 100, generation of auxiliary data to be output to the information processing apparatus 100, and the like. The auxiliary data control unit 132 outputs the generated auxiliary data to the information processing apparatus 100 via the content acquisition unit 121. The auxiliary data control unit 132 acquires auxiliary data output from the information processing apparatus 100 from the information processing apparatus 100 via the content acquisition unit 121.

  An exemplary process flow of the tone map control unit 105 of the information processing apparatus 100 will be described. The tone map control unit 105 includes a peak luminance determination unit 106, a tone map determination unit 107, and an image quality adjustment parameter detection unit 108. FIG. 2 is a flowchart showing an example of a process flow of the tone map control unit 105. When the content acquisition unit 101 acquires HDR image data, the processing flow of FIG. 2 is started.

  In step S201, the peak luminance determination unit 106 determines, according to the tone map luminance information output from the metadata analysis unit 102, the first peak luminance that is the peak luminance in the tone map function. For example, when the tone map luminance information indicates a peak luminance, the peak luminance is determined as the first peak luminance.

  In step S202, the tone map determination unit 107 generates first tone map control information in accordance with the first peak luminance determined in step S201. The first tone map control information is tone map control information for setting a tone map function (first tone map function) whose peak luminance is equal to the first peak luminance. If the tone map luminance information indicates a toe map function, step S201 may be omitted. Then, the tone map determination unit 107 may generate tone map control as first tone map control information in order to set the tone map function indicated by the tone map luminance information according to the tone map luminance information.

  In step S203, tone map determination section 107 outputs the first tone map control information determined in step S202 to content output section 109. The first tone map control information output from the tone map determination unit 107 is output from the content output unit 109 to the display device 120.

  In step S204, the image quality adjustment parameter detection unit 108 waits for the image quality adjustment parameter output from the auxiliary data control unit 111. The image quality adjustment parameter is a parameter for adjusting each gradation value of the image data, and is generated in response to the image quality adjustment operation on the display device 120. The image quality adjustment parameter may be output from the display device 120 to the information processing apparatus 100 as auxiliary data superimposed on an AUX signal, a CEC signal, and the like. When the image quality adjustment parameter detection unit 108 acquires (detects) the image quality adjustment parameter, the process proceeds to step S205. The image quality adjustment parameter may be transmitted without being superimposed on an AUX signal, a CEC signal, or the like.

In step S205, the peak luminance determination unit 106 determines whether the tone map luminance information output from the metadata analysis unit 102 includes display control information. The display control information indicates that the display method (use of the first tone map function) of the image data is determined by the image creator, and that the image quality adjustment not conforming to the display method is not permitted. The display control information can also be referred to as “information for controlling the display method in a method according to the intention of the image creator”. If it is determined that the display control information is included, the process proceeds to step S206. If it is determined that the display control information is not added, the process proceeds to step S209.

  In step S206, the peak luminance determination unit 106 determines the second peak luminance by adjusting the first peak luminance in accordance with the image quality adjustment parameter acquired in step S204. In step S207, the tone map determination unit 107 generates second tone map control information based on the second peak luminance determined in step S204 and the tone map luminance information output from the metadata analysis unit 102. . The second tone map control information is information for setting a tone map function (second tone map function) whose peak luminance is equal to the second peak luminance. The second tone map function is "a tone map function following the intention of the image creator (a first tone map function)", and "a tone map function obtained by adjusting the first tone map function based on the image quality adjustment parameter. And so on. In step S208, the tone map determination unit 107 outputs the second tone map control information determined in step S207 to the content output unit 109, and the processing flow is ended. The second tone map control information output from the tone map determination unit 107 is output from the content output unit 109 to the display device 120.

  In step S209, the peak luminance determination unit 106 determines that it is not necessary to adjust the tone map function based on the image quality adjustment parameter, outputs the image quality adjustment authority to the content output unit 109, and the processing flow ends. . The image quality adjustment authority output from the tone map determination unit 107 is output from the content output unit 109 to the display device 120. When the display device 120 acquires the image quality adjustment authority, the image processing unit 124 performs image processing using the image quality adjustment parameter.

  An exemplary process flow of the image quality adjustment determination unit 127 will be described. The image quality adjustment determination unit 127 includes an image quality adjustment parameter determination unit 128, an HDR image detection unit 129, an image quality adjustment restriction unit 130, and an image quality adjustment parameter transmission determination unit 131. FIG. 3 is a flowchart showing an example of a process flow of the image quality adjustment determination unit 127. When the content acquisition unit 121 acquires screen data and tone map control information from the information processing apparatus 100, the processing flow of FIG. 3 is started.

  In step S301, the image quality adjustment parameter determination unit 128 waits for operation information output from the image quality adjustment operation unit 126. That is, the image quality adjustment parameter determination unit 128 waits for the image quality adjustment operation using the image quality adjustment operation unit 126. When the image quality adjustment parameter determination unit 128 acquires (detects) operation information, the process proceeds to step S302.

  In step S302, the image quality adjustment parameter determination unit 128 determines (acquires) the image quality adjustment parameter according to the operation information acquired in S301, and outputs the determined image quality adjustment parameter to the image quality adjustment restriction unit 130.

  In step S303, the HDR image detection unit 129 detects an HDR image from the image (screen based on the acquired screen data) displayed on the display unit 125, and outputs the detection result to the image quality adjustment limiting unit 130. That is, the HDR image detection unit 129 determines whether the HDR image is arranged on the screen. In the present embodiment, the HDR image detection unit 129 detects an HDR image based on the acquired tone map control information (metadata added to the screen data). For example, the HDR image detection unit 129 detects an image displayed at a luminance such as 100 nit or more as an HDR image, or displays an area displayed at a luminance such as 100 nit or more as a region of the HDR image (high luminance display area) Or as

Note that the detection method of step S303 is not limited to the above method. For example, the display device 120 includes a feature amount acquisition unit that acquires feature amounts of screen data from the screen data, and the HDR image detection unit 129 generates an HDR image based on the feature amounts acquired by the feature amount acquisition unit. It may be detected. When the display device 120 is a transmissive display device including a light emitting unit and a display unit that displays an image by transmitting light emitted from the light emitting unit based on image data, the light emission luminance of the light emitting unit The HDR image may be detected based on a control value that controls. The transmissive display device is a liquid crystal display device or the like having a backlight portion and a liquid crystal panel. When the display device 120 is a self-luminous display device, an HDR image may be detected based on a control value for controlling the light emission luminance of the display element. The self-luminous display device is an organic EL display device, a plasma display device, or the like. The HDR image may be detected based on two or more of the metadata, the feature amount, the control value of the light emitting unit, and the control value of the display device.

  In step S304, the image quality adjustment limiting unit 130 analyzes the detection result in step S303, and determines whether an HDR image is arranged on the screen. If it is determined that the HDR image is arranged, the process proceeds to step S305. If it is determined that the HDR image is not arranged, the processing flow is ended. In this case, the image processing unit 124 performs image processing using the image quality adjustment parameter.

  In step S305, the image quality adjustment limiting unit 130 stops (prohibits) the execution of the image processing performed by the image processing unit 124. As a result, the image processing unit 124 outputs tone map data as display data without performing image processing using the image quality adjustment parameter.

  In step S306, the image quality adjustment parameter transmission determination unit 131 determines to output the image quality adjustment parameter to the information processing apparatus 100. If it is determined that the image quality adjustment parameter is to be output to the information processing apparatus 100, the auxiliary data control unit 132 generates auxiliary data including the image quality adjustment parameter, and outputs the auxiliary data to the content acquisition unit 121. Then, the content acquisition unit 121 superimposes the auxiliary data including the image quality adjustment parameter on the AUX signal, the CEC signal, and the like, and outputs the auxiliary data to the information processing apparatus 100. If it is determined in step S304 that no HDR image is arranged on the screen, the image quality adjustment parameter transmission determining unit 131 determines that the image quality adjustment parameter is not to be output to the information processing apparatus 100, and the image quality adjustment parameter is It is not output to the information processing device.

  In step S307, the image quality adjustment limiting unit 130 waits for the image quality adjustment authority. The process returns to step S301 until the image quality adjustment limiting unit 130 acquires (detects) the image quality adjustment authority. In this case, the screen includes an image to be displayed in accordance with the intention of the image creator, and the tone map processing unit 123 executes the second tone map control information output in step S208 of FIG. Perform tone map processing. When the image quality adjustment limiting unit 130 acquires the image quality adjustment authority, the process proceeds to step S308. When the process of step S 209 in FIG. 2 is performed, the content acquisition unit 121 acquires the image quality adjustment authority from the information processing apparatus 100 and outputs the image quality adjustment authority to the auxiliary data control unit 132. Then, the auxiliary data control unit 132 outputs the image quality adjustment authority to the image quality adjustment limiting unit 130.

  In step S308, the image quality adjustment limiting unit 130 cancels the suspension of the image processing performed by the image processing unit 124, and the processing flow is ended. Thus, the image processing unit 124 performs image processing using the image quality adjustment parameter.

  The difference between the case where the image quality adjustment parameter is reflected in tone map processing of the tone map processing unit 123 and the case where the image quality adjustment parameter is reflected in image processing of the image processing unit 124 will be described. FIGS. 4A to 4E show an example of the correspondence between the gradation value of the screen data and the display luminance realized by the display device 120. FIG. In FIGS. 4A to 4E, the vertical axis represents the display luminance realized by the display device 120, and the horizontal axis represents the gradation value of the screen data. FIGS. 4A to 4E show an example in the case where an HDR image is arranged on the screen.

  FIG. 4A shows the correspondence before the image quality adjustment operation is performed. Before the image quality adjustment operation is performed, the tone map processing unit 123 performs tone map processing in accordance with the first tone map control information output in step S203 of FIG. Then, tone map data is used as display data. Therefore, the correspondence in FIG. 4A is also the correspondence of the first tone map function intended by the creator of the HDR image. In the correspondence in FIG. 4A, display luminances 0 to 2000 are allocated to the gradation values 0 to 1023.

  FIGS. 4B to 4E show the correspondence after the image quality adjustment operation for reducing the peak luminance realized by the display device 120 from 2000 nit to 1500 nit is performed. In the correspondence relationships of FIGS. 4B to 4E, the display luminance of 0 to 1500 nit is assigned to the gradation values of 0 to 1023.

  When the image quality adjustment parameter is reflected in the image processing of the image processing unit 124 because the image processing of the image processing unit 124 is simpler than that of the tone map processing of the tone map processing unit 123, as shown in FIG. The correspondence between B) and 4 (C) is realized. In the correspondence in FIG. 4B, the display luminance increases linearly from 0 nit to 1500 nit as the tone value increases from 0 to 1023. The correspondence in FIG. 4B is obtained by reducing the slope of the correspondence in FIG. 4A. Adjustment from the correspondence in FIG. 4A to the correspondence in FIG. 4B is so-called contrast adjustment, and when the adjustment is performed, the peak luminance decreases, but the display color (the color of the display surface) is It will change. The correspondence in FIG. 4C is obtained by uniformly reducing the display luminance while maintaining the slope of the correspondence in FIG. 4A. The adjustment from the correspondence in FIG. 4A to the correspondence in FIG. 4C is so-called brightness adjustment, and when the adjustment is performed, only one display luminance is assigned to the gradation range of the dark part. Well, I can not express the details of the dark part. And the correspondence of FIG. 4 (B) and (C) is not the correspondence along the intention (The correspondence of FIG. 4 (A); 1st tone map function) of the maker of a HDR image.

  On the other hand, when the image quality adjustment parameter is reflected in the tone map processing of the tone map processing unit 123, the correspondence between FIGS. 4D and 4E is realized. The correspondence in FIG. 4D matches the correspondence in FIG. 4A in the display luminance range of 1500 nit or less. The correspondence in FIG. 4D is obtained by limiting (clipping) the display luminance higher than 1500 nit to 1500 nit. If adjustment to the correspondence shown in FIG. 4D is performed based on the correspondence shown in FIG. 4A, the peak luminance can be lowered without changing the display color. In the correspondence in FIG. 4E, the display luminance increases nonlinearly from 0 nit to 1500 nit as the gradation value increases from 0 to 1023. In the correspondence relationship of FIG. 4E, since a plurality of display luminances are assigned to the gradation range of the dark part, details of the dark part can be expressed.

  In this embodiment, when there is display control information of an HDR image, the tone map processing unit 123 performs tone map processing according to the second tone map control information, and the image processing unit 124 outputs tone map data as display data ((1) Figures 2 and 3). Therefore, the correspondences in FIGS. 4 (D) and 4 (E) are also the correspondences of the second tone map function according to the intention of the creator of the HDR image. The second tone map function (second tone map control information) is determined by the peak luminance determination unit 106. For example, the determination method of the tone map function is described in the tone map luminance information, and the peak luminance determination unit 106 determines the correspondence in FIG. 4 (D) or the correspondence in FIG. 4 (E) according to the determination method. Determined as a two tone map function.

As described above, according to the present embodiment, when the HDR image (specific image) is arranged on the screen, the image quality adjustment parameter is output from the display device 120 to the information processing apparatus 100. Then, the tone map function corresponding to the HDR image is determined based on the image quality adjustment parameter by the information processing apparatus 100, and the display device 120 performs tone map processing using the tone map function. By these, it is possible to preferably perform the image quality adjustment in accordance with the intention of the image creator according to the image quality adjustment operation on the display device.

  In the method described above, tone map processing is performed on the entire screen. That is, tone map processing may be applied to areas other than the area of the HDR image. However, the user may want to adjust only the image quality of the HDR image. Therefore, it is preferable that the information processing apparatus 100 or the display device 120 cause the user to designate at least a partial area of the screen, and only the gradation value corresponding to the area designated by the user is converted in the tone map processing.

  FIG. 5 shows an example of a screen displayed on the display device 120. In the screen 600, the layout unit 104 arranges and displays a text creation window 601 which is a window of text creation software and an HDR display window 602 which is a window of HDR image display software. Here, the peak luminance of the sentence creation window 601 is 100 nit, and the peak luminance of the HDR display window 602 is 2000 nit.

  According to the processing flows of FIGS. 2 and 3, according to the image quality adjustment operation on the image quality adjustment operation unit 126, tone map processing using the second tone map function as shown in FIGS. 4 (D) and 4 (E) is performed. The display brightness of the entire screen 600 is changed. In this case, an OSD (On-Screen Display) image 603 indicating information on the image quality adjustment parameter is superimposed on the screen 600 and displayed, and the user performs the image quality adjustment operation while checking the OSD image 603.

  Here, the user may want to adjust only the display luminance of the HDR display window 602. However, in the processing flows of FIGS. 2 and 3, the display luminance of the entire screen 600 is changed, so the display luminance of the sentence creation window 601 may be changed, and the visibility of the sentence creation window 601 may be impaired.

  An exemplary process flow for solving such a problem will be described. FIGS. 6A and 6B are flowcharts showing an example of a processing flow for solving the above-mentioned problem. FIG. 6A shows an example of the process flow of the information processing apparatus 100, and FIG. 6B shows an example of the process flow of the display apparatus 120.

  The process flow (FIG. 6A) of the information processing apparatus 100 will be described. When the image quality adjustment parameter detection unit 108 acquires the image quality adjustment parameter in step S204 in FIG. 2, the process proceeds to step S2041 in FIG.

  In step S 2041, the tone map control unit 105 displays the HDR display area in which the HDR image is displayed based on the layout information output from the layout unit 104 and the tone map luminance information output from the metadata analysis unit 102. Determine the presence or absence of If it is determined that there is an HDR display area, the process proceeds to step S2042, and if it is determined that there is no HDR display area, the process proceeds to step S209 in FIG.

  In step S 2042, the OSD control unit (not shown) generates OSD control information, and outputs the generated OSD control information to the display device 120 via the auxiliary data control unit 111 and the content output unit 109. The OSD control information includes a display instruction of the OSD image 603 of FIG. 5, a display instruction of the OSD image 604 for causing the user to specify the window of the image quality adjustment target, and the like. The OSD control information is output to the display device 120 as auxiliary data superimposed on an AUX signal, a CEC signal, and the like.

At step S2043, tone map control section 105 receives area information (AUX signal, CE).
Wait for the auxiliary data superimposed on the C signal, etc.). When the tone map control unit 105 acquires area information from the display device 120 via the content output unit 109 and the auxiliary data control unit 111, the process proceeds to step S205 in FIG. The area information indicates the area of the window designated by the user as the image quality adjustment target.

  The process flow (FIG. 6B) of the display device 120 will be described. After step S305 in FIG. 3, the process proceeds to step S3051 in FIG.

  In step S3051, an OSD generation unit (not shown) waits for OSD control information output from the information processing apparatus 100. When the OSD generation unit acquires OSD control information from the information processing apparatus 100 via the content acquisition unit 121 and the auxiliary data control unit 132, the process proceeds to step S3052.

  In step S3052, the OSD generation unit generates the OSD image 603, the OSD image 604, and the like according to the OSD control information acquired in step S3051. The generated OSD image is displayed on the display unit 125. For example, the display of the display unit 125 transitions from the screen 600 of FIG. 5 to the screen 605. In the screen 605, the OSD image 603 and the OSD image 604 are superimposed on the screen 600. The user can specify a window to be subjected to image quality adjustment using the OSD image 604. In the screen 605, the HDR display window 602 is designated as an image quality adjustment target. When the window targeted for image quality adjustment is designated by the user, the tone map processing unit 123 converts only the gradation value corresponding to the window targeted for image quality adjustment by tone map processing.

  Note that the OSD image 606 may be displayed instead of the OSD image 603. In the OSD image 606, the item 606-1 of image quality adjustment (brightness adjustment) performed by the image processing unit 124 is grayed out and the item 606-2 of image quality adjustment (HDR adjustment) performed by the tone map processing unit 123 is displayed. It is displayed valid. That is, in the OSD image 606, it is clearly indicated that the HDR adjustment is to be performed. Therefore, the user can grasp that the HDR adjustment is performed by confirming the OSD image 606.

  In addition, an OSD image including a plurality of toggle buttons corresponding to a plurality of areas may be displayed as an OSD image for causing the user to specify an area to be subjected to image quality adjustment. For example, an OSD image including a sentence creation window 601, an HDR display window 602, and three toggle buttons respectively corresponding to the entire screen may be displayed. Then, an area (an area of a window, an area of the entire screen, or the like) corresponding to the pressed button may be determined as an image quality adjustment target.

  In step S <b> 3053, the user uses the operation unit (not shown) of the display device 120 to designate a window as an image quality adjustment target.

  In step S3054, the OSD generation unit generates area information indicating the area of the window specified in step S3053, and the generated area information is transferred to the information processing apparatus 100 via the auxiliary data control unit 132 and the content acquisition unit 121. Output to

  A first operation unit for tone map processing performed by the tone map processing unit 123 and a second operation unit for image quality adjustment performed by the image processing unit 124 are separately provided in the display device 120. It is also good. In such a configuration, when the image to be displayed according to the intention of the image creator is arranged on the screen, the user operation using the second operation unit is invalidated, and the first operation unit is used. User operation becomes effective.

Example 2
Hereinafter, Example 2 of the present invention will be described. In this embodiment, an example in which the display device has the function of the information processing apparatus of the first embodiment will be described. In the following, the points (structure and processing) different from the first embodiment will be described in detail, and the description of the same points as the first embodiment will be omitted.

  FIG. 7 is a schematic view showing a configuration example of a display device 800 according to the present embodiment. In FIG. 7, the same functional units as in the first embodiment (FIG. 1) are denoted by the same reference numerals as those in the first embodiment. The display device 800 is a smartphone, a tablet terminal, a notebook PC, or the like. In the present embodiment, the display unit 125 is a display unit capable of receiving a touch operation on the display surface, and includes the operation unit 103.

  The communication unit 801 has substantially the same function as the content acquisition unit 101 of the first embodiment. In the present embodiment, the communication unit 801 communicates with the cloud 200, acquires image data from the cloud 200, and requests the cloud 200 for processing. Device information of the display device 800 (display unit 125) is recorded in advance in the device information storage unit 802. In the present embodiment, it is assumed that information indicating the type of the display device 800 (display unit 125) is recorded in advance as device information. Examples of the type of the display unit 125 include a liquid crystal panel, an OLED (Organic Light Emitting Diode) panel (organic EL panel), and the like. Similarly, as the type of the display device 800, there are a liquid crystal display device, an organic EL display device, and the like. The light sensor 803 detects external light to the display device 800. In the present embodiment, the light sensor 803 detects the illuminance of external light and outputs a detected value (illuminance value) to the tone map control unit 806. The battery 804 is a power source for driving the display device 800, and is a lithium ion battery or the like. The battery remaining amount monitoring unit 805 detects (monitors) the battery remaining amount of the battery 804, and outputs a detection value (battery remaining amount value) to the tone map control unit 806.

  The tone map control unit 806 has substantially the same function as the tone map control unit 105 of the first embodiment. However, the tone map control unit 806 further considers the device information recorded in the device information storage unit 802, the illuminance value obtained by the light sensor 803, and the battery remaining amount value obtained by the battery remaining amount monitoring unit 805. And determine the tone map function. Specifically, as adjustment of the tone map function, the tone map control unit 806 performs not only adjustment according to the adjustment parameter but also adjustment according to the device information, the illuminance value, and the remaining battery value. The adjustment of the tone map function according to the adjustment parameter may be performed only when the user pays the predetermined amount of cost.

  8A-8C show an example of the tone map function determined by the tone map control unit 806. FIG. The change of the tone map function according to the device information recorded in the device information storage unit 802 will be described. For example, when the display unit 125 is a liquid crystal panel, the tone map control unit 806 determines the tone map function of FIG. 8A. On the other hand, when the display unit 125 is an OLED panel, the tone map control unit 806 determines the tone map function of FIG. 8B. In the OLED panel, black floating is suppressed and details (tones) of the dark part can be expressed with high accuracy as compared with the liquid crystal panel. Therefore, in the tone map function of FIG. 8B, the display luminance range corresponding to the gradation range of the dark part is lower and narrower than that of the tone map function of FIG. 8A. In other words, in the tone map function of FIG. 8B, the number of gradation values assigned to the low display luminance range is larger than that of the tone map function of FIG. 8A. By changing the tone map function according to the type of display device 800 (display unit 125), the user can view the HDR image at an appropriate display luminance according to the type of display device 800.

The change of the tone map function according to the illuminance value obtained by the light sensor 803 will be described. The tone map control unit 806 changes the peak brightness of the tone map function according to the illuminance value. FIG. 9A shows an example of the correspondence between the illuminance of ambient light and the peak luminance of the tone map function. The vertical axis in FIG. 9A indicates peak luminance (nit). The horizontal axis of FIG. 9 (A) indicates illuminance (lx), which is a logarithmic scale. For example, in the case of an illuminance of 100 lx, the tone map control unit 806 determines a peak luminance of 500 nit. Then, the tone map control unit 806 adjusts the toe map function according to the peak luminance 500 nit. For example, when the display unit 125 is an OLED panel, the tone map control unit 806 adjusts the tone map function of FIG. 8B to the tone map function of FIG. 8C. In the toe map function of FIG. 8C, display luminances 0 to 500 nit are assigned to the gradation values 0 to 1023. By changing the tone map function in accordance with the illuminance of the external light, the user can view the HDR image at an appropriate display luminance according to the viewing environment.

  The change of the tone map function according to the battery remaining amount value obtained by the battery remaining amount observing unit 805 will be described. The tone map control unit 806 changes the peak brightness of the tone map function according to the battery remaining amount value. FIG. 9B shows an example of the correspondence between the remaining battery level of the battery 804 and the peak luminance of the tone map function. The vertical axis in FIG. 9 (B) indicates the peak luminance (nit), and the horizontal axis in FIG. 9 (B) indicates the battery remaining amount (%). For example, if the battery remaining amount is 70%, the tone map control unit 806 determines a peak luminance of 500 nit. Then, the tone map control unit 806 adjusts the toe map function according to the peak luminance 500 nit. By changing the tone map function according to the battery remaining amount, the user can view the HDR image at an appropriate display luminance according to the state of the display device 800.

  As described above, according to this embodiment, the same effect as that of the first embodiment can be obtained by the same function as that of the first embodiment. Furthermore, according to the present embodiment, the tone map function is determined in consideration of the type of the display device 800, the external light to the display device 800, the remaining amount of the battery of the display device 800, and the like. As a result, the user can view the HDR image at an appropriate display luminance according to the use state (environment and state) of the display device 800.

  In addition, the change of the tone map function according to the device information, the change of the tone map function according to the ambient light, and the change of the tone map function according to the remaining battery capacity may be individually performed. It does not have to be. Two or more of these three changes may be realized by one change. At least one of these three changes may not be made.

  The timing at which the change of the tone map function according to the device information, the change of the tone map function according to the ambient light, the change of the tone map function according to the remaining battery capacity, etc. is not particularly limited. For example, these changes may be performed at the timing when the display of the HDR image is started, the scene is switched, or the like. The tone map function may be changed when the difference between the tone map function before the change and the tone map function after the change becomes equal to or greater than a predetermined threshold.

  The tone map control unit 806 may be provided in the cloud 200. Then, the display device 800 outputs information (adjustment parameter, device information, illuminance, battery remaining amount, etc.) necessary for determining the tone map function to the cloud 200, and the tone map function determined by the tone map control unit 806. May be obtained from the cloud 200.

Example 3
Hereinafter, Example 2 of the present invention will be described. In the present embodiment, control of image quality adjustment based on the image quality adjustment parameter is performed from control by the display device to information processing from the control by the display device at the timing when the state of the information processing apparatus becomes a specific state capable of outputting HDR image data to the display An example of switching to control by the device will be described. In the following, the points (structure and processing) different from the first embodiment will be described in detail, and the description of the same points as the first embodiment will be omitted.

  FIG. 10 is a schematic view showing a configuration example of a display system according to the present embodiment. In FIG. 10, the same functional units as those of the first embodiment (FIG. 1) are denoted by the same reference numerals as those of the first embodiment. The display system according to the present embodiment includes an information processing device 1200 and a display device 1220.

  The functional units of the information processing apparatus 1200 will be described. The HDR preparation completion detection unit 1201 detects that the state of the information processing apparatus 1200 is in the HDR preparation completion state (specific state) in which HDR image data can be output. Then, in response to detection of the HDR preparation completion state, the HDR preparation completion detection unit 1201 outputs an HDR preparation completion signal to the image quality adjustment authority request unit 1202.

  In the present embodiment, the HDR preparation completion detection unit 1201 checks the state of the layout unit 104 to determine the activation state of an OS (Operating System) or an application (not shown) that controls the process of the layout unit 104. Then, the HDR preparation completion detection unit 1201 determines whether the state of the information processing apparatus 1200 has reached the HDR preparation completion state according to the determination result of the activation state of the OS or the application. Specifically, the HDR preparation completion detection unit 1201 determines that the state of the information processing apparatus 1200 is in the HDR preparation completion state when the activation of the OS or the application that controls the process of the layout unit 104 is completed.

  When the image quality adjustment authority request unit 1202 receives the HDR preparation completion signal from the HDR preparation completion detection unit 1201, the image quality adjustment authority request signal, which is an instruction signal for stopping the image processing by the image processing unit 124 of the display device 1220, Output to data control unit 1203.

  The auxiliary data control unit 1203 has the same function as the auxiliary data control unit 111 of the first embodiment. Furthermore, when the image quality adjustment authority request signal is output from the image quality adjustment authority request unit 1202, the auxiliary data control unit 1203 generates auxiliary data including the image quality adjustment authority request signal. The image quality adjustment authority request signal (auxiliary data) is superimposed on the AUX signal, the CEC signal, and the like, and is output from the content output unit 109 to the display device 1220. As a result, the execution of the image processing by the image processing unit 124 is stopped, and the image quality adjustment parameter is sent from the display device 1220 to the information processing device 1200.

  The functional units of the display device 1220 will be described. The auxiliary data control unit 1221 has the same function as the auxiliary data control unit 132 of the first embodiment. Further, when the auxiliary data output from the information processing apparatus 100 includes the image quality adjustment authority request signal, the auxiliary data control unit 1221 outputs the image quality adjustment authority request signal to the image quality adjustment determination unit 1222.

  The image quality adjustment determination unit 1222 has the same function as the image quality adjustment determination unit 127 of the first embodiment. However, when the image quality adjustment authorization request signal is output from the auxiliary data control unit 1221, the image quality adjustment determination unit 1222 determines that the image quality adjustment parameter is to be reflected in the tone map processing of the tone map processing unit 123. If not, the image quality adjustment determination unit 1222 determines that the image quality adjustment parameter is to be reflected in the image processing of the image processing unit 124. The execution of the image processing performed by the image processing unit 124 is stopped (prohibited).

The image quality adjustment limiting unit 1223 has the same function as the image quality adjustment limiting unit 130 of the first embodiment. However, when the image quality adjustment authority request signal is output from the auxiliary data control unit 1221, the image quality adjustment limiting unit 1223 stops (prohibits) the execution of the image processing performed by the image processing unit 124. As a result, the execution of the image processing by the image processing unit 124 is stopped, and the image quality adjustment parameter is sent from the display device 1220 to the information processing device 1200. If not, the image quality adjustment parameter is not sent from the display device 1220 to the information processing apparatus 1200, and the image processing unit 124 performs image processing using the image quality adjustment parameter.

  An exemplary process flow of initialization of the information processing apparatus 1200 will be described. FIG. 11A is a flowchart illustrating an exemplary processing flow of initialization of the information processing apparatus 1200. The processing flow of FIG. 11A is started when the power of the information processing apparatus 1200 is turned on. It is assumed that the EDID information of the display device 1220 is acquired in advance.

  In step S1301, the BIOS (Basic Input / Output System) of the information processing apparatus 1200 is activated. The BIOS is a computer program that reads the OS at startup, performs basic input / output control to connected devices and devices, and the like, and is stored in a main board or the like.

  In step S1302, the HDR preparation completion detection unit 1201 waits for the completion of activation of the OS of the information processing apparatus 1200. When the activation of the OS of the information processing apparatus 1200 is completed, the process proceeds to step S1303. In the present embodiment, the state in which the activation of the OS of the information processing apparatus 1200 is completed is referred to as the HDR preparation completion state, but the HDR preparation completion state is not limited to this. For example, the state in which the start of the HDR image display software (application for displaying the HDR image) operating on the OS is completed may be set as the HDR preparation completion state.

  In step S1303, the EDID analysis unit 110 determines whether the display device 1220 supports HDR based on EDID (display performance information of the display device 1220) acquired in advance. That is, the EDID analysis unit 110 determines whether the display device 1220 can display HDR image data in HDR. If it is determined that the display device 1220 supports HDR, the process proceeds to step S1304, and if it is determined that the display device 1220 does not support HDR, the processing flow ends.

  In step S1304, the image quality adjustment authority request unit 1202 outputs an image quality adjustment authority request signal to the display device 1220 via the auxiliary data control unit 1203 and the content output unit 109. Then, the process flow is ended.

  When the process flow of FIG. 11A ends, the process flow of FIG. 2 is performed. However, the processing of steps S205 and S209 is omitted.

  A process flow example of initialization of the display device 1220 will be described. FIG. 11B is a flowchart showing an example of a process flow of initialization of the display device 1220 (image quality adjustment determination unit 1222; image quality adjustment limitation unit 1223). The processing flow of FIG. 11B is started when the power of the information processing apparatus 1200 is turned on. It is assumed that the display device 1220 is already powered on, and the display device 1220 is waiting for image data output from the information processing device 1200.

  In step S1401, the image quality adjustment limiting unit 1223 determines whether the image quality adjustment authority request signal has been received. If the image quality adjustment authority request signal is received, the process proceeds to step S1402, and if the image quality adjustment authority request signal is not received, the process proceeds to step S1403.

  In step S1402, the image quality adjustment limiting unit 1223 stops (prohibits) the execution of the image processing performed by the image processing unit 124. As a result, the image processing unit 124 outputs tone map data as display data without performing image processing using the image quality adjustment parameter. Then, the process flow is ended.

  In step S1403, the image quality adjustment limiting unit 1223 permits execution of the image processing performed by the image processing unit 124. As a result, the image processing unit 124 performs image processing using the image quality adjustment parameter. Then, the process flow is ended.

  When the process flow of FIG. 11B ends, the process flow of FIG. 3 is performed. However, the processes of steps S303, S304, S305, S307, and S308 are omitted.

  As described above, according to the present embodiment, control of image quality adjustment based on the image quality adjustment parameter is controlled by the display device 1220 from the control by the display device 1220 at the timing when the state of the information processing device 1200 changes to the HDR ready state. It is switched to control by 1200. As a result, it is possible to shorten the time until the image quality adjustment result according to the intention of the image creator is displayed.

  The functional units in the first to third embodiments may be individual hardware or not. The functions of two or more functional units may be realized by common hardware. Each of the plurality of functions of one functional unit may be realized by separate hardware. Two or more functions of one functional unit may be realized by common hardware. Also, each functional unit may or may not be realized by hardware. For example, the device may have a processor and a memory in which a control program is stored. The functions of at least some of the functional units of the device may be realized by the processor reading and executing the control program from the memory.

  Examples 1 to 3 are merely examples, and configurations obtained by appropriately changing or changing the configurations of Examples 1 to 3 within the scope of the present invention are also included in the present invention. The configuration obtained by appropriately combining the configurations of Embodiments 1 to 3 is also included in the present invention.

<Other Embodiments>
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or storage medium, and one or more processors in a computer of the system or apparatus read and execute the program. Can also be realized. It can also be implemented by a circuit (eg, an ASIC) that implements one or more functions.

120: display device 123: tone map processing unit 126: image quality adjustment operation unit 127: image quality adjustment determination unit 128: image quality adjustment parameter determination unit 129: HDR image detection unit 1200: information processing device 105: tone map control unit 107: tone map Determination unit 108: image quality adjustment parameter detection unit 109: content output unit 1201: preparation completion detection unit 1203: auxiliary data control unit

Claims (16)

An acquiring step of acquiring an adjustment parameter for adjusting each gradation value of the image data in response to a user operation on the display device;
A determination step in which the display device determines whether or not a specific image whose maximum luminance in the luminance range is equal to or greater than a threshold is disposed in an image based on the image data;
When it is determined that the specific image is arranged, the display device converts each gradation value of the image data based on the adjustment parameter and using the gradation conversion characteristic corresponding to the specific image. A conversion step for performing gradation conversion processing;
Processing method characterized by having. The display apparatus may further include an output step of outputting the adjustment parameter to an information processing apparatus that determines the gradation conversion characteristic corresponding to the specific image based on the adjustment parameter. The treatment method described in. The processing method according to claim 2, wherein, in the output step, the adjustment parameter is output to the information processing apparatus using an AUX signal of DisplayPort standard or a CEC signal of HDMI standard. The processing method according to claim 1, further comprising: determining the gradation conversion characteristic corresponding to the specific image based on the adjustment parameter. In the determination step, it is determined whether or not the specific image is arranged based on at least one of metadata added to the image data and a feature amount of the image data. The treatment method according to any one of Items 1 to 4. And designating the display device to cause the user to designate at least a partial region of an image based on the image data.
The processing method according to any one of claims 1 to 5, wherein in the conversion step, the gradation value corresponding to the area designated by the user is converted by the gradation conversion processing. The display device can execute image processing different from the gradation conversion processing as the image processing for converting each gradation value of the image data,
7. The processing method according to claim 1, further comprising: a stop step of stopping the execution of the image processing when it is determined that the specific image is arranged. The processing method according to any one of the above. A processing method of the information processing apparatus;
Whether the state of the information processing apparatus is in a specific state where it is possible to output image data whose maximum luminance in the luminance range is equal to or greater than the threshold value to a display device that performs gradation conversion processing that converts each gradation value of image data A determination step in which the information processing apparatus determines whether or not
An acquisition step of acquiring, from the display device, adjustment parameters for adjusting each gradation value of the image data after it is determined that the state of the information processing device has become the specific state;
A determination step of determining the gradation conversion characteristic corresponding to the image data as the gradation conversion characteristic of the gradation conversion processing based on the adjustment parameter;
Processing method characterized by having. The processing method according to claim 8, wherein in the acquisition step, the adjustment parameter is acquired from the display device using an AUX signal of DisplayPort standard or a CEC signal of HDMI standard. The information processing apparatus further includes a designation step of causing a user to designate at least a partial region of an image based on the image data.
10. The processing method according to claim 8, wherein a gradation value corresponding to the area designated by the user is converted by the gradation conversion processing. The display device can execute image processing different from the gradation conversion processing as the image processing for converting each gradation value of the image data,
The processing method further includes an output step in which the information processing apparatus outputs an instruction regarding stop of execution of the image processing to the display device after it is determined that the state of the information processing apparatus is in the specific state. The processing method according to any one of claims 8 to 10, characterized in that. 12. The image processing method according to claim 7, wherein at least one of contrast adjustment processing, brightness adjustment processing, color adjustment processing, color temperature adjustment processing, gain adjustment processing, and gamma conversion processing is included. Processing method. A first detection step of the display device detecting ambient light to the display device;
A second detection step in which the display device detects a battery remaining amount of the display device;
And have
The gradation conversion characteristic is determined in consideration of at least one of a type of the display device, a detection result of the first detection step, and a detection result of the second detection step. The processing method of any one of 1-12. Acquisition means for acquiring adjustment parameters for adjusting each tone value of the image data in accordance with user operation;
Determining means for determining whether or not a specific image having the maximum luminance of the luminance range equal to or greater than a threshold is disposed in the image based on the image data;
A tone conversion process of converting each tone value of the image data based on the adjustment parameter and using the tone conversion characteristic corresponding to the specific image when it is determined that the specific image is arranged Conversion means to perform
A display device characterized by having. An information processing apparatus,
Whether the state of the information processing apparatus is in a specific state where it is possible to output image data whose maximum luminance in the luminance range is equal to or greater than the threshold value to a display device that performs gradation conversion processing that converts each gradation value of image data Judging means for judging whether or not
An acquisition unit configured to acquire, from the display device, adjustment parameters for adjusting each gradation value of the image data after it is determined that the state of the information processing apparatus is in the specific state;
Determining means for determining tone conversion characteristics of the tone conversion processing based on the adjustment parameter;
An information processing apparatus comprising: The program for making a computer perform each step of the processing method of any one of Claims 1-13.

Images