WO2017051612A1 - 画像処理装置及び画像処理方法 - Google Patents
画像処理装置及び画像処理方法 Download PDFInfo
- Publication number
- WO2017051612A1 WO2017051612A1 PCT/JP2016/072691 JP2016072691W WO2017051612A1 WO 2017051612 A1 WO2017051612 A1 WO 2017051612A1 JP 2016072691 W JP2016072691 W JP 2016072691W WO 2017051612 A1 WO2017051612 A1 WO 2017051612A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- display
- signal
- luminance level
- image processing
- conversion
- Prior art date
Links
- 238000012545 processing Methods 0.000 title claims abstract description 139
- 238000003672 processing method Methods 0.000 title claims description 8
- 238000006243 chemical reaction Methods 0.000 claims abstract description 203
- 238000000034 method Methods 0.000 claims description 115
- 230000008859 change Effects 0.000 claims description 11
- 238000010606 normalization Methods 0.000 claims description 7
- 230000011664 signaling Effects 0.000 claims description 7
- 230000000153 supplemental effect Effects 0.000 claims description 6
- 230000001131 transforming effect Effects 0.000 claims description 2
- 230000008569 process Effects 0.000 description 38
- 230000006870 function Effects 0.000 description 27
- 238000012423 maintenance Methods 0.000 description 27
- 238000004891 communication Methods 0.000 description 25
- 230000015654 memory Effects 0.000 description 20
- 238000010586 diagram Methods 0.000 description 19
- 238000003384 imaging method Methods 0.000 description 18
- 230000009466 transformation Effects 0.000 description 18
- 230000005540 biological transmission Effects 0.000 description 13
- 230000005236 sound signal Effects 0.000 description 11
- 230000003287 optical effect Effects 0.000 description 9
- 238000012546 transfer Methods 0.000 description 7
- 230000000694 effects Effects 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 230000007423 decrease Effects 0.000 description 4
- 230000006978 adaptation Effects 0.000 description 3
- 238000012937 correction Methods 0.000 description 3
- 239000000284 extract Substances 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 2
- 230000014509 gene expression Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000001151 other effect Effects 0.000 description 2
- 230000008929 regeneration Effects 0.000 description 2
- 238000011069 regeneration method Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 101000882406 Staphylococcus aureus Enterotoxin type C-1 Proteins 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000001771 impaired effect Effects 0.000 description 1
- 210000003127 knee Anatomy 0.000 description 1
- 238000012886 linear function Methods 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000005693 optoelectronics Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 238000007639 printing Methods 0.000 description 1
- 230000001172 regenerating effect Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
- H04N5/20—Circuitry for controlling amplitude response
- H04N5/202—Gamma control
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/10—Intensity circuits
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/02—Improving the quality of display appearance
- G09G2320/0271—Adjustment of the gradation levels within the range of the gradation scale, e.g. by redistribution or clipping
- G09G2320/0276—Adjustment of the gradation levels within the range of the gradation scale, e.g. by redistribution or clipping for the purpose of adaptation to the characteristics of a display device, i.e. gamma correction
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/06—Adjustment of display parameters
- G09G2320/0626—Adjustment of display parameters for control of overall brightness
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/06—Adjustment of display parameters
- G09G2320/0673—Adjustment of display parameters for control of gamma adjustment, e.g. selecting another gamma curve
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2360/00—Aspects of the architecture of display systems
- G09G2360/16—Calculation or use of calculated indices related to luminance levels in display data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/741—Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/82—Camera processing pipelines; Components thereof for controlling camera response irrespective of the scene brightness, e.g. gamma correction
Definitions
- the present disclosure relates to an image processing apparatus and an image processing method.
- ITU-R International Telecommunication Union-Radio communications sector
- SDR Standard Dynamic Range
- HDR High Dynamic Range
- Application-1 is a signal system based on PQ (Perceptual Quantizer) -EOTF (Electro-Optical Transfer Function) for the purpose of expressing the absolute value of the luminance of the shooting environment (see Non-Patent Document 1). ).
- Application-2 is a signal system that expresses a relative luminance level by an HLG (Hybrid Log-Gamma) curve that combines a gamma curve at a luminance level lower than the reference white and a logarithmic curve at a luminance level higher than the reference white. (See Non-Patent Document 2).
- Up to the Application-1 can display the absolute luminance of 10,000 cd / m 2, while the relative luminance of 12 times the reference white up to the Application-2 (20-fold when using the headroom) Can be displayed.
- ITU-R Application-1 is the same method as ST2084 established by SMPTE (Society of Motion Picture and Television Engineers), which is a standardization organization different from ITU-R. There are other signal systems similar to SMPTE ST2084 (see Non-Patent Document 3).
- the peak luminance of the display is often different from the upper limit of the HDR dynamic luminance dynamic range.
- the luminance of one or more pixels included in the video signal exceeds the peak luminance of the display, so-called overexposure occurs in the reproduced video as a result of clipping. If the maximum brightness is below the peak brightness of the display, the display performance will not be fully utilized.
- One simple technique for eliminating such a range mismatch is to adjust the brightness level by multiplying gains. However, simple gain multiplication changes even the luminance level of the reference point that should be fixedly handled.
- the display brightness level of the reference white is maintained by using an image signal based on a signal system that handles the display brightness level of the reference white in a fixed manner using a parameter determined based on the peak brightness level of the display.
- an image processing apparatus includes a conversion unit that converts into a display signal by performing gamma conversion.
- an image processing method executed by an image processing apparatus wherein an image signal based on a signal method that handles a reference white display luminance level in a fixed manner is determined based on a peak luminance level of a display.
- An image processing method is provided that includes performing a gamma conversion so that the display brightness level of the reference white color is maintained using a parameter to be converted into a display signal.
- the technique according to the present disclosure it is possible to eliminate or at least reduce inconvenience related to the mismatch between the dynamic range of the HDR video signal and the peak luminance of the display.
- the above effects are not necessarily limited, and any of the effects shown in the present specification, or other effects that can be grasped from the present specification, together with or in place of the above effects. May be played.
- 11 is a flowchart showing a first example of a flow of RW maintenance gamma conversion processing shown in FIG. 10.
- 12 is a flowchart illustrating a second example of the flow of the RW maintenance gamma conversion process illustrated in FIG. 10.
- 11 is a flowchart illustrating a third example of the flow of the RW maintenance gamma conversion process illustrated in FIG. 10. It is a flowchart which shows an example of the flow of the linear transformation process shown in FIG. It is explanatory drawing for demonstrating an example of the method of recording and reproducing
- FIG. 1 is an explanatory diagram for explaining an outline of conversion characteristics of a video signal.
- an imaging device 10 a network 20, a recording device 30, and a display device 50 are shown.
- the photographing device 10 photographs a subject in a photographing environment and generates a video signal.
- the photographing apparatus 10 has an array of photoelectric conversion elements (image sensors) such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), and converts light incident from the photographing environment into an electrical signal. Convert.
- the characteristic of conversion from light to an electrical signal is modeled by an OETF (Opto-Electronic Transfer Function).
- OETF is a linear function
- the voltage level of the electrical signal is proportional to the amount of light received for each element.
- BT. which is a standard specification established by ITU-R. 709 or BT.
- the OETF of 2020 is nonlinear, for example, the overall gamma value is 0.45, and has linearity only in the low luminance region.
- the imaging device 10 transmits a video signal including a series of frame image signals and control signals to the display device 50 via the network 20 or causes the recording device 30 to record the video signal on a recording medium.
- the network 20 may be a wired communication network, a wireless communication network, or a simple connection cable.
- the recording device 30 records the video signal received from the photographing device 10 on a recording medium by a designated recording method.
- the recording medium may be a removable medium such as a BD (Blu-ray (registered trademark) disk) or a DVD (Digital Versatile Disc), or a built-in medium such as a hard disk.
- Display device 50 reproduces a video from a video signal received via network 20 or read from a recording medium. More specifically, the display device 50 has an array of display elements that convert an input electrical signal into light (for example, a liquid crystal panel, an organic light emitting diode (OLED) panel, a plasma display panel (PDP), or the like). .
- the characteristics of conversion from an electric signal to light are modeled by EOTF (Electro-Optical Transfer Function). If EOTF is an inverse function of OETF, the intensity of the displayed light is equal to the intensity of the photographed light.
- OOTF Opto-Optical Transfer Function
- OOTF is also called system gamma or total gamma.
- BT. which is a standard specification formulated by ITU-R.
- the gamma value of 1886 EOTF is 2.4.
- the upper limit of the general luminance dynamic range of the existing SDR video signal is 100 cd / m 2 (also referred to as nit).
- the upper limit of the luminance dynamic range of the HDR video signal is expanded from several hundred to several thousand cd / m 2 .
- the ITU-R is expected to add two systems, Application-1 and Application-2, as the HDR video signal signal system.
- FIG. 2 is an explanatory diagram for explaining the photoelectric transfer function of ITU-R Application-2.
- Application-2 is an HLG (Hybrid Log-Gamma) curve that combines a gamma curve at a luminance level lower than the reference white and a logarithmic curve at a luminance level higher than the reference white, and expresses a relative luminance level.
- the horizontal axis represents the light intensity E normalized so that the luminance level of the reference white is equal to 1
- the vertical axis represents the signal level E ′ of the corresponding electrical signal.
- the gamma value is equal to 0.5 in the low luminance region below the reference white, and there is no linear portion. This improves the Weber fraction in dark conditions.
- the upper limit of the luminance dynamic range is further increased.
- FIG. 3 is an explanatory diagram for explaining the OOTF of ITU-R Application-2.
- the horizontal axis represents the same normalized light intensity E as in FIG. 2, and the vertical axis represents the luminance level L (cd / m 2 ) after the inverse transformation (OETF ⁇ 1 ) is executed.
- FIG. 3 shows an example of ITU-R Application-2.
- the upper limit of the luminance dynamic range is from several hundred to several thousand cd / m 2 . Reach.
- FIG. 4 is an explanatory diagram for explaining examples of several methods for adapting the luminance dynamic range to the peak luminance of the display.
- the horizontal axis represents the normalized light intensity E
- the vertical axis represents the luminance level L.
- a graph 42 represented by an alternate long and short dash line is a result of hard clipping of the original OOTF (graph 41) with the peak luminance of the display. Such clipping causes over-exposure in a region where the light intensity E is larger than the clipping point P CLP , thereby losing image information.
- a graph 43 represented by a broken line is a result of soft clipping for giving an inclination to the OOTF in a region where the light intensity E is larger than the clipping point P CLP ′ . Although soft clipping does not cause complete overexposure, since the slope becomes discontinuous at the clipping point P CLP ′ , an unnatural image may be displayed.
- a graph 44 represented by a two-dot chain line is a result of linear conversion of the original OOTF with a constant gain.
- the luminance level corresponding to the reference white (E 1) that should be handled fixedly changes (P 1 ⁇ P 1 ′ ).
- the luminance level of the reference white changes, it becomes difficult to appropriately reproduce the brightness of the shooting environment (or the brightness that the content producer desires to show to the viewer).
- Such a linear transformation is not consistent with the purpose of, for example, ITU-R Application-2.
- FIG. 5 is a block diagram illustrating an example of the configuration of the image processing apparatus 100 according to an embodiment.
- the image processing apparatus 100 may be, for example, a photographing apparatus, a recording apparatus, or a display apparatus as shown in FIG. 1, or may be an image processing module mounted on these apparatuses.
- the image processing apparatus 100 includes an image acquisition unit 110, a conversion unit 120, and a control unit 130.
- the image acquisition unit 110 acquires an input image signal from some signal source.
- the input image signal may be an image signal of each of a series of frames constituting the video signal, or may be an image signal for a still image.
- the input image signal is based on the HDR signal system, and here, as an example, an image signal based on ITU-R Application-2 (hereinafter referred to as an HLG image signal) is acquired.
- ITU-R Application-2 is an example of a signal system that handles the display brightness level of the reference white in a fixed manner.
- the HLG image signal is a signal after normalization at the luminance level of the reference white.
- the image acquisition unit 110 generates a linear image signal by applying an OETF inverse function (OETF ⁇ 1 ) of the signal method to the acquired input image signal.
- the linear image signal is a signal that linearly represents the intensity of light at the time of photographing.
- the calculation of the inverse function here may be implemented as a numerical calculation using calculation parameters stored in advance for each signal system, or implemented using a lookup table that maps the input value and output value of the signal. May be. Then, the image acquisition unit 110 outputs the generated linear image signal to the conversion unit 120.
- the conversion unit 120 performs gamma conversion on the linear image signal input from the image acquisition unit 110 using parameters determined based on the peak luminance level of the display so that the reference white display luminance level is maintained. To convert to a display signal.
- the conversion unit 120 uses a conversion method corresponding to one or a combination of two or more of the following three basic conversions to obtain a signal level of an image signal.
- Convert. ⁇ Standard white (RW) fixed gamma conversion ⁇ Linear conversion ⁇ Peak fixed gamma conversion
- the RW fixed gamma conversion is a gamma conversion that does not change the luminance level of the reference white.
- FIG. 6A shows a graph of RW fixed gamma conversion.
- the luminance level decreases in a range lower than the reference white, and the luminance level increases in a range higher than the reference white.
- the luminance level increases in a range lower than the reference white, and the luminance level decreases in a range higher than the reference white. The brightness level of the reference white is maintained.
- the linear transformation is expressed as a function T 2 (E) of the image signal E using the gain value G as follows:
- FIG. 6B shows a linear transformation graph.
- the gain value G when the gain value G is larger than 1, the luminance level increases over the entire range, and when the gain value is smaller than 1, the luminance level decreases over the entire range. If the gain value is not 1, the luminance level of the reference white also changes.
- the peak fixed gamma conversion is a gamma conversion that does not change the upper limit of the dynamic range.
- the peak fixed gamma conversion can be expressed as a function T 3 (E) of the image signal E as shown in the following equation.
- FIG. 6C shows a graph of peak fixed gamma conversion.
- K 12.
- the luminance level decreases over the entire range
- the gamma value is smaller than 1
- the luminance level increases over the entire range.
- the rate of change of the brightness level is larger as it is closer to the center of the range. If the gamma value is not 1, the luminance level of the reference white also changes.
- the role of the conversion unit 120 is to match the maximum luminance level that can be expressed by the display signal to the peak luminance level of the display, and to maintain the reference white display luminance level when necessary.
- the peak luminance level of the display here may be the maximum luminance level in terms of the performance of the display (or display element), or may be smaller than the upper limit in terms of performance, in terms of additional restrictions. It may be the maximum luminance level (for example, user settings or environmental conditions).
- the display brightness level of the reference white is maintained by the RW fixed gamma conversion.
- the display brightness level of the reference white is maintained by a combination of linear conversion and peak fixed gamma conversion.
- the conversion unit 120 determines the first gamma value ⁇ 1 so that the maximum luminance level that can be expressed by the display signal matches the peak luminance level of the display. Then, the linear image signal is gamma-transformed using the determined first gamma value ⁇ 1 .
- FIG. 7A is a first explanatory diagram showing how OOTF changes according to RW fixed gamma conversion.
- the peak luminance of the display is assumed to be greater than 2000 cd / m 2 .
- the maximum luminance level that can be expressed is about 4000 cd / m 2 .
- the maximum expressible luminance level exceeds 5000 cd / m 2 .
- the maximum representable luminance level reaches about 9000 cd / m 2 .
- the brightness level of the reference white is maintained (point P 1 ).
- FIG. 7B is a second explanatory diagram showing how OOTF changes according to RW fixed gamma conversion.
- the peak luminance of the display is smaller than 2000 cd / m 2 .
- the brightness level of the reference white is maintained (point P 1 ).
- the system gamma in the low luminance region (0 ⁇ E ⁇ 1) is smaller than that in the existing SDR display case, but its visual influence Is not so big.
- FIG. 7C is a third explanatory diagram illustrating how the OOTF changes according to the RW fixed gamma conversion.
- the peak luminance of the display is assumed to be smaller than 1200 cd / m 2 .
- the conversion unit 120 determines the gain value G so that the maximum luminance level that can be expressed by the display signal matches the peak luminance level of the display, and the determined gain The linear image signal is linearly transformed using the value G. Further, the conversion unit 120 determines the second gamma value ⁇ 2 so that the display brightness level of the reference white is restored to the original brightness level, and uses the determined second gamma value ⁇ 2 to perform the above linear operation. Gamma-convert the converted image signal. The conversion unit 120 executes gamma conversion using the second gamma value ⁇ 2 so as not to change the peak luminance level.
- FIG. 8A is an explanatory diagram showing how OOTF changes in accordance with linear conversion and peak fixed gamma conversion.
- FIG. 8B is an enlarged view of the low luminance region of FIG. 8A.
- the upper limit of the luminance dynamic range that is, the maximum representable luminance level is close to the peak luminance of the display. Pulled down to about 1200 cd / m 2 .
- the occurrence of overexposure is suppressed and the performance of the display can be utilized to the maximum extent.
- the input value E of the gamma conversion here is divided by the parameter K as shown in the above equation (4).
- the value of the parameter K may be, for example, 12 when the headroom is not used and 20 when the headroom is used.
- the conversion unit 120 may support both the first operation mode that maintains the display brightness level of the reference white and the second operation mode that does not maintain the display brightness level of the reference white.
- the first operation mode and the second operation mode are referred to as an RW maintenance mode and an RW non-maintenance mode, respectively.
- the conversion unit 120 executes either the first conversion method or the second conversion method described above.
- the conversion unit 120 outputs a display signal by another method without maintaining the reference white display luminance level.
- the conversion unit 120 performs ITU-R BT.
- the image signal may be converted into a display signal.
- ITU-R BT For display output (SDR display) at 1886, a gamma value of 2.4 is used throughout the range.
- the conversion unit 120 determines a gain value so that the maximum luminance level that can be expressed by the display signal matches the peak luminance level of the display, and linearizes the image signal using the determined gain value. It may be converted.
- FIG. 18 is an explanatory diagram for describing OOTF in SDR display in 1886.
- the one-dot chain line graph is BT.
- the maximum luminance level that can be expressed is about 500 cd / m 2 , so when the peak luminance level of the display exceeds about 500 cd / m 2 , Requires linear transformation with large gain.
- the conversion unit 120 does not have to execute the gain adjustment.
- the system gamma in the low luminance region (0 ⁇ E ⁇ 1) is maintained at about 1.2.
- the case of SDR display shows an average luminance level in the middle luminance region (1 ⁇ E ⁇ 8).
- SDR display can be a visually better option when the peak brightness of the display is low (eg, less than about 600 cd / m 2 ).
- the control unit 130 controls the operations of the image acquisition unit 110 and the conversion unit 120. For example, the control unit 130 determines the signal method of the input image signal from the control parameter associated with the input image signal, and causes the image acquisition unit 110 and the conversion unit 120 to execute processing corresponding to the determined signal method. Examples of control parameters here will be further described later.
- the control unit 130 may switch the type of the inverse function of the OETF that the image acquisition unit 110 should apply to the input image signal according to the signal method of the input image signal.
- the control unit 130 may control the operation mode of the image processing apparatus 100.
- control unit 130 selects an operation mode to be used by the conversion unit 120 among an RW maintaining mode in which the reference white display luminance level is maintained and an RW non-maintaining mode in which the reference white display luminance level is not maintained. To do.
- RW maintenance mode the control unit 130 causes the conversion unit 120 to use a conversion method in which the reference white display luminance level is maintained in the conversion process for adjusting the dynamic range.
- the control unit 130 may select one of the operation modes based on one or more of the following conditions.
- Signal system type When the signal system of the input image signal is a signal system (for example, ITU-R Application-2) in which the display brightness level of the reference white is fixed, the control unit 130 is in the RW maintenance mode. Select.
- a signal system for example, ITU-R Application-2
- the control unit 130 is in the RW maintenance mode. Select.
- the user sets the RW maintenance mode or the RW non-maintenance mode via the user interface.
- a user who desires to appropriately reproduce the brightness of the shooting environment can set the RW maintenance mode.
- the user may set an acceptable peak luminance level for the display.
- the control unit 130 may select the RW maintenance mode when the allowable peak luminance level is greater than a predetermined threshold, and otherwise select the RW non-maintenance mode.
- the control unit 130 determines the peak luminance level of the display from the display attribute (for example, device type, model number, or performance value), and the determined peak luminance level is greater than a predefined threshold value.
- RW maintenance mode may be selected in some cases, and RW non-maintenance mode may be selected otherwise.
- the control unit 130 determines the recommended peak luminance level of the display from the conditions of the display environment (environmental illuminance, location, etc.) detected via a sensor (not shown), and the determined recommended peak luminance level is defined in advance.
- the RW maintenance mode may be selected if the threshold value is larger than the threshold value, and the RW non-maintenance mode may be selected otherwise.
- control unit 130 selectively uses the first conversion method (RW fixed gamma conversion) and the second conversion method (combination of linear conversion and peak fixed gamma conversion) described above for the conversion unit 120. May be used. Similar to the selection of the operation mode described above, the control unit 130 is based on, for example, a mode setting by the user or a comparison between a peak luminance value (which may include a performance value, an allowable value by the user, and a system recommended value) and a threshold value. Any conversion method may be selected.
- FIG. 10 is a flowchart illustrating an example of the flow of the image conversion process executed by the image processing apparatus 100 described above.
- control unit 130 determines the signal method of the input image signal from the control parameter associated with the input image signal (step S102).
- the control unit 130 obtains the peak luminance L P of the display (step S104).
- the control unit 130 selects an operation mode based on a condition such as a signal system type or user setting (step S106).
- the image conversion process in FIG. 10 branches depending on the signal method determined in step S102 and the operation mode selected in step S106 (steps S110 and S125). For example, when the signal system is not the HDR system, ITU-R BT. In accordance with 1886, a display signal is output from the conversion unit 120 to the display, and the video is displayed in SDR (step S120). On the other hand, if the signal method is the HDR method (for example, the HLG method) and the RW maintenance mode is selected, the process proceeds to step S130. If the signaling method is the HDR method and the RW non-maintaining mode is selected, the process proceeds to step S165.
- the signal method is the HDR method and the RW non-maintaining mode is selected
- step S130 the image acquisition unit 110 and the conversion unit 120 execute RW maintenance gamma conversion processing.
- the display brightness level of the reference white (RW) is maintained.
- step S165 the display brightness level of the reference white is not necessarily maintained.
- the control unit 130 determines whether or not to perform SDR display based on, for example, user settings or the peak luminance level of the display determined in step S104 (step S165). If it is determined that the SDR display is to be performed, the process proceeds to step S120, and the ITU-R BT. In accordance with 1886, a display signal is output from the conversion unit 120 to the display. If it is determined not to perform SDR display, the process proceeds to step S170, and linear conversion processing is performed by the image acquisition unit 110 and the conversion unit 120 (step S170). A more detailed flow of the linear conversion process will be further described later.
- a display signal is output to the display, and the HDR video is displayed on the display (step S190).
- FIG. 11A is a flowchart showing a first example of the flow of the RW maintenance gamma conversion process shown in FIG.
- the conversion unit 120 the upper limit L max of the peak luminance level L P and the luminance dynamic range of the display, to compute the gamma value gamma 1 (step S132).
- the gamma value ⁇ 1 can be calculated so that the maximum luminance level that can be expressed by the display signal is matched with the peak luminance level of the display, for example, through the RW fixed gamma conversion shown in Equation (2).
- the image acquisition unit 110 acquires an input image signal from some signal source (step S136), and generates a linear image signal by applying an inverse function of OETF (OETF ⁇ 1 ) to the acquired input image signal. (Step S138).
- the conversion unit 120 uses the gamma value gamma 1 calculated in step S132, a linear image signal inputted from the image acquisition unit 110 by gamma conversion, generates display signals (step S144). Then, the conversion unit 120 outputs the generated display signal to the display (Step S150).
- FIG. 11B is a flowchart showing a second example of the flow of the RW maintenance gamma conversion process shown in FIG.
- the conversion unit 120 the upper limit L max of the peak luminance level L P and the luminance dynamic range of the display, to compute the gain G 1 and the gamma value gamma 2 (step S134).
- Gain G 1 for example, it may be calculated as Equation 3 to a maximum brightness level that can be expressed by the display signal through the linear transformation shown is matched to the peak brightness level of the display.
- the gamma value ⁇ 2 may be calculated such that the reference white display luminance level is restored to the original luminance level by further applying the peak fixed gamma transformation shown in Equation (4).
- the image acquisition unit 110 acquires an input image signal from some signal source (step S136), and generates a linear image signal by applying an inverse function of OETF (OETF ⁇ 1 ) to the acquired input image signal. (Step S138).
- control unit 130 determines whether or not to adjust the system gamma based on, for example, the user setting or the peak luminance level of the display (step S140). If it is determined that the system gamma is to be adjusted, the conversion unit 120 gamma-converts the linear image signal input from the image acquisition unit 110 using a predetermined system gamma value (for example, 1.2). (Step S142).
- a predetermined system gamma value for example, 1.2
- the conversion unit 120 uses the gain G 1 calculated in step S134, executes the (system gamma is adjusted as necessary) linear transformation of the linear image signal (step S146).
- the conversion unit 120 by the gamma converting the image signal after linear transformation by using a gamma value gamma 2 calculated in step S134 generates display signals (step S148).
- the conversion unit 120 outputs the generated display signal to the display (Step S150).
- FIG. 11C is a flowchart illustrating a third example of the flow of the RW maintenance gamma conversion process illustrated in FIG. In the third example, selective switching between the first conversion method and the second conversion method is performed.
- the control unit 130 determines the first based on, for example, a mode setting by the user or a comparison between a peak luminance value (which may include a performance value, an allowable value by the user, and a system recommended value) and a threshold value.
- the conversion method (RW fixed gamma conversion) and the second conversion method (combination of linear conversion and peak fixed gamma conversion) are selected (step S152).
- the control unit 130 causes the image acquisition unit 110 and the conversion unit 120 to execute Steps S132 to S150 illustrated in FIG. 11A (Step S154).
- the control unit 130 causes the image acquisition unit 110 and the conversion unit 120 to execute steps S134 to S150 illustrated in FIG. 11B (step S156).
- FIG. 12 is a flowchart illustrating an example of the flow of the linear conversion process illustrated in FIG.
- Gain G 2 is, for example, may be calculated as Equation (3) to the maximum brightness level that can be expressed by the display signal through the linear transformation shown is matched to the peak brightness level of the display.
- the image acquisition unit 110 acquires an input image signal from some signal source (step S174), and generates a linear image signal by applying an inverse function of OETF (OETF ⁇ 1 ) to the acquired input image signal. (Step S176).
- control unit 130 determines whether or not to adjust the system gamma based on, for example, the user setting or the peak luminance level of the display (step S178). If it is determined that the system gamma is to be adjusted, the conversion unit 120 gamma-converts the linear image signal input from the image acquisition unit 110 using a predetermined system gamma value (for example, 1.2). (Step S180).
- a predetermined system gamma value for example, 1.2
- the conversion unit 120 uses the gain G 2 calculated in step S172, by performing a linear transformation of the (system gamma is adjusted as necessary) linear image signal to generate a display signal (Step S182). Then, the conversion unit 120 outputs the generated display signal to the display (step S184).
- HLG image recognition As described with reference to FIG. 5, the signal system of the input image signal is determined based on the control parameter associated with the input image signal.
- the image signal of a series of frames is usually compressed and encoded according to some video codec, and then recorded on a recording medium or transmitted over a network.
- Control parameters that identify the signaling scheme are also encoded and associated with the bit stream of the image signal.
- UHD-BD Ultra HD-Blu-ray Disc
- HEVC High Efficiency Video Coding
- VUI Video Usability Information
- a new value definition for the HLG method is added as the value of this OETF number.
- the UHD-BD recorder writes the currently permitted value (for example, “1” or “14”) to the OETF number in the VUI, while the signal type in the SEI is for the HLG system.
- the number “18” may be written.
- the HDR-compatible player or display can recognize the HLG video without violating the UHD-BD specification by preferentially referring to the parameters in the SEI.
- FIG. 13 is an explanatory diagram for explaining an example of a method for recording and reproducing HLG video.
- FIG. 13 shows a recording device 30 that is an HDR-compatible recorder / player, a recording medium 40, a playback device 45 that is an HDR-incompatible player, a display device 50 that is an HDR-compatible display, and an HDR-incompatible type.
- a display device 55 which is a display of the above is shown.
- the recording device 30 includes an encoding unit 32, a decoding unit 34, an HLG processing unit 36, and a control unit 38.
- the encoding unit 32 of the recording device 30 encodes the HLG image signal generated by the HLG processing unit 36 according to HEVC, and records the encoded bit stream on the recording medium 40 according to UHD-BD.
- the control unit 38 writes a control parameter indicating an OETF number for the HLG method into the VUI or SEI.
- a VUI or SEI is associated with an encoded bitstream that includes a compressed image signal.
- the control unit 38 reads the OETF number in the VUI or SEI, thereby recognizing that the video recorded on the recording medium 40 is an HLG video.
- the decoding unit 34 decodes the HLG image signal according to HEVC.
- the control unit 38 of the recording device 30 may signal the decoded HLG image signal to an output destination display of the image signal together with an HLG indicator indicating that the image signal is an HLG image signal.
- the display device 50 that is an HDR-compatible display processes the image signal according to the HLG method and displays an HDR video.
- the image processing apparatus 100 described above is mounted on the display device 50, for example, and can perform the dynamic range adjustment described above before the HDR video is displayed.
- the output destination display of the image signal is the HDR non-compliant display device 55
- the display device 55 displays the video in SDR without noticing the presence of the HLG sign.
- the HDR non-compliant playback device 45 When playing back video, the HDR non-compliant playback device 45 does not read the OETF number in the VUI or SEI, or ignores it because the read OETF number is an unknown (or contradicts) value. .
- the playback device 45 outputs the image signal decoded according to HEVC to the display device 50 or the display device 55 without an HLG label.
- the display device 50 displays the video in SDR since the HLG indicator is not received.
- the display device 55 also displays the video in SDR.
- the HLG processing unit 36 of the recording device 30 may have the function of the image processing device 100 described above.
- the HLG processing unit 36 processes the decoded HLG image signal according to the HLG method to generate a display signal for HDR video having a wide luminance dynamic range.
- the display signal is output to the display device 50, the display device 50 displays the HDR video.
- FIG. 14 is a flowchart illustrating an example of a recording process executed by the recording apparatus 30 according to an embodiment.
- the HLG processing unit 36 of the recording device 30 acquires an original image signal that linearly represents the light intensity of the video content (step S202).
- the HLG processing unit 36 converts the original image signal into an HLG image signal (step S204).
- the encoding unit 32 encodes the HLG image signal to generate an encoded stream (step S206).
- the control unit 38 generates a control parameter indicating the OETF number of the HLG method (step S208).
- the control unit 38 records the encoded stream of the HLG image signal on the recording medium, and writes a control parameter indicating the OLG number of the HLG method to the VUI or SEI associated with the encoded stream (step S210).
- FIG. 15A is a flowchart illustrating a first example of the flow of a reproduction process according to an embodiment.
- the control unit 38 of the recording device 30 reads the encoded stream and the associated control parameter from the recording medium (step S222).
- the decoding unit 34 decodes the image signal from the read encoded stream (step S224).
- the control unit 38 determines whether or not the signal method of the image signal is the HLG method based on the control parameter read in step S222 (step S226).
- the process proceeds to step S228, and a non-HLG image signal is output to the display (step S228).
- the control unit 38 further determines whether or not the output destination display is an HLG compatible type (step S230).
- the image signal is output to the display without executing the HLG conversion (step S228). If the output destination display is HLG compatible, the HLG processing unit 36 processes the decoded image signal in accordance with the HLG method to generate a display signal having a wide luminance dynamic range (step S232). Then, a display signal is output to the display (step S234).
- FIG. 15B is a flowchart illustrating a second example of the flow of the reproduction process according to an embodiment.
- the control unit 38 of the recording device 30 reads the encoded stream and the associated control parameter from the recording medium (step S222).
- the decoding unit 34 decodes the image signal from the read encoded stream (step S224).
- the control unit 38 determines whether or not the signal method of the image signal is the HLG method based on the control parameter read in step S222 as in the first example (step S226). If an image signal that is not an HLG image signal is decoded, the process proceeds to step S228, and a non-HLG image signal is output to the display (step S228). When the HLG image signal is decoded, the process proceeds to step S236, and the control unit 38 outputs the HLG image signal to the display together with the HLG indicator signaling (step S236).
- Video content may also include a supplemental stream containing subtitle information or graphics information in addition to the encoded stream of image signals, audio signals and control signals in a series of frames.
- the recording device 30 that is an HDR-compatible recorder / player can display the content of the supplementary stream (for example, subtitle, GUI, or other display).
- appropriate visibility of the content can be ensured by matching the maximum luminance level of the supplemental stream content to the reference white display luminance level of the HDR video.
- Hardware configuration example The above-described embodiments may be realized using any of software, hardware, and a combination of software and hardware.
- a program constituting the software is stored in advance in a storage medium (non-transitory media) provided inside or outside the apparatus, for example.
- Each program is read into a RAM (Random Access Memory) at the time of execution and executed by a processor such as a CPU (Central Processing Unit).
- a processor such as a CPU (Central Processing Unit).
- FIG. 16 is a block diagram illustrating an example of a hardware configuration of an apparatus to which the above-described embodiment can be applied.
- the image processing apparatus 800 includes a system bus 810, an image processing chip 820, and an off-chip memory 890.
- the image processing chip 820 includes n (n is 1 or more) processing circuits 830-1, 830-2,..., 830-n, a reference buffer 840, a system bus interface 850, and a local bus interface 860.
- the system bus 810 provides a communication path between the image processing chip 820 and an external module (for example, a central control function, an application function, a communication interface, a user interface, or a display interface).
- the processing circuits 830-1, 830-2,..., 830-n are connected to the system bus 810 via the system bus interface 850 and to the off-chip memory 890 via the local bus interface 860.
- the processing circuits 830-1, 830-2,..., 830-n can also access a reference buffer 840 that may correspond to an on-chip memory (eg, SRAM).
- the off-chip memory 890 may be a frame memory that stores image data processed by the image processing chip 820, for example.
- the processing circuit 830-1 may be used for adjusting the luminance dynamic range of the HDR image signal
- the processing circuit 830-2 may be used for encoding or decoding the image signal according to HEVC. Note that these processing circuits may be formed not on the same image processing chip 820 but on separate chips.
- FIG. 17 illustrates an example of a schematic configuration of a television device to which the above-described embodiment is applied.
- the television apparatus 900 includes an antenna 901, a tuner 902, a demultiplexer 903, a decoder 904, a video signal processing unit 905, a display unit 906, an audio signal processing unit 907, a speaker 908, an external interface 909, a control unit 910, a user interface 911, And a bus 912.
- Tuner 902 extracts a signal of a desired channel from a broadcast signal received via antenna 901, and demodulates the extracted signal. Then, the tuner 902 outputs the encoded bit stream obtained by the demodulation to the demultiplexer 903. In other words, the tuner 902 serves as a transmission unit in the television apparatus 900 that receives an encoded stream in which an image is encoded.
- the demultiplexer 903 separates the video stream and audio stream of the viewing target program from the encoded bit stream, and outputs each separated stream to the decoder 904. In addition, the demultiplexer 903 extracts auxiliary data such as EPG (Electronic Program Guide) from the encoded bit stream, and supplies the extracted data to the control unit 910. Note that the demultiplexer 903 may perform descrambling when the encoded bit stream is scrambled.
- EPG Electronic Program Guide
- the decoder 904 decodes the video stream and audio stream input from the demultiplexer 903. Then, the decoder 904 outputs the video data generated by the decoding process to the video signal processing unit 905. In addition, the decoder 904 outputs audio data generated by the decoding process to the audio signal processing unit 907.
- the video signal processing unit 905 reproduces the video data input from the decoder 904 and causes the display unit 906 to display the video.
- the video signal processing unit 905 may cause the display unit 906 to display an application screen supplied via a network.
- the video signal processing unit 905 may perform additional processing such as noise removal on the video data according to the setting.
- the video signal processing unit 905 may generate a GUI (Graphical User Interface) image such as a menu, a button, or a cursor, and superimpose the generated image on the output image.
- GUI Graphic User Interface
- the display unit 906 is driven by a drive signal supplied from the video signal processing unit 905, and displays a video or an image on a video screen of a display device (for example, a liquid crystal display, a plasma display, or an OLED).
- a display device for example, a liquid crystal display, a plasma display, or an OLED.
- the audio signal processing unit 907 performs reproduction processing such as D / A conversion and amplification on the audio data input from the decoder 904, and outputs audio from the speaker 908.
- the audio signal processing unit 907 may perform additional processing such as noise removal on the audio data.
- the external interface 909 is an interface for connecting the television apparatus 900 to an external device or a network.
- a video stream or an audio stream received via the external interface 909 may be decoded by the decoder 904. That is, the external interface 909 also has a role as a transmission unit in the television apparatus 900 that receives an encoded stream in which an image is encoded.
- the control unit 910 has a processor such as a CPU (Central Processing Unit) and a memory such as a RAM (Random Access Memory) and a ROM (Read Only Memory).
- the memory stores a program executed by the CPU, program data, EPG data, data acquired via a network, and the like.
- the program stored in the memory is read and executed by the CPU when the television device 900 is activated, for example.
- the CPU controls the operation of the television device 900 according to an operation signal input from the user interface 911, for example, by executing the program.
- the user interface 911 is connected to the control unit 910.
- the user interface 911 includes, for example, buttons and switches for the user to operate the television device 900, a remote control signal receiving unit, and the like.
- the user interface 911 detects an operation by the user via these components, generates an operation signal, and outputs the generated operation signal to the control unit 910.
- the bus 912 connects the tuner 902, the demultiplexer 903, the decoder 904, the video signal processing unit 905, the audio signal processing unit 907, the external interface 909, and the control unit 910 to each other.
- the video signal processing unit 905 has the function of the image processing apparatus 100 according to the above-described embodiment. Therefore, when reproducing the HDR video in the television apparatus 900, it is possible to eliminate or at least reduce inconvenience related to the mismatch between the dynamic range of the video signal and the peak luminance of the display.
- FIG. 18 shows an example of a schematic configuration of a mobile phone to which the above-described embodiment is applied.
- a cellular phone 920 includes an antenna 921, a communication unit 922, an audio codec 923, a speaker 924, a microphone 925, a camera unit 926, an image processing unit 927, a demultiplexing unit 928, a recording / reproducing unit 929, a display unit 930, a control unit 931, an operation A portion 932 and a bus 933.
- the antenna 921 is connected to the communication unit 922.
- the speaker 924 and the microphone 925 are connected to the audio codec 923.
- the operation unit 932 is connected to the control unit 931.
- the bus 933 connects the communication unit 922, the audio codec 923, the camera unit 926, the image processing unit 927, the demultiplexing unit 928, the recording / reproducing unit 929, the display unit 930, and the control unit 931 to each other.
- the mobile phone 920 has various operation modes including a voice call mode, a data communication mode, a shooting mode, and a videophone mode, and is used for sending and receiving voice signals, sending and receiving e-mail or image data, taking images, and recording data. Perform the action.
- the analog voice signal generated by the microphone 925 is supplied to the voice codec 923.
- the audio codec 923 converts an analog audio signal into audio data, A / D converts the compressed audio data, and compresses it. Then, the audio codec 923 outputs the compressed audio data to the communication unit 922.
- the communication unit 922 encodes and modulates the audio data and generates a transmission signal. Then, the communication unit 922 transmits the generated transmission signal to a base station (not shown) via the antenna 921. In addition, the communication unit 922 amplifies a radio signal received via the antenna 921 and performs frequency conversion to acquire a received signal.
- the communication unit 922 demodulates and decodes the received signal to generate audio data, and outputs the generated audio data to the audio codec 923.
- the audio codec 923 expands the audio data and performs D / A conversion to generate an analog audio signal. Then, the audio codec 923 supplies the generated audio signal to the speaker 924 to output audio.
- the control unit 931 generates character data constituting the e-mail in response to an operation by the user via the operation unit 932.
- the control unit 931 causes the display unit 930 to display characters.
- the control unit 931 generates e-mail data in response to a transmission instruction from the user via the operation unit 932, and outputs the generated e-mail data to the communication unit 922.
- the communication unit 922 encodes and modulates email data and generates a transmission signal. Then, the communication unit 922 transmits the generated transmission signal to a base station (not shown) via the antenna 921.
- the communication unit 922 amplifies a radio signal received via the antenna 921 and performs frequency conversion to acquire a received signal.
- the communication unit 922 demodulates and decodes the received signal to restore the email data, and outputs the restored email data to the control unit 931.
- the control unit 931 displays the content of the electronic mail on the display unit 930 and stores the electronic mail data in the storage medium of the recording / reproducing unit 929.
- the recording / reproducing unit 929 has an arbitrary readable / writable storage medium.
- the storage medium may be a built-in storage medium such as a RAM or a flash memory, or an externally mounted storage medium such as a hard disk, a magnetic disk, a magneto-optical disk, an optical disk, a USB memory, or a memory card. May be.
- the camera unit 926 images a subject to generate image data, and outputs the generated image data to the image processing unit 927.
- the image processing unit 927 encodes the image data input from the camera unit 926 and stores the encoded stream in the storage medium of the recording / playback unit 929.
- the demultiplexing unit 928 multiplexes the video stream encoded by the image processing unit 927 and the audio stream input from the audio codec 923, and the multiplexed stream is the communication unit 922. Output to.
- the communication unit 922 encodes and modulates the stream and generates a transmission signal. Then, the communication unit 922 transmits the generated transmission signal to a base station (not shown) via the antenna 921.
- the communication unit 922 amplifies a radio signal received via the antenna 921 and performs frequency conversion to acquire a received signal.
- These transmission signal and reception signal may include an encoded bit stream.
- the communication unit 922 demodulates and decodes the received signal to restore the stream, and outputs the restored stream to the demultiplexing unit 928.
- the demultiplexing unit 928 separates the video stream and the audio stream from the input stream, and outputs the video stream to the image processing unit 927 and the audio stream to the audio codec 923.
- the image processing unit 927 decodes the video stream and generates video data.
- the video data is supplied to the display unit 930, and a series of images is displayed on the display unit 930.
- the audio codec 923 decompresses the audio stream and performs D / A conversion to generate an analog audio signal. Then, the audio codec 923 supplies the generated audio signal to the speaker 924 to output audio.
- the image processing unit 927 has the function of the image processing apparatus 100 according to the above-described embodiment. Therefore, when the mobile phone 920 reproduces the HDR video, it is possible to eliminate or at least reduce the inconvenience related to the mismatch between the dynamic range of the video signal and the peak luminance of the display.
- FIG. 19 shows an example of a schematic configuration of a recording / reproducing apparatus to which the above-described embodiment is applied.
- the recording / reproducing device 940 encodes audio data and video data of a received broadcast program and records the encoded data on a recording medium.
- the recording / reproducing device 940 may encode audio data and video data acquired from another device and record them on a recording medium, for example.
- the recording / reproducing device 940 reproduces data recorded on the recording medium on a monitor and a speaker, for example, in accordance with a user instruction. At this time, the recording / reproducing device 940 decodes the audio data and the video data.
- the recording / reproducing apparatus 940 includes a tuner 941, an external interface 942, an encoder 943, an HDD (Hard Disk Drive) 944, a disk drive 945, a selector 946, a decoder 947, an OSD (On-Screen Display) 948, a control unit 949, and a user interface. 950.
- Tuner 941 extracts a signal of a desired channel from a broadcast signal received via an antenna (not shown), and demodulates the extracted signal. Then, the tuner 941 outputs the encoded bit stream obtained by the demodulation to the selector 946. That is, the tuner 941 has a role as a transmission unit in the recording / reproducing apparatus 940.
- the external interface 942 is an interface for connecting the recording / reproducing apparatus 940 to an external device or a network.
- the external interface 942 may be, for example, an IEEE 1394 interface, a network interface, a USB interface, or a flash memory interface.
- video data and audio data received via the external interface 942 are input to the encoder 943. That is, the external interface 942 serves as a transmission unit in the recording / reproducing device 940.
- the encoder 943 encodes video data and audio data when the video data and audio data input from the external interface 942 are not encoded. Then, the encoder 943 outputs the encoded bit stream to the selector 946.
- the HDD 944 records an encoded bit stream in which content data such as video and audio is compressed, various programs, and other data on an internal hard disk. Also, the HDD 944 reads out these data from the hard disk when playing back video and audio.
- the disk drive 945 performs recording and reading of data to and from the mounted recording medium.
- the recording medium loaded in the disk drive 945 may be, for example, a DVD disk (DVD-Video, DVD-RAM, DVD-R, DVD-RW, DVD + R, DVD + RW, etc.) or a Blu-ray (registered trademark) disk. .
- the selector 946 selects an encoded bit stream input from the tuner 941 or the encoder 943 when recording video and audio, and outputs the selected encoded bit stream to the HDD 944 or the disk drive 945. In addition, the selector 946 outputs the encoded bit stream input from the HDD 944 or the disk drive 945 to the decoder 947 during video and audio reproduction.
- the decoder 947 decodes the encoded bit stream and generates video data and audio data. Then, the decoder 947 outputs the generated video data to the OSD 948. The decoder 904 outputs the generated audio data to an external speaker.
- the OSD 948 reproduces the video data input from the decoder 947 and displays the video. Further, the OSD 948 may superimpose a GUI image such as a menu, a button, or a cursor on the video to be displayed.
- a GUI image such as a menu, a button, or a cursor
- the control unit 949 includes a processor such as a CPU and memories such as a RAM and a ROM.
- the memory stores a program executed by the CPU, program data, and the like.
- the program stored in the memory is read and executed by the CPU when the recording / reproducing apparatus 940 is activated, for example.
- the CPU controls the operation of the recording / reproducing device 940 according to an operation signal input from the user interface 950, for example, by executing the program.
- the user interface 950 is connected to the control unit 949.
- the user interface 950 includes, for example, buttons and switches for the user to operate the recording / reproducing device 940, a remote control signal receiving unit, and the like.
- the user interface 950 detects an operation by the user via these components, generates an operation signal, and outputs the generated operation signal to the control unit 949.
- the OSD 948 has the function of the image processing apparatus 100 according to the above-described embodiment. Therefore, when the recording / reproducing apparatus 940 reproduces the HDR video, it is possible to eliminate or at least reduce inconvenience related to the mismatch between the dynamic range of the video signal and the peak luminance of the display.
- FIG. 20 illustrates an example of a schematic configuration of an imaging apparatus to which the above-described embodiment is applied.
- the imaging device 960 captures an image of a subject, generates an image, encodes the image data, and records the image data on a recording medium.
- the imaging device 960 includes an optical block 961, an imaging unit 962, a signal processing unit 963, an image processing unit 964, a display unit 965, an external interface 966, a memory 967, a media drive 968, an OSD 969, a control unit 970, a user interface 971, and a bus. 972.
- the optical block 961 is connected to the imaging unit 962.
- the imaging unit 962 is connected to the signal processing unit 963.
- the display unit 965 is connected to the image processing unit 964.
- the user interface 971 is connected to the control unit 970.
- the bus 972 connects the image processing unit 964, the external interface 966, the memory 967, the media drive 968, the OSD 969, and the control unit 970 to each other.
- the optical block 961 includes a focus lens and a diaphragm mechanism.
- the optical block 961 forms an optical image of the subject on the imaging surface of the imaging unit 962.
- the imaging unit 962 includes an image sensor such as a CCD or a CMOS, and converts an optical image formed on the imaging surface into an image signal as an electrical signal by photoelectric conversion. Then, the imaging unit 962 outputs the image signal to the signal processing unit 963.
- the signal processing unit 963 performs various camera signal processing such as knee correction, gamma correction, and color correction on the image signal input from the imaging unit 962.
- the signal processing unit 963 outputs the image data after the camera signal processing to the image processing unit 964.
- the image processing unit 964 encodes the image data input from the signal processing unit 963 and generates encoded data. Then, the image processing unit 964 outputs the generated encoded data to the external interface 966 or the media drive 968. The image processing unit 964 also decodes encoded data input from the external interface 966 or the media drive 968 to generate image data. Then, the image processing unit 964 outputs the generated image data to the display unit 965. In addition, the image processing unit 964 may display the image by outputting the image data input from the signal processing unit 963 to the display unit 965. Further, the image processing unit 964 may superimpose display data acquired from the OSD 969 on an image output to the display unit 965.
- the OSD 969 generates a GUI image such as a menu, a button, or a cursor, for example, and outputs the generated image to the image processing unit 964.
- the external interface 966 is configured as a USB input / output terminal, for example.
- the external interface 966 connects the photographing device 960 and a printer, for example, when printing an image.
- a drive is connected to the external interface 966 as necessary.
- a removable medium such as a magnetic disk or an optical disk is attached to the drive, and a program read from the removable medium can be installed in the photographing apparatus 960.
- the external interface 966 may be configured as a network interface connected to a network such as a LAN or the Internet. That is, the external interface 966 has a role as a transmission unit in the photographing apparatus 960.
- the recording medium mounted on the media drive 968 may be any readable / writable removable medium such as a magnetic disk, a magneto-optical disk, an optical disk, or a semiconductor memory. Further, a recording medium may be fixedly attached to the media drive 968, and a non-portable storage unit such as an internal hard disk drive or an SSD (Solid State Drive) may be configured.
- a non-portable storage unit such as an internal hard disk drive or an SSD (Solid State Drive) may be configured.
- the control unit 970 includes a processor such as a CPU and memories such as a RAM and a ROM.
- the memory stores a program executed by the CPU, program data, and the like.
- the program stored in the memory is read and executed by the CPU when the photographing apparatus 960 is activated, for example.
- the CPU controls the operation of the imaging device 960 according to an operation signal input from the user interface 971, for example, by executing the program.
- the user interface 971 is connected to the control unit 970.
- the user interface 971 includes, for example, buttons and switches for the user to operate the photographing apparatus 960.
- the user interface 971 detects an operation by the user via these components, generates an operation signal, and outputs the generated operation signal to the control unit 970.
- the image processing unit 964 has the function of the image processing apparatus 100 according to the above-described embodiment. Therefore, when the HDR image is played back by the photographing device 960, the inconvenience related to the mismatch between the dynamic range of the video signal and the peak luminance of the display can be eliminated or at least reduced.
- the image signal based on the signal system that handles the reference white display luminance level in a fixed manner is gamma-converted for conversion into a display signal.
- the gamma conversion is performed so that the reference white display luminance level is maintained using a parameter determined based on the peak luminance level of the display. Therefore, the occurrence of loss of information (so-called overexposure) in the high-luminance area due to luminance clipping (or excessively strong roll-off) is avoided, and it is used as a reference for brightness during content shooting or production. It is possible to appropriately reproduce the brightness of the reference white color when displaying the content.
- the luminance level of the reference white does not change due to gamma conversion.
- the signal after normalization at the reference white luminance level is linear using a gain value determined to match the maximum luminance level that can be represented by the display signal to the peak luminance level of the display.
- the converted image signal after the linear conversion is gamma-converted using a second gamma value determined so as to restore the reference white display luminance level to the original luminance level.
- the luminance level of the reference white is finally maintained as the original level (although it changes during the calculation).
- the gamma conversion using the second gamma value can be executed so as not to change the maximum luminance level that can be expressed by the display signal.
- the second conversion method may be executed after gamma-converting the image signal using a predetermined system gamma value. For example, by using a system gamma value of 1.2, the luminance gradation in the displayed video is changed to ITU-R BT. A display based on existing specifications such as 1886 can be approached.
- the first conversion method and the second conversion method described above may be selectively switched. Thereby, it is possible to provide the user with various expressions of the HDR video and to select an optimal expression according to the characteristics of the display.
- the operation mode is switched between a first operation mode in which the reference white display luminance level is maintained and a second operation mode in which the reference white display luminance level is not maintained.
- the operating mode may be selected based on the type of signaling. In this case, for example, when the image signal is generated by the HLG method in which the luminance level is relatively expressed with respect to the reference white level, the reference white level is maintained, and otherwise, the reference white level is set. Switching such as not maintaining is possible.
- the type of the signal method can be determined based on, for example, a control parameter included in VUI (Video Usability Information) or SEI (Supplemental Enhancement Information).
- VUI Video Usability Information
- SEI Supplemental Enhancement Information
- the operation mode may be selected based on user settings. For example, a user who wants to reproduce the brightness of the shooting environment or the content production environment will select the first operation mode. The operation mode may be selected based on other factors such as a peak luminance level as the performance of the display or a peak luminance level that is automatically set based on conditions of the display environment.
- a simple linear conversion using a gain value may be performed. In this case, occurrence of a loss of information in the high luminance region due to luminance clipping is avoided.
- ITU-R BT. SDR display according to 1886 may be performed, and in this case, an image with good visibility in the medium luminance region can be obtained.
- An image processing apparatus comprising: (2) The image signal is a signal after normalization at the luminance level of the reference white, The conversion unit performs gamma conversion on the image signal using a first gamma value. The image processing apparatus according to (1). (3) The image processing apparatus according to (2), wherein the conversion unit determines the first gamma value so that a maximum luminance level that can be expressed by the display signal matches the peak luminance level of the display.
- the image signal is a signal after normalization at the luminance level of the reference white
- the conversion unit linearly converts the image signal using a gain value, and uses the second gamma value determined so that the display luminance level of the reference white is restored to the original luminance level. Gamma-convert the converted image signal,
- the image processing apparatus according to (1).
- (6) The image according to (4) or (5), wherein the conversion unit executes gamma conversion using the second gamma value so as not to change a maximum luminance level that can be expressed by the display signal. Processing equipment.
- the conversion unit performs the gamma conversion using the linear conversion and the second gamma value after performing the gamma conversion on the image signal using a predetermined system gamma value, (4) to (6)
- the image processing apparatus according to any one of the above.
- the image processing apparatus selects a mode to be used by the conversion unit from a first operation mode in which the display brightness level of the reference white is maintained and a second operation mode in which the display brightness level of the reference white is not maintained Further comprising a control unit, The conversion unit converts the image signal into the display signal so that the display brightness level of the reference white is maintained when the first operation mode is selected by the control unit.
- the image processing apparatus according to any one of (1) to (7).
- the control unit may be configured to select the first operation mode and the second operation mode based on one or more of a signaling method type, a user setting, an attribute of the display, and a display environment condition.
- the image processing apparatus according to (8), wherein one is selected.
- the converter is A first conversion method for gamma-converting the image signal so that the display brightness level of the reference white does not change;
- the image signal after linear conversion is performed using a second gamma value that is determined so that the display luminance level of the reference white is restored to the original luminance level by linearly converting the image signal using a gain value.
- a second conversion method for gamma-converting The image processing device according to any one of (1) to (9), wherein the image processing device is selectively used.
- the conversion unit is a gain value determined to match the maximum luminance level that can be expressed by the display signal with the peak luminance level of the display when the control unit selects the second operation mode. Linearly transforming the image signal using The image processing apparatus according to (8) or (9). (12) When the second operation mode is selected by the control unit, the conversion unit performs ITU-R BT. The image processing apparatus according to (8) or (9), wherein the image signal is converted into the display signal in accordance with 1886. (13)
- the signal system is an HLG (Hybrid Log Gamma) system based on a combination of a gamma curve at a luminance level lower than the reference white and a logarithmic curve at a luminance level higher than the reference white.
- the image processing apparatus according to any one of the above.
- the image signal is decoded from an encoded stream encoded according to HEVC (High Efficiency Video Coding) system, Based on parameters included in SEI (Supplemental Enhancement Information) associated with the encoded stream, it is determined that the HLG method is used for the image signal.
- the image processing apparatus according to (13).
- the image signal includes an encoded stream encoded in accordance with HEVC (High Efficiency Video Coding) system, Based on parameters included in VUI (Video Usability Information) associated with the encoded stream, it is determined that the HLG method is used for the image signal.
- VUI Video Usability Information
- Imaging device 10 Imaging device 20 Network 30 Recording device (HDR compatible type) 40 Recording medium 45 Playback device (non-HDR compatible type) 50 Display device (HDR compatible) 55 Display device (non-HDR compatible type) DESCRIPTION OF SYMBOLS 100 Image processing apparatus 110 Image acquisition part 120 Conversion part 130 Control part
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Picture Signal Circuits (AREA)
- Controls And Circuits For Display Device (AREA)
- Transforming Electric Information Into Light Information (AREA)
- Processing Of Color Television Signals (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
Description
なお、上記の効果は必ずしも限定的なものではなく、上記の効果と共に、又は上記の効果に代えて、本明細書に示されたいずれかの効果、又は本明細書から把握され得る他の効果が奏されてもよい。
1.関連技術の説明
1-1.映像信号の変換特性
1-2.HDR映像信号の信号方式の例
1-3.ディスプレイピークへの適応
2.画像処理装置の構成例
2-1.画像取得部
2-2.変換部
2-3.制御部
3.処理の流れ
3-1.画像変換処理
3-2.RW維持ガンマ変換処理
3-3.線形変換処理
4.HLG映像の記録及び再生
4-1.HLG映像の認識
4-2.処理の流れ
4-3.補足的なストリームの扱い
5.ハードウェア構成例
6.応用例
7.まとめ
まず、図1~図4を用いて、本開示に関連する技術について説明する。
図1は、映像信号の変換特性の概略について説明するための説明図である。図1には、撮影装置10、ネットワーク20、記録装置30及び表示装置50が示されている。撮影装置10は、撮影環境において被写体を撮影して、映像信号を生成する。より具体的には、撮影装置10は、CCD(Charge Coupled Device)又はCMOS(Complementary Metal Oxide Semiconductor)といった光電変換素子(イメージセンサ)の配列を有し、撮影環境から入射する光を電気信号へと変換する。光から電気信号への変換の特性は、OETF(Opto-Electronic Transfer Function;光電気伝達関数)でモデル化される。OETFが線形関数であれば、電気信号の電圧レベルは素子ごとの受光量に比例する。但し、ITU-Rにより策定された標準仕様であるBT.709又はBT.2020のOETFは非線形であり、例えば全体的なガンマ値が0.45で、低輝度領域においてのみ線形性を有する。
既存のSDR映像信号の一般的な輝度ダイナミックレンジの上限は、100cd/m2(nitともいう)である。一方、HDR映像信号の輝度ダイナミックレンジの上限は、数百から数千cd/m2へと拡張される。上述したように、ITU-Rは、HDR映像信号の信号方式として、Application-1及びApplication-2という2つの方式を勧告案に併記するものと見込まれている。
C1)基準白色(E=1)でE´=0.5
C2)基準白色の12倍の光強度(E=12)でE´=1
C3)基準白色(E=1)において傾き0.25でガンマ曲線と対数曲線とが滑らかに接続する
HDR信号方式により輝度ダイナミックレンジの上限が拡張されたとしても、ディスプレイのピーク輝度が必ずその上限に一致するわけではない。映像信号に含まれる1つ以上の画素の輝度がディスプレイのピーク輝度を上回る場合には、クリッピングの結果として、再生される映像内でいわゆる白とびが発生する。最大輝度がディスプレイのピーク輝度を下回る場合には、ディスプレイの性能が最大限活用されないことになる。こうしたレンジの不一致を解消するために、いくつかの手法が考えられる。
図5は、一実施形態に係る画像処理装置100の構成の一例を示すブロック図である。画像処理装置100は、例えば、図1に示したような撮影装置、記録装置若しくは表示装置であってもよく、又はこれら装置に搭載される画像処理モジュールであってもよい。図5を参照すると、画像処理装置100は、画像取得部110、変換部120及び制御部130を備える。
画像取得部110は、何らかの信号源から入力画像信号を取得する。入力画像信号は、映像信号を構成する一連のフレームの各々の画像信号であってもよく、又は静止画のための画像信号であってもよい。入力画像信号はHDR信号方式に基づいており、ここでは一例として、ITU-R Application-2に基づく画像信号(以下、HLG画像信号という)が取得されるものとする。ITU-R Application-2は、基準白色の表示輝度レベルを固定的に扱う信号方式の一例である。HLG画像信号は、基準白色の輝度レベルでの正規化後の信号である。
変換部120は、画像取得部110から入力される線形画像信号を、ディスプレイのピーク輝度レベルに基づいて決定されるパラメータを用いて、基準白色の表示輝度レベルが維持されるようにガンマ変換することにより、表示用信号へと変換する。
本実施形態において、変換部120は、次の3通りの基本変換のうちの1つ又は2つ以上の組合せに相当する変換法を用いて、画像信号の信号レベルを変換する。
・基準白色(RW)固定ガンマ変換
・線形変換
・ピーク固定ガンマ変換
第1の変換法において、変換部120は、表示用信号により表現可能な最大輝度レベルをディスプレイのピーク輝度レベルに合わせるように第1のガンマ値γ1を決定し、決定した第1のガンマ値γ1を用いて線形画像信号をガンマ変換する。
第2の変換法において、変換部120は、表示用信号により表現可能な最大輝度レベルをディスプレイのピーク輝度レベルに合わせるようにゲイン値Gを決定し、決定したゲイン値Gを用いて線形画像信号を線形変換する。さらに、変換部120は、基準白色の表示輝度レベルが元の輝度レベルへと復元されるように第2のガンマ値γ2を決定し、決定した第2のガンマ値γ2を用いて上記線形変換後の画像信号をガンマ変換する。変換部120は、第2のガンマ値γ2を用いたガンマ変換を、ピーク輝度レベルを変化させないように実行する。変換部120は、線形画像信号の代わりに、線形画像信号を所定のシステムガンマ値γS(例えば、γS=1.2)を用いてガンマ変換することにより得られる中間画像信号を、第2の変換法への入力信号として扱ってもよい。
変換部120は、基準白色の表示輝度レベルを維持する第1の動作モード及び基準白色の表示輝度レベルを維持しない第2の動作モードの双方をサポートしてもよい。ここでは一例として、第1の動作モード及び第2の動作モードをそれぞれRW維持モード及びRW非維持モードという。変換部120は、RW維持モードが選択された場合には、上述した第1の変換法又は第2の変換法のいずれかを実行する。一方、変換部120は、RW非維持モードが選択された場合には、基準白色の表示輝度レベルを維持することなく、他の手法で表示用信号を出力する。
制御部130は、画像取得部110及び変換部120の動作を制御する。例えば、制御部130は、入力画像信号に関連付けられる制御パラメータから入力画像信号の信号方式を判定し、判定した信号方式に対応する処理を画像取得部110及び変換部120に実行させる。ここでの制御パラメータの例について、後にさらに説明する。制御部130は、入力画像信号の信号方式に応じて、画像取得部110が入力画像信号に適用すべきOETFの逆関数の種類を切り替えさせてもよい。また、制御部130は、画像処理装置100の動作モードを制御してもよい。
[3-1.画像変換処理]
図10は、上述した画像処理装置100により実行される画像変換処理の流れの一例を示すフローチャートである。
(1)第1の例
図11Aは、図10に示したRW維持ガンマ変換処理の流れの第1の例を示すフローチャートである。
図11Bは、図10に示したRW維持ガンマ変換処理の流れの第2の例を示すフローチャートである。
図11Cは、図10に示したRW維持ガンマ変換処理の流れの第3の例を示すフローチャートである。第3の例では、第1の変換法と第2の変換法との間の選択的な切替えが行われる。
図12は、図10に示した線形変換処理の流れの一例を示すフローチャートである。
[4-1.HLG映像の認識]
図5に関連して説明したように、入力画像信号の信号方式は、入力画像信号に関連付けられる制御パラメータに基づいて判定される。一連のフレームの画像信号は、通常、何らかの映像コーデックに従って圧縮符号化された上で、記録媒体に記録され又はネットワーク上で伝送される。信号方式を識別する制御パラメータもまた符号化され、画像信号のビットストリームに関連付けられる。
(1)記録処理
図14は、一実施形態に係る記録装置30により実行される記録処理の流れの一例を示すフローチャートである。図14を参照すると、まず、記録装置30のHLG処理部36は、映像コンテンツの光強度を線形的に表現する原画像信号を取得する(ステップS202)。次に、HLG処理部36は、原画像信号をHLG画像信号に変換する(ステップS204)。次に、符号化部32は、HLG画像信号を符号化して、符号化ストリームを生成する(ステップS206)。次に、制御部38は、HLG方式のOETF番号を示す制御パラメータを生成する(ステップS208)。そして、制御部38は、HLG画像信号の符号化ストリームを記録媒体へ記録すると共に、当該符号化ストリームに関連付けられるVUI又はSEIへ、HLG方式のOETF番号を示す制御パラメータを書き込む(ステップS210)。
図15Aは、一実施形態に係る再生処理の流れの第1の例を示すフローチャートである。図15Aを参照すると、まず、記録装置30の制御部38は、符号化ストリーム及び関連付けられている制御パラメータを記録媒体から読み出す(ステップS222)。次に、復号部34は、読み出された符号化ストリームから画像信号を復号する(ステップS224)。制御部38は、画像信号の信号方式がHLG方式であるか否かを、ステップS222において読み出した制御パラメータに基づいて判定する(ステップS226)。例えば、HLG方式用のOETF番号“18”がVUIに含まれる場合、又は他のOETF番号がVUIに含まれているとしてもSEIにおいてOETF番号が値“18”で上書きされている場合には、画像信号の信号方式はHLG方式であると判定され得る。HLG画像信号ではない画像信号が復号された場合には、処理はステップS228へ進み、非HLG画像信号がディスプレイへ出力される(ステップS228)。HLG画像信号が復号された場合には、処理はステップS230へ進み、制御部38は、出力先のディスプレイがHLG対応型であるか否かをさらに判定する(ステップS230)。出力先のディスプレイがHLG対応型ではない場合には、HLG変換が実行されることなく、画像信号がディスプレイへ出力される(ステップS228)。出力先のディスプレイがHLG対応型である場合、HLG処理部36は、復号された画像信号をHLG方式に従って処理して、広い輝度ダイナミックレンジを有する表示用信号を生成する(ステップS232)。そして、表示用信号がディスプレイへ出力される(ステップS234)。
図15Bは、一実施形態に係る再生処理の流れの第2の例を示すフローチャートである。図15Bを参照すると、まず、記録装置30の制御部38は、符号化ストリーム及び関連付けられている制御パラメータを記録媒体から読み出す(ステップS222)。次に、復号部34は、読み出された符号化ストリームから画像信号を復号する(ステップS224)。制御部38は、画像信号の信号方式がHLG方式であるか否かを、第1の例と同様に、ステップS222において読み出した制御パラメータに基づいて判定する(ステップS226)。HLG画像信号ではない画像信号が復号された場合には、処理はステップS228へ進み、非HLG画像信号がディスプレイへ出力される(ステップS228)。HLG画像信号が復号された場合には、処理はステップS236へ進み、制御部38は、HLG標識のシグナリングと共に、HLG画像信号をディスプレイへ出力する(ステップS236)。
映像コンテンツは、一連のフレームの画像信号、音声信号及び制御信号の符号化ストリームに加えて、字幕情報又はグラフィックス情報を含む補足的なストリームをも有し得る。HDR対応型のレコーダ/プレーヤである記録装置30は、こうした補足的なストリームが画像信号の符号化ストリームに関連付けられている場合に、当該補足的なストリームのコンテンツ(例えば字幕、GUI又はその他の表示オブジェクト)の最大輝度レベルが基準白色の表示輝度レベル(図2におけるE´=0.5)に一致するように、コンテンツの輝度を調整する。これは、HDR非対応型の再生装置45又は表示装置55がSDR映像の最大輝度レベルと補足的なストリームのコンテンツの最大輝度レベルとを一致させることとは対照的である。例えば字幕又はGUIの白色がHDR映像の最大輝度レベル(ヘッドルーム不使用の場合、図2におけるE´=1.0)で表示されてしまうと、その白色は明る過ぎて却って視認性を損なう。しかし、上述したように、補足的なストリームのコンテンツの最大輝度レベルをHDR映像の基準白色の表示輝度レベルに合わせることで、コンテンツの適切な視認性を確保することができる。
上述した実施形態は、ソフトウェア、ハードウェア、及びソフトウェアとハードウェアとの組合せのいずれを用いて実現されてもよい。ソフトウェアが使用される場合、ソフトウェアを構成するプログラムは、例えば、装置の内部又は外部に設けられる記憶媒体(非一時的な媒体:non-transitory media)に予め格納される。そして、各プログラムは、例えば、実行時にRAM(Random Access Memory)に読み込まれ、CPU(Central Processing Unit)などのプロセッサにより実行される。
上述した実施形態は、様々な電子機器に応用され得る。以下、4つの応用例について説明する。
図17は、上述した実施形態を適用したテレビジョン装置の概略的な構成の一例を示している。テレビジョン装置900は、アンテナ901、チューナ902、デマルチプレクサ903、デコーダ904、映像信号処理部905、表示部906、音声信号処理部907、スピーカ908、外部インタフェース909、制御部910、ユーザインタフェース911、及びバス912を備える。
図18は、上述した実施形態を適用した携帯電話機の概略的な構成の一例を示している。携帯電話機920は、アンテナ921、通信部922、音声コーデック923、スピーカ924、マイクロホン925、カメラ部926、画像処理部927、多重分離部928、記録再生部929、表示部930、制御部931、操作部932、及びバス933を備える。
図19は、上述した実施形態を適用した記録再生装置の概略的な構成の一例を示している。記録再生装置940は、例えば、受信した放送番組の音声データ及び映像データを符号化して記録媒体に記録する。また、記録再生装置940は、例えば、他の装置から取得される音声データ及び映像データを符号化して記録媒体に記録してもよい。また、記録再生装置940は、例えば、ユーザの指示に応じて、記録媒体に記録されているデータをモニタ及びスピーカ上で再生する。このとき、記録再生装置940は、音声データ及び映像データを復号する。
図20は、上述した実施形態を適用した撮像装置の概略的な構成の一例を示している。撮影装置960は、被写体を撮像して画像を生成し、画像データを符号化して記録媒体に記録する。
ここまで、図1~図20を用いて、本開示に係る技術の実施形態について詳細に説明した。上述した実施形態によれば、基準白色の表示輝度レベルを固定的に扱う信号方式に基づく画像信号が、表示用信号への変換のためにガンマ変換される。そのガンマ変換は、ディスプレイのピーク輝度レベルに基づいて決定されるパラメータを用いて、基準白色の表示輝度レベルが維持されるように実行される。従って、輝度のクリッピング(又は過剰に強いロールオフ)に起因する高輝度領域の情報の欠損(いわゆる白とび)の発生が回避されると共に、コンテンツの撮影又は制作の際に明るさの基準とされる基準白色の輝度を、コンテンツの表示の際にも適切に再現することが可能となる。
(1)
基準白色の表示輝度レベルを固定的に扱う信号方式に基づく画像信号を、ディスプレイのピーク輝度レベルに基づいて決定されるパラメータを用いて、前記基準白色の表示輝度レベルが維持されるようにガンマ変換することにより、表示用信号へと変換する変換部、
を備える画像処理装置。
(2)
前記画像信号は、前記基準白色の輝度レベルでの正規化後の信号であり、
前記変換部は、第1のガンマ値を用いて前記画像信号をガンマ変換する、
前記(1)に記載の画像処理装置。
(3)
前記変換部は、前記表示用信号により表現可能な最大輝度レベルを前記ディスプレイの前記ピーク輝度レベルに合わせるように前記第1のガンマ値を決定する、前記(2)に記載の画像処理装置。
(4)
前記画像信号は、前記基準白色の輝度レベルでの正規化後の信号であり、
前記変換部は、前記画像信号をゲイン値を用いて線形変換し、前記基準白色の表示輝度レベルが元の輝度レベルへと復元されるように決定される第2のガンマ値を用いて前記線形変換後の画像信号をガンマ変換する、
前記(1)に記載の画像処理装置。
(5)
前記変換部は、前記表示用信号により表現可能な最大輝度レベルを前記ディスプレイの前記ピーク輝度レベルに合わせるように前記ゲイン値を決定する、前記(4)に記載の画像処理装置。
(6)
前記変換部は、前記第2のガンマ値を用いたガンマ変換を、前記表示用信号により表現可能な最大輝度レベルを変化させないように実行する、前記(4)又は前記(5)に記載の画像処理装置。
(7)
前記変換部は、前記画像信号を所定のシステムガンマ値を用いてガンマ変換した後に、前記線形変換及び前記第2のガンマ値を用いた前記ガンマ変換を実行する、前記(4)~(6)のいずれか1項に記載の画像処理装置。
(8)
前記画像処理装置は、前記基準白色の表示輝度レベルが維持される第1の動作モード及び前記基準白色の表示輝度レベルが維持されない第2の動作モードのうち前記変換部が使用すべきモードを選択する制御部、をさらに備え、
前記変換部は、前記制御部により前記第1の動作モードが選択された場合に、前記基準白色の表示輝度レベルが維持されるように、前記画像信号を前記表示用信号へと変換する、
前記(1)~(7)のいずれか1項に記載の画像処理装置。
(9)
前記制御部は、信号方式のタイプ、ユーザ設定、前記ディスプレイの属性及び表示環境の条件のうちの1つ以上に基づいて、前記第1の動作モード及び前記第2の動作モードのうちの前記1つを選択する、前記(8)に記載の画像処理装置。
(10)
前記変換部は、
前記画像信号を前記基準白色の表示輝度レベルが変化しないようにガンマ変換する第1の変換法と、
前記画像信号をゲイン値を用いて線形変換し、前記基準白色の表示輝度レベルが元の輝度レベルへと復元されるように決定される第2のガンマ値を用いて前記線形変換後の画像信号をガンマ変換する第2の変換法と、
を選択的に使用する、前記(1)~(9)のいずれか1項に記載の画像処理装置。
(11)
前記変換部は、前記制御部により前記第2の動作モードが選択された場合に、前記表示用信号により表現可能な最大輝度レベルを前記ディスプレイの前記ピーク輝度レベルに合わせるように決定されるゲイン値を用いて前記画像信号を線形変換する、
前記(8)又は前記(9)に記載の画像処理装置。
(12)
前記変換部は、前記制御部により前記第2の動作モードが選択された場合に、ITU-R BT.1886に従って前記画像信号を前記表示用信号へと変換する、前記(8)又は前記(9)に記載の画像処理装置。
(13)
前記信号方式は、基準白色よりも低い輝度レベルにおけるガンマ曲線と、基準白色よりも高い輝度レベルにおける対数曲線との組合せに基づくHLG(Hybrid Log Gamma)方式である、前記(1)~(12)のいずれか1項に記載の画像処理装置。
(14)
前記画像信号は、HEVC(High Efficiency Video Coding)方式に従って符号化された符号化ストリームから復号され、
前記符号化ストリームに関連付けられるSEI(Supplemental Enhancement Information)に含まれるパラメータに基づいて、前記画像信号について前記HLG方式が使用されたことが判定される、
前記(13)に記載の画像処理装置。
(15)
前記画像信号は、HEVC(High Efficiency Video Coding)方式に従って符号化された符号化ストリームを含み、
前記符号化ストリームに関連付けられるVUI(Video Usability Information)に含まれるパラメータに基づいて、前記画像信号について前記HLG方式が使用されたことが判定される、
前記(13)に記載の画像処理装置。
(16)
前記符号化ストリームに字幕情報又はグラフィックス情報を含む補足的なストリームが関連付けられている場合に、当該補足的なストリームのコンテンツの最大輝度レベルは、前記基準白色の表示輝度レベルに合うように調整される、前記(14)又は前記(15)に記載の画像処理装置。
(17)
画像処理装置により実行される画像処理方法であって、
基準白色の表示輝度レベルを固定的に扱う信号方式に基づく画像信号を、ディスプレイのピーク輝度レベルに基づいて決定されるパラメータを用いて、前記基準白色の表示輝度レベルが維持されるようにガンマ変換することにより、表示用信号へと変換すること、
を含む画像処理方法。
20 ネットワーク
30 記録装置(HDR対応型)
40 記録媒体
45 再生装置(HDR非対応型)
50 表示装置(HDR対応型)
55 表示装置(HDR非対応型)
100 画像処理装置
110 画像取得部
120 変換部
130 制御部
Claims (17)
- 基準白色の表示輝度レベルを固定的に扱う信号方式に基づく画像信号を、ディスプレイのピーク輝度レベルに基づいて決定されるパラメータを用いて、前記基準白色の表示輝度レベルが維持されるようにガンマ変換することにより、表示用信号へと変換する変換部、
を備える画像処理装置。 - 前記画像信号は、前記基準白色の輝度レベルでの正規化後の信号であり、
前記変換部は、第1のガンマ値を用いて前記画像信号をガンマ変換する、
請求項1に記載の画像処理装置。 - 前記変換部は、前記表示用信号により表現可能な最大輝度レベルを前記ディスプレイの前記ピーク輝度レベルに合わせるように前記第1のガンマ値を決定する、請求項2に記載の画像処理装置。
- 前記画像信号は、前記基準白色の輝度レベルでの正規化後の信号であり、
前記変換部は、前記画像信号をゲイン値を用いて線形変換し、前記基準白色の表示輝度レベルが元の輝度レベルへと復元されるように決定される第2のガンマ値を用いて前記線形変換後の画像信号をガンマ変換する、
請求項1に記載の画像処理装置。 - 前記変換部は、前記表示用信号により表現可能な最大輝度レベルを前記ディスプレイの前記ピーク輝度レベルに合わせるように前記ゲイン値を決定する、請求項4に記載の画像処理装置。
- 前記変換部は、前記第2のガンマ値を用いたガンマ変換を、前記表示用信号により表現可能な最大輝度レベルを変化させないように実行する、請求項4に記載の画像処理装置。
- 前記変換部は、前記画像信号を所定のシステムガンマ値を用いてガンマ変換した後に、前記線形変換及び前記第2のガンマ値を用いた前記ガンマ変換を実行する、請求項4に記載の画像処理装置。
- 前記画像処理装置は、前記基準白色の表示輝度レベルが維持される第1の動作モード及び前記基準白色の表示輝度レベルが維持されない第2の動作モードのうち前記変換部が使用すべきモードを選択する制御部、をさらに備え、
前記変換部は、前記制御部により前記第1の動作モードが選択された場合に、前記基準白色の表示輝度レベルが維持されるように、前記画像信号を前記表示用信号へと変換する、
請求項1に記載の画像処理装置。 - 前記制御部は、信号方式のタイプ、ユーザ設定、前記ディスプレイの属性及び表示環境の条件のうちの1つ以上に基づいて、前記第1の動作モード及び前記第2の動作モードのうちの前記1つを選択する、請求項8に記載の画像処理装置。
- 前記変換部は、
前記画像信号を前記基準白色の表示輝度レベルが変化しないようにガンマ変換する第1の変換法と、
前記画像信号をゲイン値を用いて線形変換し、前記基準白色の表示輝度レベルが元の輝度レベルへと復元されるように決定される第2のガンマ値を用いて前記線形変換後の画像信号をガンマ変換する第2の変換法と、
を選択的に使用する、請求項1に記載の画像処理装置。 - 前記変換部は、前記制御部により前記第2の動作モードが選択された場合に、前記表示用信号により表現可能な最大輝度レベルを前記ディスプレイの前記ピーク輝度レベルに合わせるように決定されるゲイン値を用いて前記画像信号を線形変換する、
請求項8に記載の画像処理装置。 - 前記変換部は、前記制御部により前記第2の動作モードが選択された場合に、ITU-R BT.1886に従って前記画像信号を前記表示用信号へと変換する、請求項8に記載の画像処理装置。
- 前記信号方式は、基準白色よりも低い輝度レベルにおけるガンマ曲線と、基準白色よりも高い輝度レベルにおける対数曲線との組合せに基づくHLG(Hybrid Log Gamma)方式である、請求項1に記載の画像処理装置。
- 前記画像信号は、HEVC(High Efficiency Video Coding)方式に従って符号化された符号化ストリームから復号され、
前記符号化ストリームに関連付けられるSEI(Supplemental Enhancement Information)に含まれるパラメータに基づいて、前記画像信号について前記HLG方式が使用されたことが判定される、
請求項13に記載の画像処理装置。 - 前記画像信号は、HEVC(High Efficiency Video Coding)方式に従って符号化された符号化ストリームを含み、
前記符号化ストリームに関連付けられるVUI(Video Usability Information)に含まれるパラメータに基づいて、前記画像信号について前記HLG方式が使用されたことが判定される、
請求項13に記載の画像処理装置。 - 前記符号化ストリームに字幕情報又はグラフィックス情報を含む補足的なストリームが関連付けられている場合に、当該補足的なストリームのコンテンツの最大輝度レベルは、前記基準白色の表示輝度レベルに合うように調整される、請求項14に記載の画像処理装置。
- 画像処理装置により実行される画像処理方法であって、
基準白色の表示輝度レベルを固定的に扱う信号方式に基づく画像信号を、ディスプレイのピーク輝度レベルに基づいて決定されるパラメータを用いて、前記基準白色の表示輝度レベルが維持されるようにガンマ変換することにより、表示用信号へと変換すること、
を含む画像処理方法。
Priority Applications (8)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201680054234.1A CN108028036B (zh) | 2015-09-25 | 2016-08-02 | 图像处理设备和图像处理方法 |
MX2018003360A MX2018003360A (es) | 2015-09-25 | 2016-08-02 | Aparato de procesamiento de imagenes y metodo de procesamiento de imagenes. |
JP2017541465A JP6825568B2 (ja) | 2015-09-25 | 2016-08-02 | 画像処理装置及び画像処理方法 |
EP16848400.4A EP3355300B1 (en) | 2015-09-25 | 2016-08-02 | Image processing device and image processing method |
US15/759,686 US10638023B2 (en) | 2015-09-25 | 2016-08-02 | Image processing apparatus and image processing method |
CA2999098A CA2999098A1 (en) | 2015-09-25 | 2016-08-02 | Image processing apparatus and image processing method |
AU2016326942A AU2016326942B2 (en) | 2015-09-25 | 2016-08-02 | Image processing device and image processing method |
HK18106869.5A HK1247369A1 (zh) | 2015-09-25 | 2018-05-25 | 圖像處理設備和圖像處理方法 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2015188348 | 2015-09-25 | ||
JP2015-188348 | 2015-09-25 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017051612A1 true WO2017051612A1 (ja) | 2017-03-30 |
Family
ID=58385969
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2016/072691 WO2017051612A1 (ja) | 2015-09-25 | 2016-08-02 | 画像処理装置及び画像処理方法 |
Country Status (10)
Country | Link |
---|---|
US (1) | US10638023B2 (ja) |
EP (1) | EP3355300B1 (ja) |
JP (1) | JP6825568B2 (ja) |
CN (1) | CN108028036B (ja) |
AU (1) | AU2016326942B2 (ja) |
CA (1) | CA2999098A1 (ja) |
HK (1) | HK1247369A1 (ja) |
MX (1) | MX2018003360A (ja) |
TW (1) | TWI704551B (ja) |
WO (1) | WO2017051612A1 (ja) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018047753A1 (ja) * | 2016-09-09 | 2018-03-15 | パナソニックIpマネジメント株式会社 | 表示装置および信号処理方法 |
JP2018195911A (ja) * | 2017-05-15 | 2018-12-06 | 日本放送協会 | 映像信号変換装置、ダイナミックレンジ変換装置およびそれらのプログラム |
WO2019044171A1 (ja) * | 2017-08-28 | 2019-03-07 | シャープ株式会社 | 映像処理装置、表示装置、映像処理方法、制御プログラム、および記録媒体 |
JP2019103041A (ja) * | 2017-12-05 | 2019-06-24 | 株式会社ソニー・インタラクティブエンタテインメント | 画像処理装置および画像処理方法 |
JP2019193025A (ja) * | 2018-04-20 | 2019-10-31 | 日本放送協会 | 映像輝度変換装置およびそのプログラム |
US10600163B2 (en) | 2017-11-22 | 2020-03-24 | Interdigital Vc Holdings, Inc. | Method and device for reconstructing a display adapted HDR image |
WO2020060186A1 (ko) * | 2018-09-18 | 2020-03-26 | 엘지전자 주식회사 | 영상표시장치 |
US11722704B2 (en) | 2018-12-21 | 2023-08-08 | Interdigital Vc Holdings, Inc. | Decoding an image |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10917583B2 (en) * | 2018-04-27 | 2021-02-09 | Apple Inc. | Standard and high dynamic range display systems and methods for high dynamic range displays |
US20200045341A1 (en) * | 2018-07-31 | 2020-02-06 | Ati Technologies Ulc | Effective electro-optical transfer function encoding for limited luminance range displays |
US10964289B2 (en) * | 2019-07-25 | 2021-03-30 | Google Llc | OLED display with different spatial gamma |
JP7370762B2 (ja) * | 2019-08-20 | 2023-10-30 | キヤノン株式会社 | 撮像装置およびその制御方法 |
CN115946632B (zh) * | 2023-01-10 | 2023-08-18 | 润芯微科技(江苏)有限公司 | 一种多屏显示的中控娱乐系统及显示方法 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006215756A (ja) * | 2005-02-02 | 2006-08-17 | Dainippon Ink & Chem Inc | 画像処理装置および画像処理方法ならびにそのプログラム |
JP2007163979A (ja) * | 2005-12-15 | 2007-06-28 | Fujifilm Corp | プロファイル作成装置、プロファイル作成プログラム、および画像出力装置 |
JP2012504259A (ja) * | 2008-09-30 | 2012-02-16 | ドルビー ラボラトリーズ ライセンシング コーポレイション | 高ブライトネスで高ダイナミックレンジのディスプレイのための画像処理における適応ガンマの適用のためのシステムおよび方法 |
JP2014531821A (ja) * | 2011-09-27 | 2014-11-27 | コーニンクレッカ フィリップス エヌ ヴェ | 画像のダイナミックレンジ変換のための装置及び方法 |
Family Cites Families (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100214634B1 (ko) * | 1996-12-21 | 1999-08-02 | 구자홍 | 프로젝션 티브이의 b색 감마보정 회로 |
US7590299B2 (en) * | 2004-06-10 | 2009-09-15 | Samsung Electronics Co., Ltd. | Increasing gamma accuracy in quantized systems |
KR100748333B1 (ko) * | 2006-11-30 | 2007-08-09 | 삼성에스디아이 주식회사 | 플라즈마 표시 패널의 구동장치 및 그 구동방법 |
US8803922B2 (en) * | 2007-05-30 | 2014-08-12 | Apple Inc. | Methods and apparatuses for increasing the apparent brightness of a display |
CN101329842B (zh) * | 2007-06-22 | 2011-06-15 | 深圳创维-Rgb电子有限公司 | 一种能对显示屏进行gamma校正的液晶显示器及其制作方法 |
US8345038B2 (en) * | 2007-10-30 | 2013-01-01 | Sharp Laboratories Of America, Inc. | Methods and systems for backlight modulation and brightness preservation |
TWI401667B (zh) * | 2008-05-23 | 2013-07-11 | Innolux Corp | 液晶顯示器加馬校正電路及方法 |
CN102177539B (zh) * | 2008-10-14 | 2014-07-23 | 杜比实验室特许公司 | 用于处理信号的设备和方法 |
KR101330396B1 (ko) * | 2010-06-25 | 2013-11-15 | 엘지디스플레이 주식회사 | 표시장치와 그의 콘트라스트 향상 방법 |
JP5744429B2 (ja) * | 2010-07-16 | 2015-07-08 | キヤノン株式会社 | 画像処理装置、画像処理方法、およびプログラム |
WO2012012489A2 (en) * | 2010-07-22 | 2012-01-26 | Dolby Laboratories Licensing Corporation | Display management server |
US8743291B2 (en) * | 2011-04-12 | 2014-06-03 | Dolby Laboratories Licensing Corporation | Quality assessment for images that have extended dynamic ranges or wide color gamuts |
EP2819414A3 (en) * | 2013-06-28 | 2015-02-25 | Samsung Electronics Co., Ltd | Image processing device and image processing method |
CN105393525B (zh) * | 2013-07-18 | 2019-04-12 | 皇家飞利浦有限公司 | 创建用于对hdr图像编码的代码映射函数的方法和装置以及使用这样的编码图像的方法和装置 |
KR101477505B1 (ko) * | 2013-12-23 | 2015-01-07 | 이동현 | 하이 다이나믹 레인지 영상 형성 방법 |
CN104935911B (zh) * | 2014-03-18 | 2017-07-21 | 华为技术有限公司 | 一种高动态范围图像合成的方法及装置 |
WO2017022513A1 (ja) * | 2015-07-31 | 2017-02-09 | ソニー株式会社 | 映像信号処理装置および映像信号処理方法、ならびに表示装置 |
-
2016
- 2016-08-02 EP EP16848400.4A patent/EP3355300B1/en active Active
- 2016-08-02 CN CN201680054234.1A patent/CN108028036B/zh active Active
- 2016-08-02 MX MX2018003360A patent/MX2018003360A/es unknown
- 2016-08-02 CA CA2999098A patent/CA2999098A1/en not_active Abandoned
- 2016-08-02 JP JP2017541465A patent/JP6825568B2/ja active Active
- 2016-08-02 WO PCT/JP2016/072691 patent/WO2017051612A1/ja active Application Filing
- 2016-08-02 US US15/759,686 patent/US10638023B2/en not_active Expired - Fee Related
- 2016-08-02 AU AU2016326942A patent/AU2016326942B2/en not_active Ceased
- 2016-08-29 TW TW105127701A patent/TWI704551B/zh not_active IP Right Cessation
-
2018
- 2018-05-25 HK HK18106869.5A patent/HK1247369A1/zh unknown
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006215756A (ja) * | 2005-02-02 | 2006-08-17 | Dainippon Ink & Chem Inc | 画像処理装置および画像処理方法ならびにそのプログラム |
JP2007163979A (ja) * | 2005-12-15 | 2007-06-28 | Fujifilm Corp | プロファイル作成装置、プロファイル作成プログラム、および画像出力装置 |
JP2012504259A (ja) * | 2008-09-30 | 2012-02-16 | ドルビー ラボラトリーズ ライセンシング コーポレイション | 高ブライトネスで高ダイナミックレンジのディスプレイのための画像処理における適応ガンマの適用のためのシステムおよび方法 |
JP2014531821A (ja) * | 2011-09-27 | 2014-11-27 | コーニンクレッカ フィリップス エヌ ヴェ | 画像のダイナミックレンジ変換のための装置及び方法 |
Non-Patent Citations (1)
Title |
---|
See also references of EP3355300A4 * |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018047753A1 (ja) * | 2016-09-09 | 2018-03-15 | パナソニックIpマネジメント株式会社 | 表示装置および信号処理方法 |
JP2018195911A (ja) * | 2017-05-15 | 2018-12-06 | 日本放送協会 | 映像信号変換装置、ダイナミックレンジ変換装置およびそれらのプログラム |
WO2019044171A1 (ja) * | 2017-08-28 | 2019-03-07 | シャープ株式会社 | 映像処理装置、表示装置、映像処理方法、制御プログラム、および記録媒体 |
JP2019041329A (ja) * | 2017-08-28 | 2019-03-14 | シャープ株式会社 | 映像処理装置、表示装置、映像処理方法、制御プログラム、および記録媒体 |
US10600163B2 (en) | 2017-11-22 | 2020-03-24 | Interdigital Vc Holdings, Inc. | Method and device for reconstructing a display adapted HDR image |
JP2019103041A (ja) * | 2017-12-05 | 2019-06-24 | 株式会社ソニー・インタラクティブエンタテインメント | 画像処理装置および画像処理方法 |
US11094286B2 (en) | 2017-12-05 | 2021-08-17 | Sony Interactive Entertainment Inc. | Image processing apparatus and image processing method |
JP2019193025A (ja) * | 2018-04-20 | 2019-10-31 | 日本放送協会 | 映像輝度変換装置およびそのプログラム |
JP7045916B2 (ja) | 2018-04-20 | 2022-04-01 | 日本放送協会 | 映像輝度変換装置およびそのプログラム |
WO2020060186A1 (ko) * | 2018-09-18 | 2020-03-26 | 엘지전자 주식회사 | 영상표시장치 |
US11532289B2 (en) | 2018-09-18 | 2022-12-20 | Lg Electronics Inc. | Image display apparatus |
US11722704B2 (en) | 2018-12-21 | 2023-08-08 | Interdigital Vc Holdings, Inc. | Decoding an image |
Also Published As
Publication number | Publication date |
---|---|
TWI704551B (zh) | 2020-09-11 |
US10638023B2 (en) | 2020-04-28 |
JP6825568B2 (ja) | 2021-02-03 |
CA2999098A1 (en) | 2017-03-30 |
EP3355300A1 (en) | 2018-08-01 |
MX2018003360A (es) | 2018-05-30 |
TW201721627A (zh) | 2017-06-16 |
CN108028036B (zh) | 2021-01-29 |
AU2016326942B2 (en) | 2019-10-10 |
JPWO2017051612A1 (ja) | 2018-08-30 |
AU2016326942A1 (en) | 2018-03-15 |
US20190045091A1 (en) | 2019-02-07 |
EP3355300A4 (en) | 2019-06-19 |
EP3355300B1 (en) | 2021-09-29 |
CN108028036A (zh) | 2018-05-11 |
HK1247369A1 (zh) | 2018-09-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6825568B2 (ja) | 画像処理装置及び画像処理方法 | |
JP7065376B2 (ja) | 表示装置、変換装置、表示方法、および、コンピュータプログラム | |
CN110213459B (zh) | 显示方法和显示装置 | |
US10009613B2 (en) | Method, systems and apparatus for HDR to HDR inverse tone mapping | |
CN107203974B (zh) | 扩展的高动态范围hdr到hdr色调映射的方法、装置和系统 | |
EP3157251B1 (en) | Playback method and playback apparatus | |
US10779009B2 (en) | Image decoding device and method | |
AU2014335620A1 (en) | Decoding device and decoding method, and coding device and coding method | |
KR20170115528A (ko) | Hdr 화상을 sdr 화상으로 맵핑하기 위한 방법 및 디바이스 그리고 대응하는 sdr 대 hdr 맵핑 방법 및 디바이스 | |
CN106133817B (zh) | 图像处理装置、图像处理方法和程序 | |
KR20160052459A (ko) | 복호 장치 및 복호 방법, 부호화 장치, 및 부호화 방법 | |
JP6213341B2 (ja) | 画像処理装置、画像処理方法、およびプログラム | |
JP2007295022A (ja) | 撮像装置と映像信号処理方法および映像信号処理プログラム | |
US20240013356A1 (en) | Method for generating high dynamic range image, and image processing system | |
JP6868797B2 (ja) | 変換方法及び変換装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16848400 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2017541465 Country of ref document: JP Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2016326942 Country of ref document: AU Date of ref document: 20160802 Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2999098 Country of ref document: CA |
|
WWE | Wipo information: entry into national phase |
Ref document number: MX/A/2018/003360 Country of ref document: MX |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: 112018005243 Country of ref document: BR |
|
ENP | Entry into the national phase |
Ref document number: 112018005243 Country of ref document: BR Kind code of ref document: A2 Effective date: 20180316 |