CN106204474B - Local multi-grade tone mapping arithmetic unit - Google Patents

Local multi-grade tone mapping arithmetic unit Download PDF

Info

Publication number
CN106204474B
CN106204474B CN201610516542.3A CN201610516542A CN106204474B CN 106204474 B CN106204474 B CN 106204474B CN 201610516542 A CN201610516542 A CN 201610516542A CN 106204474 B CN106204474 B CN 106204474B
Authority
CN
China
Prior art keywords
image
ratio
tone mapping
value
grade
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610516542.3A
Other languages
Chinese (zh)
Other versions
CN106204474A (en
Inventor
G·J·沃德
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dolby Laboratories Licensing Corp
Original Assignee
Dolby Laboratories Licensing Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dolby Laboratories Licensing Corp filed Critical Dolby Laboratories Licensing Corp
Publication of CN106204474A publication Critical patent/CN106204474A/en
Application granted granted Critical
Publication of CN106204474B publication Critical patent/CN106204474B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G06T5/92
    • G06T5/90
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/40Image enhancement or restoration by the use of histogram techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/50Image enhancement or restoration by the use of more than one image, e.g. averaging, subtraction
    • G06T5/94
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/02Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the way in which colour is displayed
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20016Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20072Graph-based image processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20172Image enhancement details
    • G06T2207/20208High dynamic range [HDR] image processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20212Image combination
    • G06T2207/20221Image fusion; Image merging

Abstract

This disclosure relates to local multi-grade tone mapping arithmetic unit.Provide the technology that local multi-grade tone mapping is applied to the image of opposite high dynamic range.Global ratio operator can be applied to derived from high dynamic range (HDR) image of input brightness value to generate the high resolution gray ratio image including brighteness ratio value.The local multi-grade gray scale ratio image of weighted array including at least two different gray scale ratio images can be generated.Each of at least two different gray scale ratio images can have different space resolution levels.Rate value in local multi-grade gray scale ratio image can be used to generate together with the brightness value derived from the HDR image of input tone mapping gray level image.

Description

Local multi-grade tone mapping arithmetic unit
It is on March 1st, 2012 that the application, which is application No. is 201280011203.X, the applying date, entitled " part is more The divisional application of the application for a patent for invention of grade tone mapping arithmetic unit ".
Cross reference to related applications
This application claims the U.S. Provisional Patent Application No.61/448 that March 2 in 2011 submits, 606 priority passes through Entire contents are incorporated to this by reference.
This application involves the U.S. Patent Application No. No.11/568 that January 7 in 2008 submits, 030, it is by reference that it is complete Portion's content is incorporated to this.
Technical field
This patent disclosure relates generally to image procossings, and particularly high dynamic range images are handled.
Background technique
Human eyesight can identify up to 1: 10,000 or bigger contrast ratio.Most conventional digital image format (institute 24 bit formats of meaning) using being up to 24 bits both color and the luminance information that store each pixel in image.It is this Format is properly termed as " output reference standard ", because they do not attempt to save in addition to can leaving by past most-often used type Image information except the image information that electronic console reproduces.
Display technology developed by assignee etc. can reproduce the image with high dynamic range (HDR).It is this Display can reproduce the image of representing real world scene more verily than traditional monitor.
In order to support that backward compatibility and new HDR display technology, HDR image can be by the colors with attaching metadata Mapping image is adjusted to represent.On the one hand, tone mapping image be used to represent normal dynamic range image (such as leaving display On device).On the other hand, attaching metadata can be used to generate together with tone mapping image, restore or indicate HDR image (such as passing through HDR display).
Some different tone mapping arithmetic units (TMO, tone mapping operator) can be used to be based on HDR Image creation tone mapping image.Among these TMO, Reinhard overall situation photography arithmetic unit is used to relatively efficiently generate Tone mapping image.However, the shortcomings that Reinhard arithmetic unit, is to be lost relatively great amount of image detail, in bright area It is especially true in domain.Bilateral filter is used to generate the tone mapping image of relative high quality.However, the meter of bilateral filter It is very high to be counted as this, it may be possible to 60 times of the relatively simple TMO of such as Reinhard arithmetic unit.Such as Histogram adjustment is transported Other TMO for calculating device or gradient field arithmetic unit are found the good of those TMO work not as mentioned above.U.S. Patent No. No. 6285798 describe a kind of computer for the digital picture with the dynamic range for being greater than desired output display media The auto tone method of adjustment of processing.
The method described in this chapters and sections is the method that can be carried out, but the side for having conceived or having carried out before being not necessarily Method.Therefore, unless otherwise indicated, it otherwise should not assume that any method is merely due to they are incorporated herein chapter described in this chapters and sections The prior art is counted as in section.Similarly, unless specifically stated otherwise, otherwise the asking for identifying about one or more methods Topic should not assume to be identified in the prior art any based on this chapters and sections.
Summary of the invention
In one aspect, a kind of method for local tone mapping is provided, it is high dynamic the method includes receiving input State range image;The brightness value inputted in high dynamic range images is converted into log-domain to generate log input images;It will Global tone mapping operations device is applied to the log input images to generate logarithm global tone mapping image;Based on described right The brightness value of number global tone mapping image and the input high dynamic range images generates high-resolution ratio image;Based on height Resolution ratio ratio image generates at least two different brackets ratio images, every in at least two different brackets ratio image A image has different space resolution levels;Merge at least two different brackets ratio image to generate including described The local multi-grade ratio image of the weighted array of at least two different brackets ratio images, wherein the part multi-grade ratio Rate image is obtained using Recursion process;The local multi-grade ratio image is added with the log input images with The brightness generated in log-domain exports tone mapping image.
On the other hand, it provides a kind of equipment for local tone mapping, including processor and is configured to hold Row method described in the text.
On the other hand, a kind of equipment including being configured to execute the device of method described in the text is provided.
On the other hand, a kind of equipment for local tone mapping is provided, comprising: one or more processors;With And one or more storage mediums of store instruction, described instruction to execute when being executed by one or more of processors Method described in the text.
On the other hand, a kind of non-transient storage media is provided, store instruction, described instruction is by one or more Reason device to execute method described in the text when executing.
Detailed description of the invention
It is not construed as limiting as an example and the present invention is shown in the accompanying drawings, similar reference number refers to phase in the accompanying drawings As element, in which:
Figure 1A shows the exemplary local multi-grade tone mapping system of some possible embodiments according to the present invention;
Figure 1B is the block diagram for showing the exemplary local multi-grade ratio calculations device of some possible embodiments according to the present invention;
Fig. 2 shows the explanation exemplary local multi-grade image processing methods of some possible embodiments according to the present invention Block diagram;
Fig. 3 shows explanation exemplary local multi-grade (ratio) arithmetic unit of some possible embodiments according to the present invention Block diagram;
Fig. 4 A shows the exemplary process flow of possible embodiment according to the present invention;
Fig. 4 B shows the exemplary process flow of possible embodiment according to the present invention;With
Fig. 5 shows the exemplary hardware platform of possible embodiment according to the present invention, may be implemented on the platform as Computer described herein calculates equipment.
Specific embodiment
It is described herein to be related to the exemplary possible embodiment of local multi-grade tone mapping technique.In the following description, For purposes of illustration, many specific details are illustrated to provide a thorough understanding of the present invention.It may be evident The present invention can be carried out without these specific details.In other instances, it is known that structure and equipment do not have Have and is at large described to avoid unnecessarily including, obscuring or obscure the present invention.
Exemplary embodiment is described according to following outline herein:
1. general overview
2. multi-grade part tone mapping system
3. multi-grade part tone mapping arithmetic unit
4 local multi-grade image processing methods
5. local multi-grade arithmetic unit
6. exemplary flow
7. realization mechanism-HARDWARE OVERVIEW
8. equivalent, extension, substitute and miscellaneous
1. general overview
The general view gives the basic description of some aspects of possibility embodiment of the invention.It should be pointed out that the general view is not Be the scalability of the various aspects of the possible embodiment or detailed summary.Further, it should be noted that the general view is not intended to and is seen as It is any particular importance or element for identifying the possible embodiment, is not intended to and is regarded as describing the possibility in fact Any range for applying example less depicts of the invention overall.The general view is only to simplify and simple format describes and example Property may the related some concepts of embodiment, and should only be regarded as exemplary possible embodiment given below more in detail The conceptual preamble carefully described.
In some possible embodiments, picture format can be used to support that HDR image is presented and non-HDR image is in It is existing.The example of picture format discussed here can be JPEG, MPEG, AVI, TIFF, BMP, GIF or other suitable formats. One particular example of this image is JPEG-HDR, replaces JPEG and is used to that new HDR is supported to show in equipment simultaneously HDR image is presented and HDR or non-HDR shows that the non-HDR image in equipment is presented.JPEG-HDR stores tone mapping image to such as In normal place defined in JPEG (such as in bit stream, disk format medium) and by attaching metadata storage to can be non- HDR is shown in the new position that equipment is ignored.Attaching metadata can be used to generate together with tone mapping image/store again The HDR version of original HDR image.
In some possible embodiments, attaching metadata as described herein is to utilize technology as described herein from original Multi-grade gray scale ratio image in part derived from beginning HDR image.In some possible embodiments, such as the color of extension YCC colour gamut Domain can be used together can be realized such as from tone mapping image and local multi-grade gray scale ratio herein with picture format The complete recovery at each pixel in the HDR version of image generation/recovery original HDR image.In some possible embodiments In, technology as described herein minimizes the number of the tone mapping value of the complete black in tone mapping image to lower than threshold Value (such as 0.01%, 0.1%, 1%, 2% etc. of the sum of all pixels in tone mapping image) is can be realized original HDR image HDR version in each pixel at complete recovery.
According to technology here, global contrast is compressed to be suitble to desired brightness value output area and lose as using The substitution for losing global tone mapping (TM) arithmetic unit of the local contrast important to human visual perception, it is more to can be used part The processing of grade tone mapping improves the local contrast compromised in global TM arithmetic unit, simultaneously original sample guarantor to generate Stay the tone mapping image of overall map.In some possible embodiments, local multi-grade TM processing uses global curve (such as Histogram adjustment TM curve) carrys out map intensity values without losing details.In some possible embodiments, part is more Grade TM processing is efficiently executed without generating/introducing new pseudomorphism (such as ring of light) in the process.In certain embodiments, Efficient recursive processing is carried out to execute local multi-grade processing as described herein with Computationally efficient.Specifically may In embodiment, local multi-grade, which is handled, only takes the time that more 30% are handled than the TM carried out by global TM arithmetic unit.
In some possible embodiments, input HDR image is loaded into and its brightness value is switched in log-domain.Directly Side's figure adjustment TM curve is calculated and is applied to brightness value so that it is determined that global ratio gray level image.As used herein Like that, ratio image typically refers to include bright in image before tone mapping (such as input HDR image or its logarithm equivalent) The rate value between brightness value after angle value and tone mapping in image (such as tone mapping image or its logarithm equivalent) Image.In some possible embodiments, ratio image is logically represented as each location of pixels in non-logarithmic domain Image before the tone mapping that place is removed by image after tone mapping, or equally it is expressed as each location of pixels in log-domain Place subtracts after tone mapping image before the tone mapping of image.In some other possible embodiments, ratio image is in logic On be expressed as each pixel position in non-logarithmic domain by tone mapping before image after the tone mapping removed of image, or it is equivalent Ground is expressed as each pixel position in log-domain and subtracts before tone mapping image after the tone mapping of image.It is all this In a little embodiments, it is noted that if image before ratio image (such as part multi-grade TM image) and tone mapping (such as it is defeated Enter HDR image) be it is known, then image (such as part multi-grade TM image) can be transported by simple algebra before tone mapping Calculate (such as the multiplication/division in non-logarithmic domain;Addition/subtraction in log-domain) and obtain.
In some possible embodiments, in log-domain, being used to generate will be integrated into local multi-grade ratio The global ratio images of other ratio images be efficiently to be calculated and using the subtraction of 16 bit integer amounts.Some In possible embodiment, the reference maximum value on tone mapping image can be calculated and tone mapping image can be modified So that being not more than the pixel of small percentage except the colour gamut (such as extension YCC colour gamut) supported.
In some possible embodiments, mechanism as described herein forms a part of display system, the display system System includes but is not limited to television set, laptop computer, laptop, cellular radio, E-book reader, point of sale end Terminal, desktop computer, computer table, computer pavilion, the terminal of various other types and display unit etc..
To the various modifications of general principle described herein and feature and preferred embodiment for those skilled in the art For be obvious.Therefore, the disclosure be not intended to be limited to shown in embodiment, but should be given with it is described herein Principle and the consistent widest range of feature.2. multi-grade part tone mapping system
Figure 1A shows the exemplary local multi-grade tone mapping system of some possible embodiments according to the present invention (100).In some possible embodiments, local multi-grade tone mapping system (100) can use the local multi-grade tone of realization The software and/or hardware component of processing is mapped to be configured, and part multi-grade tone mapping processing will input HDR image (example As 102) being converted into including local multi-grade tone mapping (TM) image from input format (rgb format for example including floating point values) The combined output format of (such as 110) and local multi-grade ratio image (such as 106).
In some possible embodiments, system (100) may include being configured to from one of many possible input sources The software and/or hardware component of input HDR image (102) is extracted or receives, which may include (but being not limited to) interconnection Net, storage medium (such as blue-ray DVD, hard disk, network access memory (NAS, network access storage) etc.), nothing The broadcast of line electricity, satellite broadcasting, cable etc..Input HDR image (102) may or may not be the input image sequence of such as video flowing A part.System (100) can will input HDR image (102) store/be cached to internal random access quick storage space or In another type of free memory.
In some possible embodiments, system (100) may include being configured to based on input HDR image (102) life At the global ratio operator (such as 120) of global ratio image (such as 122).System (100) can store/cache global ratio Rate image (122) is into internal random access quick storage space.In some possible embodiments, global ratio operator (120) it can correspond to global tone mapper (it can be realized in the form of function, distribution, curve, tables of data etc.), such as Color histogram adjusts TM arithmetic unit.For purposes of the present invention, as color histogram adjustment TM arithmetic unit substitution or with Its in combination, such as other overall situation TM arithmetic units of Reinhard arithmetic unit etc. can be used, as can transport with global ratio Calculate device (120) corresponding global tone mapper.In some possible embodiments, the space of global ratio image (122) Resolution levels (resolution level) can be (but are not limited to) the space resolution level phase with input HDR image Together.As used herein, space resolution level refers to the highest acutance rank that image is configured to be expressed, and can quilt It is indicated using the number of the independent pixel in one or more Spatial Dimensions.Therefore, the image of low spatial resolution rank is worked as It is sampled (upsamp1ed) or is maintained at identical low spatial resolution rank when being blurred to greater room dimension.
In some possible embodiments, system (100) may include local multi-grade ratio calculations device (such as 104). Local multi-grade ratio calculations device (104) usually may include being configured to receive global ratio image (such as 122), to the overall situation Ratio image (122) executes local multi-grade ratio operation and generates local multi-grade ratio based on global ratio image (122) The software and/or hardware of rate image (106).
In some possible embodiments, system (100) may include local multi-grade tone mapping (TM) arithmetic unit (example As 108).Local multi-grade TM arithmetic unit (108) usually may include being configured to using HDR image (102) and locally mostly etc. Grade ratio image (106) executed as input local multi-grade tone mapping operate and based on HDR image and part mostly etc. Grade ratio image (106) and generate part multi-grade TM image (110) as export software and/or hardware.
In some possible embodiments, system (100) be may be configured with to other into the system that is in or be not in (100) Equipment and/or other component provide the software of part multi-grade TM image (110) and/or local multi-grade ratio image (106) And/or hardware component.In one example, system (100) can provide part multi-grade TM figure in the first output (such as 112) Local multi-grade ratio image (106) is provided as (110) and in the second output (such as 114).As used herein, first Output (112) and the second output (114) can be physics or logic.In one example, two separation can be used Data path carries this two outputs (112 and 114).In another example, individual data path (such as 124) can be by For carrying this two outputs (112 and 114).For example, the two outputs (112 and 114) of the first and second outputs, or in which Local multi-grade ratio and TM image (106 and 110) can be coded in the individual bit with logical construction as follows In stream, each of local multi-grade ratio and TM image (106 and 110) can be decoded/be fetched from the logical construction.
In some possible embodiments, system (100) can only provide local multi-grade ratio and TM image (106 Hes 110) one in.In one example, system (100) may be configured to only provide part multi-grade TM image (110) to Non- HDR shows equipment.In some possible embodiments, system (100) be may be configured to or (1) only provides part mostly etc. Grade TM image (110) or (2) provides both local multi-grade ratio and TM image (106 and 110) to HDR display equipment.? In some possible embodiments, local multi-grade ratio and TM image (106 and 110) from system (100) can be by having Shape medium (such as CD, server Internet-based, NAS, storage medium etc.) and by storage/transmission, show that equipment can be with The image that decode/fetch from tangible medium selection or image combination.
3. multi-grade part tone mapping arithmetic unit
Figure 1B be show some possible embodiments according to the present invention exemplary local multi-grade ratio calculations device (such as 104) block diagram.
In some possible embodiments, local multi-grade ratio calculations device (104) usually may include being configured to base Creating in global ratio image (122) includes ratio image 1 (122-1) ... and one group of ratio of ratio image N (122-N) The software and/or hardware component of image, wherein N be indicate the group in different ratio images number be greater than one (1) just Integer.In some possible embodiments, this group of ratio image includes at least two differences with different spatial resolutions rank Ratio image.In some possible embodiments, global ratio image (122) is contained in this group of ratio image as member In.In some other possible embodiments, global ratio image (122) is not contained in this group of ratio image as member In.In one example, this group of ratio image includes global ratio image (122) and other one or more ratio image (its It may include such as 122-N).Global ratio image (122) can have identical as the input space resolution level of HDR image Space resolution level, and at least one of other one or more ratio images can have than input HDR image more Low space resolution level is (for example, (2x) twice thick, four times (4x), octuple (8x) in one or more Spatial Dimensions Deng).In another example, this group of ratio image includes two or more ratio images, they are not global ratio charts As (122).A ratio image (such as 122-1) in two or more ratio images can have than input HDR figure As low the first space resolution level (such as in one or more Spatial Dimensions (2x) twice thick, four times (4x), it is octuple (8x) etc.), and the other ratio images of at least one of two or more ratio images can have than input HDR image it is low Different second space resolution levels (such as thick four times (4x), octuple (8x), 16 in one or more Spatial Dimensions (16x) etc. again).
In some possible embodiments, local multi-grade ratio calculations device (104) usually may include being configured to directly Or each of the not overall situation ratio image (122) in this group of ratio image itself is generated based on global ratio image (122) indirectly The software and/or hardware component of ratio image.As used herein, " it is specific to be directly based upon global ratio image generation Ratio image ", which refers to, directly executes operation to global ratio image (such as 122) to generate specific ratios image, and " indirect base Specific ratios image is generated in global ratio image " refer to directly to the execution operation of intermediate ratio image to generate specific ratios figure Picture, rather than operation directly is executed to global ratio image, which can be directly or indirectly based on the overall situation Ratio image (such as 122) and be generated.In some possible embodiments, as described herein to global ratio image or centre Operation performed by ratio image can be down-sampling (downsampling) operation, up-sampling (upsampling) operates, is non- Multiplication/division (or addition/subtraction in log-domain) in log-domain, the ascending power in non-logarithmic domain or drop power operation (or logarithm Multiplication/division in domain), etc..
In some possible embodiments, local multi-grade ratio calculations device (104) usually may include be configured to by Ratio image in this group of ratio image is merged into the software and/or hardware component of local multi-grade ratio image (such as 106). In some possible embodiments, this group of ratio image is from highest space resolution level to lowest spatial resolution rank Sequence and successively sort.In some possible embodiments, there is the one of one or more higher spatial resolution ranks A or multiple ratio images (such as preceding ratio image), which are used to generate, to be had unlike the one or more higher spatial point The ratio image (such as posterior ratio image) of the higher space resolution level of resolution rank.
In some possible embodiments, each ratio image in this group of ratio image is integrated into office in ratio image It is individually cached or is stored in memory space before in portion's multi-grade ratio image (106).In some other possible realities Apply in example, each ratio image in this group of ratio image exists on logical meaning, but rear ratio image can be at it He is merged and is cached together with the amalgamation result of all ratios image before it before further generating in rear ratio image.
4 local multi-grade image processing methods
Fig. 2 is the exemplary local multi-grade image processing method (200) for showing some possible embodiments according to the present invention Block diagram.Solid arrow in Fig. 2 indicates data flow, and dotted arrow indicates control stream.Method (200) can be by one Or multiple calculating equipment execute.
In step 202, local multi-grade image processing method (200) can be by from application call, the application program Can (but being not limited to) be related to showing HDR image on standard dynamic range (SDR) display.In step 204, method (200) input HDR image (such as 102) can be loaded into memory space.Input HDR image (102) can be floating-point RGB figure Picture, and from method (200) output tone mapping gray level image can be as local multi-grade tone mapping image (such as 110) 8 bit grayscale images of the identical dimensional of a part, 8 bit grayscale image instruction such as gamma (gamma) encode Tone mapping brightness value in specification (γ=2.2).
In step 206, input HDR image can be converted into the HDR with logarithmic brightness (being expressed as " Log Y ") value Image (may be in color space related with Yuv color space, or further including brightness other than the relevant channel of coloration (luma) in another color space in channel).In order to simple, the HDR image with logarithmic brightness value can be referred to herein as Log HDR image (212) in the domain Y.As used herein, brightness value can refer to brightness value, luma value or through gamma expansion Or the brightness value through gamma compression.In a step 208, method (200) can the logarithm based on the HDR image in the domain Log Y it is bright Angle value calculates Log Y histogram, produces Log Y histogram (214).In step 210, method (200) can be based on Log Y histogram (214), which executes, to be calculated and generates global tone mapping curve (216), can be used for by color histogram tune The global ratio that TMO is directly or indirectly adjusted by can correspond to color histogram that whole tone mapping arithmetic unit (TMO) carries out The tone mapping or ratio operation that rate arithmetic unit (such as 120) carries out.
The operating process of method (200) can achieve reference point A (240) herein, lead to step 218.In step 218 In, this method can be using the color histogram TMO based on global tone mapping curve (216) with will be in Log Y image (212) The global tone mapping value that is mapped in the domain Log Y of Log Y value and subtracted in the domain Log Y with global tone mapping value Log Y value in HDR image, can be referred to herein as global to generate the global ratio image (such as 122) in the domain Log Y Logarithm ratio image (228).
In a step 220, local multi-grade ratio calculations device (such as 300 in Fig. 3) can be applied to by method (200) Global logarithm ratio image (228) can be referred to as partial log ratio to generate local multi-grade ratio image (such as 106) Image (230).In some possible embodiments, local multi-grade ratio calculations device can with as shown in Figures 1 A and 1 B 1 Local multi-grade ratio calculations device 104 is identical or as part of it.In some possible embodiments, local multi-grade operation Device can create one group of ratio image, and (such as 122-1 is incorporated into partial log ratio chart to 122-N) and by the ratio image In picture (230), as will be described in further detail with reference to Fig. 3.
In step 222, partial log ratio image (230) is combined with Log Y image (212) to generate tone mapping pair Number Y image 232.The combination is either the addition in log-domain is also possible to the multiplication in linear domain.In some possible realities It applies in example, the ratio operation executed in step 218 can be the subtraction in log-domain, and (it can be the division in non-logarithmic domain Operation), and inverse operation (such as log-domain can be by the operation that local multi-grade TM arithmetic unit (220) executes in step 222 In addition, can be the multiplication in non-logarithmic domain).
In step 224, method (200) discovery/calculating can refer to maximum on tone mapping Log Y image (232) Brightness value (it can be referred to as Log Y maximum value 234).It is low when to corresponding chromatic value is combined derived from input HDR image The diversified display equipment institute by including non-HDR display equipment can be maintained in the brightness value with reference to maximum brightness value In the specific colour gamut supported.Reference maximum brightness value on image might be chosen such that not more than a certain small percentage Pixel exceeds the colour gamut.
In step 226, it is most light can to subtract Log Y from the brightness value in tone mapping Log Y image for method (200) Angle value (234) and the brightness value in the tone mapping Log Y image for having subtracted Log Y maximum brightness value (234) is converted into Fixed-point values (such as 8 bit results).In step 236, the brightness value in 8 bit results can be stored in by with from HDR Chromatic value derived from image is used as the tone mapping gray tone mapping graph after the correction of (coloured) tone mapping image together As in.In some possible embodiments, the tone mapping gray tone mapping image after correction is returned calling in step 238 Application program.
5. local multi-grade ratio calculations device
Fig. 3 is to show exemplary local multi-grade ratio calculations device according to some embodiments of the invention (for example, in Fig. 2 220 or Figure 1A in 104).Local multi-grade ratio calculations device (220) may be implemented to calculate equipment execution by one or more Process flow (300).
In block 302, local multi-grade arithmetic unit (202) may begin at the global logarithm ratio image of reception (such as 228), it is denoted here as R.As used herein, " rate value " can refer to brighteness ratio value." ratio image " herein It can refer to the gray scale ratio image including brighteness ratio value.In block 304, arithmetic unit (220) can calculate spatial resolution grade Other number N.For purposes of the present invention, " calculate N " also may include the constant integer value 2 that direct setting N is positive, and 3,4,5, 6 etc..In some possible embodiments, the space resolution level of global logarithm ratio image (228) be used as calculate N because Element.For illustration purposes only, global logarithm ratio image (228) can be (but are not limited to) having Dx in horizontal dimensions (such as 2048 etc.) a pixel and the rectangular image frame in vertical dimensions with Dy (such as 1536 etc.) a pixel.Therefore, entirely Office's logarithm ratio image (228) or the space resolution level for inputting HDR image (102) can use the sum of all pixels in picture frame Dx × Dy is characterized.
In some possible embodiments, in order to calculate space resolution level sum N, global logarithm ratio image (228) space resolution level passes through positive integer factor mx* my(wherein * refers to multiplying) and reduced in succession, until Further decreasing for space resolution level will lead to obtained space resolution level lower than minimum space resolution levels Until.Herein, mxIt can be positive integer, the multiple pixels along horizontal dimensions indicated in (previous) ratio image become For the pixel along horizontal dimensions in the latter ratio image after the immediately previous ratio image;myIt can be just whole Number, indicate multiple pixels along vertical dimensions in (previous) ratio image become the immediately previous ratio image it A pixel along horizontal dimensions in latter ratio image afterwards.As used herein, minimum space resolution levels can To refer to the spatial discrimination being pre-configured and/or being programmably configured lower than global logarithm ratio image (228) The space resolution level of rate rank;The obtainable minimum of minimum space resolution levels can be in global logarithm ratio image (228) it is not less than a pixel in one (1) in any Spatial Dimension.
In some possible embodiments, global logarithm ratio image (228) supports sky along each Spatial Dimension Between the other maximum number of stage resolution ratio be determined first.
For example, the maximum level number Nx supported by the resolution ratio in illustrated horizontal dimensions can be calculated as meeting The maximum value of following formula:
mx Nx≤ Dx expression formula (1)
Similarly, the maximum level number Ny supported by the resolution ratio in illustrated vertical dimensions can be calculated as full The maximum value of sufficient following formula:
my Ny≤ Dy expression formula (2)
In some possible embodiments, N is set as being greater than one (1) and being not more than being counted according to expression formula (1) and (2) Any positive integer of both maximum values of Nx and Ny of calculation.
In some possible embodiments, N is set as the positive integer greater than one (1), so that (by from global logarithm ratio Image (228) starts to reduce the resolution ratio of previous ratio image in succession and obtain) minimum at the top of the pyramid of ratio image Width is at least one pixel to space resolution level in each dimension.
For purposes of the present invention, the other modes for calculating N can be used.For example, as constant m is usedxAnd myReplace Generation, mxAnd myDifferent values can be set as in two or more different spatial resolutions ranks.In some possible implementations In example, N can be set as the value being pre-configured with or user can configure;Space resolution level can be based at least partially in advance Configuration or the N value that can configure of user and be determined.In some possible embodiments, N and/or one or more spatial discriminations Rate rank is not to input HDR image (102) or global logarithm ratio image (228) or to be used to derive current radio figure It is determined in the case that the content of the previous ratio image of picture executes image analysis.In some other possible embodiments In, image analysis can be executed to the content of one or more previous images;N and/or one or more spatial resolutions Rank can be based at least partially on image analysis result and be determined.In various possible embodiments, mxAnd myIt can be often Number changes with rank, or can even change with the position in the picture frame of input HDR image (102).Each In kind possible embodiment, position correlation may be from or not from the result of image analysis.
In some possible embodiments, in block 306, arithmetic unit (220) calling is expressed as MSFunction's (328) Multi-grade function has the call parameters R for being initially set to R and NiAnd i;Wherein call parameters i, which can be, corresponds to sky Between the other index of stage resolution ratio.In some possible embodiments, R is global ratio image (122).In some possible implementations In example, MSFunction (328) is implemented as illustrated in fig. 3.
In block 308, arithmetic unit (220) can create the new stack frame in the space resolution level indicated with i.This A stack frame is used to be stored in the rate value of the space resolution level corresponding to i.In some possible embodiments, such as this In the stack frame that describes save the multiple pixels for corresponding to the space resolution level to be stored in the space resolution level (for example, in log-domain) rate value.
In a block 310, arithmetic unit (220) can calculate the gamma for space resolution level ii(or γi), wherein gammaiIt is that (it is the power value in non-log-domain and the multiplication in log-domain for the gamma value of space resolution level i Value).In some possible embodiments, the value (for example, 1/N etc.) for being not dependent on i value is assigned to gammai.Some other In possible embodiment, the value depending on i can be assigned to gammai.In specific possible embodiment, gammaiIt can be by such as Under provide:
gammai=2*i/ (N* (N+1)) expression formula (3)
Therefore, in this embodiment, space resolution level is higher, gammaiIt is worth bigger.
Gamma in some possible embodiments, for all ranksiSummation is confined to fixed value, such as one (1) (but without being limited thereto in other possible embodiments).It is this to gamma in some possible embodimentsiConstraint be used to The desired dynamic range of corresponding output tone mapping image is maintained at and is for example supported by the display equipment of special range In particular range.
In block 312, arithmetic unit (220) can test whether i is less than or equal to minimum number (such as one (1)), can be right It should be in the lowest spatial resolution rank in the N number of space resolution level discussed.If it is, then process flow (300) block 322 is led to;Otherwise, process flow (300) leads to block 314.Initially, since i is set as N, it is greater than one (1), because herein Reason process leads to block 314.In a block 314, arithmetic unit (220) can by one of input parameter of MSFunction (328) (that is, Ratio image Ri) it is down-sampled to Ri-1.In various possible embodiments, RiTo Ri-1Down-sampling can be by with a variety of different sides One of formula executes.In one example, if RiMx* myPixel becomes Ri-1In a pixel, then Ri-1In the pixel It can be selected to RiIn pixel mean value, or may depend on RiIn mx* mySome other representatives of the rate value of pixel Property value.In another example, such as the filter of Gaussian filter can be applied to RiIn pixel value to obtain Ri-1In Pixel.
In block 316, arithmetic unit 220 can recursively call MSFunction (328), wherein parameter RiDivide now with i R is not set as iti-1And i-1.Block 310,312,314 and 316 as described above can be repeated (or recursively call), until i not It is greater than minimum value (for example, one (1)) again.When i is less than or equal to minimum value (such as 1), process flow leads to block (322).
In block 322, arithmetic unit (220) can be by Ri(in each rate value) rises to gammaiPower can pass through The multiplication of rate value in following log-domain operates to complete:
Ri:=gammai*RiExpression formula (4)
In some possible embodiments, the operation of this ascending power is for RiIn each rate value and execute.
In block 326, the Ri finally modified can be back to father's tune as provided in expression formula (4) by arithmetic unit (220) With device (such as 306 or 316).
In block 318, arithmetic unit (220) can up-sample Ri-1In rate value to create Ri’。
In a block 320, arithmetic unit (220) can be by Ri(in each rate value) rises to gammaiPower and multiplied by Ri’ To generate the R modified in rank ii.Note that in log-domain, by RiRise to gammaiThe R that power corresponds toi* gammai Simple multiplication, and multiplication corresponds to addition.Alternatively,
Ri:=Ri’+gammai* RiExpression formula (5)
Therefore, the R in (320)iIt can be counted as weighting the summation of local ratio image, wherein in one embodiment In, weight factor corresponds to the gamma in each iterationiValue.Ascending power operation can be directed to RiIn each rate value and held Row.Ascending power can be directed to RiAnd Ri' in spatial position in every contrast ratio value and be performed.
In block 326, R that arithmetic unit (220) can will have been modifiediIt returns to father and calls device.In final iteration stages, repair The R changediIt can be used as partial log ratio image (230 in Fig. 2) and be returned.
For purposes of illustration, it has been described that local multi-grade ratio image can use (recurrence) processing stream of Fig. 3 Journey and be generated.It should be pointed out that for purposes of the present invention, local multi-grade ratio image can use different process flows And it is generated.For example, iteration function or another type of process flow can be used as the substitution for using Recursion process.With In the these and other type for generating local multi-grade ratio image process flow within the scope of the invention.
6. exemplary process flow
Fig. 4 A shows the exemplary process flow of a possible embodiment according to the present invention.In some possible embodiments In, one or more equipment or component of calculating of such as image processing unit can execute this process flow.In block 410, Image processing unit can by global ratio operator be applied to from input high dynamic range (HDR) image derived from brightness value with Generate the high resolution gray ratio image including brighteness ratio value.In some possible embodiments, high resolution gray ratio Rate image is the gray scale ratio image with space resolution level identical with HDR image.In some possible embodiments, The brightness value inputted in HDR image is transformed into log-domain by image processing unit first.
In some possible embodiments, global ratio operator includes the overall situation related with global tone mapping operations device Brightness histogram adjusts arithmetic unit.In some possible embodiments, image processing unit is based on derived from input HDR image Brightness value and calculate Histogram adjustment curve, and can by Histogram adjustment curve be applied to from input HDR image derived from Brightness value is to generate high resolution gray ratio image.
Brighteness ratio value in some possible embodiments, in non-logarithmic domain, in high resolution gray ratio image Including multiple rate values, each rate value is to be divided by reflect from the global tone for inputting one of brightness value derived from HDR image Penetrate the global tone map intensity values of image.
In block 420, image processing unit can be based at least partially on high resolution gray ratio image and generate packet The local multi-grade gray scale ratio image of the weighted array of at least two different gray scale ratio images is included, wherein each gray scale ratio Rate image has different space resolution levels.As used herein, " weighted array " refers to addition in log-domain With, but in non-logarithmic domain it is product;It can be gamma value for the weight factor in weighted array, be in log-domain Exponential factor in multiplication factor or non-logarithmic domain.
In some possible embodiments, image processing unit distributes at least two weighted factors and gives at least two difference Gray scale ratio image.In some possible embodiments, image processing unit distributes the value of multiple weighted factors to for giving birth to At multiple gray scale ratio images of local multi-grade gray scale ratio image.In some possible embodiments, multiple gray scale ratios Image includes at least two gray scales ratio image.In some possible embodiments, the value of multiple weighted factors is standardized For preconfigured value.In some possible embodiments, image processing unit at least two weighted factors of distribution give this at least Two different gray scale ratio images.
In some possible embodiments, image processing unit, which distributes to the first value, is used to be used to generate part mostly etc. First weight factor of the first gray scale ratio image in multiple gray scale ratio images of grade gray scale ratio image, and can incite somebody to action Second value distributes to the second weight factor for the second gray scale ratio image in multiple gray scale ratio image.It is some can In the embodiment of energy, the first value is higher than second value;First gray scale ratio image has sky more higher than the second gray scale ratio image Between resolution levels.
In some possible embodiments, at least two different gray scale ratio images include high resolution gray ratio chart Picture.In some possible embodiments, at least two different gray scale ratio images include passing through down-sampling high resolution gray Brighteness ratio value in ratio image and at least one the gray scale ratio image determined based on high resolution gray ratio image.
In block 430, the part with the brightness value derived from input HDR image is can be used mostly etc. in image processing unit Rate value in grade gray scale ratio image generates tone mapping gray level image.In some possible embodiments, tone mapping Tone mapping brightness value in gray level image includes lower than the dynamic of the reduction of the dynamic range of the brightness value in input HDR image Range.In some possible embodiments, the tone mapping brightness value in tone mapping gray level image is for gamma coding specification 's.
In some possible embodiments, input HDR image is floating-point RGB image.In some other possible embodiments In, input HDR image is fixed point (such as each R, G or channel B be 16 bits) RGB image.In some possible implementations In example, tone mapping gray level image includes the fixed point gray scale with Spatial Dimension identical with the input Spatial Dimension of HDR image Image.
In some possible embodiments, image processing unit calculate tone mapping gray level image on make colour gamut it Outer pixel percentage is not more than the reference maximum value of threshold value.
In some possible embodiments, local multi-grade gray scale ratio image is obtained using Recursion process.
In some possible embodiments, the tone derived from local multi-grade gray scale ratio image and input HDR image Mapping gray level image is used as exporting the composition image of tone mapping color image.In one example, mostly etc. without part The tone mapping color image of grade gray scale ratio image can be used for presenting on image-rendering apparatus.
In another example, the tone mapping color image with local multi-grade gray scale ratio image can be provided To image processing system to be presented on image-rendering apparatus.In some possible embodiments, tone mapping color image and Local multi-grade gray scale ratio image is used to generate output HDR image by image processing system.
Fig. 4 B shows the exemplary process flow of possible embodiment according to the present invention.In some possible embodiments In, one or more equipment or component of calculating of such as image processing unit can execute this process flow.In block 440, Image processing unit can by global tone mapping operations device be applied to derived from high dynamic range (HDR) image brightness value with Generate the high resolution gray ratio image including brighteness ratio value.
In block 450, image processing unit can determine the sky between highest resolution level and lowest resolution rank Between the other number of stage resolution ratio.In some possible embodiments, the number of space resolution level is not to input HDR It is determined in the case where the content execution image analysis of image.In some possible embodiments, space resolution level Number is at least partially based on the result of image analysis content of input HDR image and determined.
In block 460, image processing unit can be for from highest resolution level to immediately in lowest resolution rank On space resolution level each space resolution level down-sampling correspond to each space resolution level ratio Image, with the corresponding next ratio chart of the space resolution level for generating with being next under each space resolution level Picture.
In block 470, image processing unit can be directed to and be clipped to from lowest resolution grade immediately in highest resolution level Under space resolution level each space resolution level up-sampling correspond to each space resolution level ratio Image, to generate the up-sampling ratio image for corresponding to each space resolution level.
In block 480, image processing unit can determine the weight of the variant ratio image in multiple ratio images because Thus subvalue leads to multiple weight factors.Herein, each ratio image can correspond to one in multiple space resolution levels A space resolution level.
In block 490, local multi-grade ratio image can be determined as by multiple weight factor by image processing unit The weighted array of multiple ratio images of weighting.
7. realization mechanism-HARDWARE OVERVIEW
According to one embodiment, technology described herein is realized by one or more dedicated computing equipments.It is dedicated Calculating equipment can be hard-wired to execute the technology, or may include the digital and electronic for being permanently programmed to carry out the technology Equipment (such as one or more specific integrated circuit (ASIC) or field programmable gate array (FPGA)), or may include according to The one or more of the technology is programmed to execute according to the program instruction in firmware, memory, other storage devices or combinations thereof Common hardware processor.This dedicated computing equipment can also combine customization firmware hardwired logic, ASIC or FPGA and customization programs To realize the technology.Dedicated computing equipment can be desk side computer system, portable computer system, handheld device, networking Equipment combines hardwired and/or programmed logic with any other equipment for realizing the technology.
For example, Fig. 5 is the block diagram for showing the computer system 500 that the embodiment of the present invention may be implemented thereon.Department of computer science System 500 include bus 502 or other communication agencies for transmitting information, and couple with bus 502 be used for handle information Hardware processor 504.Hardware processor 504 may, for example, be general purpose microprocessor.
Computer system 500 further includes the finger for storing information and to be executed by processor 504 coupled with bus 502 The main memory 506 (for example, random access memory (RAM) or other dynamic memories) of order.Main memory 506 can also be with Be used to be stored in will by the instruction that processor 504 executes execution during temporary variable or other average informations.This finger Order makes computer system 500 become to be customized when being stored in the non-transient storage media that can be accessed by processor 504 At the special purpose machinery for the operation specified in executing instruction.
Computer system 500 further include be coupled to bus 502 for store be used for processor 504 instruction and static state The read-only memory (ROM) 508 of information or other static storage devices.Such as the storage equipment 510 of disk or CD is provided And it is coupled to bus 502 information and instruction for storage.
Computer system 500 can be coupled to the display for displaying information to computer user via bus 502 51 (such as cathode-ray tubes (CRT)).Input equipment 514 comprising alphanumeric and other keys is coupled to bus 502 to be used for Information and command selection are transmitted to processor 504.Another user input equipment is cursor control 516 (such as mouse, track Ball or cursor direction key), for 504 direction of transfer information of processor and command selection and for controlling display 512 On cursor it is mobile.This input equipment typically has that there are two two in axis (first axle (such as x) and the second axis (such as y)) Freedom degree allows the position in equipment given plane.
Computer system 500 can use makes computer system 500 become or will calculate in combination with computer system Machine system 500 is programmed for the customization firmware hardwired logic of special purpose machinery, one or more ASIC or FPGA, firmware and/or program are patrolled It collects to realize technology described herein.According to one embodiment, technology here is by computer system 500 in response to processor 504 execute the one or more sequences for the one or more instructions being contained in main memory 506 and are performed.This instruction Main memory 506 can be read into from another storage medium for for example storing equipment 510.It is contained in main memory 506 The execution of instruction sequence causes processor 504 to execute process steps described herein.In an alternate embodiment of the invention, hard-wired circuit Software instruction can be replaced to be used or in combination be used.
Term " storage medium " used herein refers to the data and/or instruction that storage causes machine to operate in a specific way Any non-state medium.This storage medium may include non-volatile media and/or Volatile media.Non-volatile media Including such as CD or disk, such as storage equipment 510.Volatile media includes dynamic memory, such as main memory 506. The common version of storage medium includes that such as floppy disk, flexible disk, hard disk, solid state drive, tape or any other magnetic data are deposited Storage media, CD-ROM, any other optical data memory, any physical medium with sectional hole patterns, RAM, PROM and EPROM, FLASH-EPROM, NVRAM, any other storage chip or box.
Storage medium it is different from transmission medium but can be in connection use.Transmission medium participate in storage medium it Between transmit information.For example, transmission medium includes coaxial cable, copper wire and optical fiber, including the wiring comprising bus 502.Transmission is situated between Matter can also take the form of sound or light wave, for example, during radio wave and infrared data communications it is generated those.
Various forms of media can be used to transport one or more sequences of one or more instructions to processor 504 For executing.For example, instruction initially can on the disk or solid state drive of remote computer carried.Remote computer The instruction can be loaded into its dynamic memory and send the instruction on the telephone wire using modem.Computer The local modem of system 500 can receive the data on telephone wire and be converted the data into using infrared transmitter Infrared signal.Infrared detector can receive the data carried in infrared signal and the data can be placed in by suitable circuit In bus 502.The data are transported to main memory 506 by bus 502, and processor 504 is from the primary memory retrieval and execution refers to It enables.Storage can be optionally stored in front of or after execution by processor 504 by the received instruction of main memory 506 to set In standby 510.
Computer system 500 also includes the communication interface 518 for being coupled to bus 502.
Communication interface 518 provides the bidirectional data communication for being coupled to the network link 520 being connected with local network 522.Example Such as, communication interface 518 can be integrated services digital network (ISDN) card, cable modem, satellite modem or It is provided to the modem of the data communication connection of the telephone wire of respective type.As another example, communication interface 518 can To be to provide to local area network (LAN) card of the data communication connection of compatible LAN.Radio Link can also be implemented.It is any this During kind is realized, electricity, the electricity that communication interface 518 sends and receives the digit data stream that carrying represents various types information are magnetically or optically believed Number.
Network link 520 typically provides the data communication by one or more networks to other data equipments.For example, Network link 520 can be provided by local network 522 to host computer 524 or by Internet Service Provider (ISP) 526 The connection of the data equipment of operation.ISP 526 then passes through the world wide packet data of now commonly referred to as " internet " 528 Communication network and data communication services are provided.Both local network 522 and internet 528 are all using carrying digit data stream Electricity, electric magnetically or optically signal.Pass through signal that is on the signal and network link 520 of various networks and passing through communication interface 518 It is the exemplary form of transmission medium, numerical data of the signaling bearer to and from computer system 500.
Computer system 500 can send message by one or more networks, network link 520 and communication interface 518 And receive the data including program code.In the Internet example, server 530 can pass through internet 528, ISP 526, sheet Ground network 522 and communication interface 518 send the code of requested application program.
The received code can be executed by it when being received by processor 504, and/or be stored in storage equipment 510 In or other non-volatile memory cells in for executing later.
8. equivalent, extension, substitute and miscellaneous
In description in front, this hair is described referring to a large amount of specific details that can change according to implementation Bright embodiment.Therefore, it is to issue power that unique and exclusive instruction of the invention and applicant, which are intended to be considered of the invention, The claim that the particular form including any subsequent correction that benefit requires is issued from the application.For being wrapped in these claims Any definition of the term contained being explicitly described herein should determine the meaning of these terms used in claim.Cause This, limitation, element, property, feature, advantage and the attribute not yet explicitly stated in claim should not in any way limit this The scope of the claims.Correspondingly, the description and the appended drawings are counted as illustrative rather than restrictive.

Claims (19)

1. a kind of method for local tone mapping, which comprises
Receive input high dynamic range images;
The brightness value inputted in high dynamic range images is converted into log-domain to generate log input images;
Global tone mapping operations device is applied to the log input images to generate logarithm global tone mapping image;
The brightness value for mapping image and the input high dynamic range images based on the logarithm global tone generates high-resolution Ratio image;
At least two different brackets ratio images, at least two different brackets ratio are generated based on high-resolution ratio image Each image in image has different space resolution levels;
Merge at least two different brackets ratio image to generate including at least two different brackets ratio image The local multi-grade ratio image of weighted array, wherein the part multi-grade ratio image is obtained using Recursion process 's;
The local multi-grade ratio image is added with the log input images to generate the output color of the brightness in log-domain Adjust mapping image.
2. according to the method described in claim 1, further comprising:
The pixel value of brightness output tone mapping image is transformed into linear domain from log-domain, and Combination conversion obtains Linear luminance output tone mapping value and input the chromatic value of high dynamic range images to generate colored output tone mapping figure Picture.
3. according to the method described in claim 1, further comprising:
Calculated for pixel values based on brightness output tone mapping image refers to maximum brightness value;
The reference maximum brightness value is subtracted from the pixel value of brightness output tone mapping image to generate gamut correction Brightness tones map image;
The brightness value of gamut correction brightness tones mapping image is transformed into linear domain from log-domain;And
The chromatic value of linear gamut correction brightness tones mapping value and the input high dynamic range images that Combination conversion obtains To generate colored output tone mapping image.
4. according to the method described in claim 1, wherein, the global tone mapping operations device is based on global brightness histogram quilt It calculates.
5. according to the method described in claim 1, wherein, at least two different brackets ratio image includes the high-resolution Rate ratio image.
6. according to the method described in claim 1, wherein, the high-resolution ratio image is that have and the input high dynamic The gray scale ratio image of the identical space resolution level of the space resolution level of range image.
7. according to the method described in claim 1, wherein, at least two different brackets ratio image includes being based on the height Resolution ratio ratio image by the brighteness ratio value determination in high-resolution ratio image described in down-sampling at least one etc. Grade ratio image.
8. according to the method described in claim 1, wherein, the brightness value in the global tone mapping image includes more defeated than described Enter the low dynamic range of the dynamic range of the brightness value in high dynamic range images.
9. according to the method described in claim 1, further include:
Histogram adjustment curve is calculated based on the brightness value obtained from the input high dynamic range images;With
The brightness value that the histogram adjustment curve is applied to obtain from the input high dynamic range images is to generate The high-resolution ratio image.
10. according to the method described in claim 1, wherein, calculated in log-domain the high-resolution ratio image include from The brightness value of the logarithm global tone mapping image subtracts the brightness value of the log input images.
11. according to the method described in claim 1, wherein, the brightness in non-logarithmic domain, in the high-resolution ratio image Rate value includes multiple rate values, each rate value be divided by the brightness value obtained from the input high dynamic range images it The global tone map intensity values of one global tone mapping image.
12. according to the method described in claim 1, further including that at least two weighted factors are distributed to at least two difference Order rate image.
13. according to the method described in claim 1, further include:
The value of multiple weighted factors is distributed to the multiple grades ratio chart that be used to generate the local multi-grade ratio image Picture, wherein the multiple order rate image includes at least two order rates image.
14. according to the method for claim 13, wherein the summation of the multiple weighted factor is confined to fixed value.
15. according to the method described in claim 1, wherein, for generate local multi-grade ratio image for the grade The weighted factor gamma of the order rate image in rank i in ratio imageiInclude:
gammai=2*i/ (N* (N+1))
Wherein, N indicates the number of the space resolution level of the high-resolution ratio image, and i is 1 to N.
16. a kind of equipment for local tone mapping, including processor and it is configured to execute according to claim 1 to 15 Any one of described in method.
17. a kind of includes for executing according to claim 1 to the equipment of the device of method described in any one of 15.
18. a kind of equipment for local tone mapping, comprising:
One or more processors;And
One or more storage mediums of store instruction, described instruction to hold when being executed by one or more of processors Capable method described in any one of -15 according to claim 1.
19. a kind of non-transient storage media, store instruction, described instruction make to execute when executed by one or more processors Method described in any one of -15 according to claim 1.
CN201610516542.3A 2011-03-02 2012-03-01 Local multi-grade tone mapping arithmetic unit Active CN106204474B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201161448606P 2011-03-02 2011-03-02
US61/448,606 2011-03-02
CN201280011203.XA CN103403759B (en) 2011-03-02 2012-03-01 Locally many grades tone mapping operations device

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201280011203.XA Division CN103403759B (en) 2011-03-02 2012-03-01 Locally many grades tone mapping operations device

Publications (2)

Publication Number Publication Date
CN106204474A CN106204474A (en) 2016-12-07
CN106204474B true CN106204474B (en) 2019-05-03

Family

ID=45812846

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201280011203.XA Active CN103403759B (en) 2011-03-02 2012-03-01 Locally many grades tone mapping operations device
CN201610516542.3A Active CN106204474B (en) 2011-03-02 2012-03-01 Local multi-grade tone mapping arithmetic unit

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN201280011203.XA Active CN103403759B (en) 2011-03-02 2012-03-01 Locally many grades tone mapping operations device

Country Status (8)

Country Link
US (2) US9299317B2 (en)
EP (1) EP2681710B1 (en)
JP (2) JP5960731B2 (en)
KR (1) KR101538296B1 (en)
CN (2) CN103403759B (en)
ES (1) ES2694806T3 (en)
PL (1) PL2681710T3 (en)
WO (1) WO2012118961A1 (en)

Families Citing this family (52)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2681710B1 (en) * 2011-03-02 2018-09-12 Dolby Laboratories Licensing Corporation Local multiscale tone-mapping operator
TWI538473B (en) 2011-03-15 2016-06-11 杜比實驗室特許公司 Methods and apparatus for image data transformation
SI3595281T1 (en) 2011-05-27 2022-05-31 Dolby Laboratories Licensing Corporation Scalable systems for controlling color management comprising varying levels of metadata
US9024961B2 (en) 2011-12-19 2015-05-05 Dolby Laboratories Licensing Corporation Color grading apparatus and methods
US9105078B2 (en) * 2012-05-31 2015-08-11 Apple Inc. Systems and methods for local tone mapping
CN105787908B (en) 2012-08-08 2019-05-14 杜比实验室特许公司 Image processing method, device and storage medium for high dynamic range images
US9064313B2 (en) * 2012-09-28 2015-06-23 Intel Corporation Adaptive tone map to a region of interest to yield a low dynamic range image
US9129388B2 (en) 2012-11-21 2015-09-08 Apple Inc. Global approximation to spatially varying tone mapping operators
KR101871945B1 (en) * 2013-01-17 2018-08-02 한화에어로스페이스 주식회사 Apparatus and method for processing image
KR101717457B1 (en) * 2013-01-25 2017-03-17 돌비 레버러토리즈 라이쎈싱 코오포레이션 Global display management based light modulation
FR3003378A1 (en) * 2013-03-12 2014-09-19 St Microelectronics Grenoble 2 TONE MAPPING METHOD
US9955084B1 (en) * 2013-05-23 2018-04-24 Oliver Markus Haynold HDR video camera
EP3022902B1 (en) * 2013-07-16 2019-11-20 Koninklijke Philips N.V. Method and apparatus to create an eotf function for a universal code mapping for an hdr image
KR20150017617A (en) * 2013-08-07 2015-02-17 삼성전자주식회사 Method of processing optical coherence tomography and apparatus performing the same
US8958658B1 (en) 2013-09-10 2015-02-17 Apple Inc. Image tone adjustment using local tone curve computation
WO2015077329A1 (en) 2013-11-22 2015-05-28 Dolby Laboratories Licensing Corporation Methods and systems for inverse tone mapping
PL3092800T3 (en) * 2014-01-07 2023-06-12 Dolby Laboratories Licensing Corporation Techniques for encoding, decoding and representing high dynamic range images
JP6432214B2 (en) * 2014-08-25 2018-12-05 株式会社リコー Image processing apparatus, image processing method, storage medium, and program
TW201633779A (en) 2014-12-16 2016-09-16 湯姆生特許公司 Method and device of converting a HDR version of a picture to a SDR version of said picture
US9860504B2 (en) 2015-01-09 2018-01-02 Vixs Systems, Inc. Color gamut mapper for dynamic range conversion and methods for use therewith
US9654755B2 (en) * 2015-01-09 2017-05-16 Vixs Systems, Inc. Dynamic range converter with logarithmic conversion and methods for use therewith
US9589313B2 (en) * 2015-01-09 2017-03-07 Vixs Systems, Inc. Dynamic range converter with pipelined architecture and methods for use therewith
US9652870B2 (en) * 2015-01-09 2017-05-16 Vixs Systems, Inc. Tone mapper with filtering for dynamic range conversion and methods for use therewith
KR101939012B1 (en) 2015-03-02 2019-01-15 돌비 레버러토리즈 라이쎈싱 코오포레이션 Content adaptive perceptual quantizer for high dynamic range images
US9942489B2 (en) * 2015-06-02 2018-04-10 Samsung Electronics Co., Ltd. Adaptive tone mapping based on local contrast
US10007412B2 (en) 2015-06-24 2018-06-26 Samsung Electronics Co., Ltd. Tone mastering system with creative intent metadata
US10043487B2 (en) 2015-06-24 2018-08-07 Samsung Electronics Co., Ltd. Apparatus and method for split screen display on mobile device
EP3139342A1 (en) * 2015-09-02 2017-03-08 Thomson Licensing Methods, systems and apparatus for over-exposure correction
US9621767B1 (en) 2015-11-24 2017-04-11 Intel Corporation Spatially adaptive tone mapping for display of high dynamic range (HDR) images
CN105959591A (en) * 2016-05-30 2016-09-21 广东欧珀移动通信有限公司 Local HDR implementation method and system
WO2018006390A1 (en) * 2016-07-08 2018-01-11 SZ DJI Technology Co., Ltd. System and method for image processing
WO2018010026A1 (en) * 2016-07-11 2018-01-18 Uti Limited Partnership Method of presenting wide dynamic range images and a system employing same
US10074162B2 (en) 2016-08-11 2018-09-11 Intel Corporation Brightness control for spatially adaptive tone mapping of high dynamic range (HDR) images
US10275864B2 (en) 2016-09-09 2019-04-30 Kabushiki Kaisha Toshiba Image processing device and image processing method
US10229484B2 (en) 2016-11-30 2019-03-12 Stmicroelectronics (Grenoble 2) Sas Tone mapping method
CN108460730B (en) * 2017-02-17 2020-06-26 京东方科技集团股份有限公司 Image processing method and device
GB2566050B (en) * 2017-08-31 2021-08-25 Imagination Tech Ltd Luminance-normalised colour spaces
US11276369B2 (en) * 2017-09-08 2022-03-15 Apple Inc. Electronic display burn-in detection and mitigation
JP6789904B2 (en) 2017-09-20 2020-11-25 株式会社東芝 Dynamic range compression device and image processing device
CN111226256A (en) 2017-11-09 2020-06-02 深圳市大疆创新科技有限公司 System and method for image dynamic range adjustment
CN108090879B (en) * 2017-12-12 2020-11-10 上海顺久电子科技有限公司 Method for processing input high dynamic range image and display equipment
CN110337636A (en) * 2018-02-28 2019-10-15 深圳市大疆创新科技有限公司 Data transfer device and device
US10445865B1 (en) * 2018-03-27 2019-10-15 Tfi Digital Media Limited Method and apparatus for converting low dynamic range video to high dynamic range video
CN108986039B (en) * 2018-06-06 2019-07-09 贝壳找房(北京)科技有限公司 A kind of tone mapping method and system based on grayscale image
FR3083633B1 (en) * 2018-07-05 2020-05-29 Thales METHOD AND DEVICE FOR DISPLAYING HIGH DYNAMIC SONAR OR RADAR DATA
US10863157B2 (en) * 2018-07-06 2020-12-08 Samsung Electronics Co., Ltd. Guided tone mapping of high dynamic range video based on a Bezier curve for presentation on a display device
KR102533723B1 (en) 2018-09-14 2023-05-18 삼성전자주식회사 Electric device and control method thereof
CN111031301A (en) * 2018-10-10 2020-04-17 珠海全志科技股份有限公司 Method for adjusting color gamut space, storage device and display terminal
AT522542B1 (en) * 2019-05-09 2022-07-15 Facc Ag Interchangeable coupling, changing device and testing and processing system
CN110415188B (en) * 2019-07-10 2021-08-20 首都师范大学 HDR image tone mapping method based on multi-scale morphology
US11356623B2 (en) 2020-06-01 2022-06-07 City University Of Hong Kong System and method for processing an image
CN115861096B (en) * 2022-11-22 2023-10-31 瀚博半导体(上海)有限公司 Image processing method and device and computer equipment

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6285798B1 (en) * 1998-07-06 2001-09-04 Eastman Kodak Company Automatic tone adjustment by contrast gain-control on edges
CN101415117A (en) * 2008-11-18 2009-04-22 浙江大学 Transmission method for high presence image based on GPGPU
CN101902637A (en) * 2004-04-23 2010-12-01 杜比实验室特许公司 The coding of high dynamic range images, decoding and expression

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6888552B2 (en) 2001-06-08 2005-05-03 University Of Southern California High dynamic range image editing
GB0227946D0 (en) * 2002-11-29 2003-01-08 Univ East Anglia Signal enhancement
US6879731B2 (en) 2003-04-29 2005-04-12 Microsoft Corporation System and process for generating high dynamic range video
US7492375B2 (en) 2003-11-14 2009-02-17 Microsoft Corporation High dynamic range image viewing on low dynamic range displays
US7433514B2 (en) 2005-07-13 2008-10-07 Canon Kabushiki Kaisha Tone mapping of high dynamic range images
JP4899412B2 (en) * 2005-10-25 2012-03-21 セイコーエプソン株式会社 Image display system and method
EP2320653B1 (en) 2006-01-23 2015-09-02 Max-Planck-Gesellschaft zur Förderung der Wissenschaften e.V. High dynamic range codecs
US7636496B2 (en) 2006-05-17 2009-12-22 Xerox Corporation Histogram adjustment for high dynamic range image mapping
CA2570090C (en) 2006-12-06 2014-08-19 Brightside Technologies Inc. Representing and reconstructing high dynamic range images
US8237865B2 (en) 2006-12-18 2012-08-07 Emanuele Salvucci Multi-compatible low and high dynamic range and high bit-depth texture and video encoding system
DE102006061658A1 (en) * 2006-12-27 2008-07-03 Siemens Ag Linlog image converter's sensitivity characteristic curve adjusting method for motor vehicle, involves generating fitted set of parameters from setting value of converter based on quantiles of frequency distribution of image signal value
GB2449272B (en) 2007-05-15 2010-03-10 Alessandro Artusi Selective tone mapping
US8330768B2 (en) * 2007-07-27 2012-12-11 Sharp Laboratories Of America, Inc. Apparatus and method for rendering high dynamic range images for standard dynamic range display
US9830691B2 (en) 2007-08-03 2017-11-28 The University Of Akron Method for real-time implementable local tone mapping for high dynamic range images
US20090317017A1 (en) 2008-06-20 2009-12-24 The Hong Kong University Of Science And Technology Image characteristic oriented tone mapping for high dynamic range images
ES2389458T3 (en) 2008-07-10 2012-10-26 The University Of Warwick Methods and devices for compression of HDR video data
WO2010043922A1 (en) 2008-10-17 2010-04-22 Trellis Management Co., Ltd. High dynamic range texture and video coding
US8339475B2 (en) 2008-12-19 2012-12-25 Qualcomm Incorporated High dynamic range image combining
KR101539379B1 (en) 2008-12-31 2015-07-29 주식회사 동부하이텍 Real-Time Image Generator
KR101007101B1 (en) 2009-01-07 2011-01-10 한양대학교 산학협력단 Adaptive tone mapping apparatus and method, and image processing system using the method
US8363131B2 (en) 2009-01-15 2013-01-29 Aptina Imaging Corporation Apparatus and method for local contrast enhanced tone mapping
WO2010088465A1 (en) 2009-02-02 2010-08-05 Gentex Corporation Improved digital image processing and systems incorporating the same
EP2406959B1 (en) 2009-03-13 2015-01-14 Dolby Laboratories Licensing Corporation Layered compression of high dynamic range, visual dynamic range, and wide color gamut video
EP2681710B1 (en) * 2011-03-02 2018-09-12 Dolby Laboratories Licensing Corporation Local multiscale tone-mapping operator
GB201201230D0 (en) * 2012-01-25 2012-03-07 Univ Delft Tech Adaptive multi-dimensional data decomposition
CN105787908B (en) * 2012-08-08 2019-05-14 杜比实验室特许公司 Image processing method, device and storage medium for high dynamic range images

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6285798B1 (en) * 1998-07-06 2001-09-04 Eastman Kodak Company Automatic tone adjustment by contrast gain-control on edges
CN101902637A (en) * 2004-04-23 2010-12-01 杜比实验室特许公司 The coding of high dynamic range images, decoding and expression
CN101415117A (en) * 2008-11-18 2009-04-22 浙江大学 Transmission method for high presence image based on GPGPU

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Multiscale Image Contrast Amplification;Pieter Vuylsteke et al.;《Preoceedings of SPIE》;19940502;第1-6页

Also Published As

Publication number Publication date
JP2014510339A (en) 2014-04-24
US20130335438A1 (en) 2013-12-19
KR20130112946A (en) 2013-10-14
JP6039763B2 (en) 2016-12-07
PL2681710T3 (en) 2019-03-29
ES2694806T3 (en) 2018-12-27
EP2681710A1 (en) 2014-01-08
JP5960731B2 (en) 2016-08-02
US20160125581A1 (en) 2016-05-05
WO2012118961A1 (en) 2012-09-07
US9299317B2 (en) 2016-03-29
CN103403759A (en) 2013-11-20
EP2681710B1 (en) 2018-09-12
JP2015212978A (en) 2015-11-26
KR101538296B1 (en) 2015-07-29
US9501818B2 (en) 2016-11-22
CN103403759B (en) 2016-08-10
CN106204474A (en) 2016-12-07

Similar Documents

Publication Publication Date Title
CN106204474B (en) Local multi-grade tone mapping arithmetic unit
US9467704B2 (en) Adaptive ratio images in HDR image representation
CN106095354B (en) Improve the device and method based on the nonlinear image data exchange of perceived illumination intensity between different display capabilities
CN108141508B (en) Imaging device and method for generating light in front of display panel of imaging device
CN108885783A (en) Code and decode reversible production quality single-layer video signal
JP2022550206A (en) Tensor product B-spline predictor
JP2020524446A (en) Efficient end-to-end single layer inverse display management coding
Zhang et al. Multi-scale-based joint super-resolution and inverse tone-mapping with data synthesis for UHD HDR video
Abebe High Dynamic Range Imaging
Sekmen et al. A Compact Multi-Exposure File Format for Backward and Forward Compatible HDR Imaging
Ahmad et al. Pragmatic Manifestation of High Dynamic Range Imaging–A Review

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant