CN106878694B - high dynamic range signal processing system and method - Google Patents
high dynamic range signal processing system and method Download PDFInfo
- Publication number
- CN106878694B CN106878694B CN201610078509.7A CN201610078509A CN106878694B CN 106878694 B CN106878694 B CN 106878694B CN 201610078509 A CN201610078509 A CN 201610078509A CN 106878694 B CN106878694 B CN 106878694B
- Authority
- CN
- China
- Prior art keywords
- signal
- hdr
- linear
- sdr
- brightness
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/77—Circuits for processing the brightness signal and the chrominance signal relative to each other, e.g. adjusting the phase of the brightness signal relative to the colour signal, correcting differential gain or differential phase
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Processing Of Color Television Signals (AREA)
- Image Processing (AREA)
- Color Television Systems (AREA)
Abstract
A kind of high dynamic range (High Dynamic Range；HDR) signal processing system and method support HDR display device and standard dynamic range (Standard Dynamic Range；SDR) display device.In HDR signal processing system, pre-processing module receives the first linear HDR signal, and the first linear HDR signal is converted to the first SDR signal and the first mapping signal.Coding module receives and the first SDR signal and the first mapping signal is encoded to bit element flow, with the transmission of sharp signal.Decoder module receives and decodes the first SDR signal and the first mapping signal by bit element flow.Post-processing module receives and the first SDR signal and the first mapping signal that are decoded by bit element flow is redeveloped into the first linear HDR signal.Wherein, the first SDR signal can be shown by SDR display device, and the first linear HDR signal can be shown by HDR display device.
Description
Technical field
The present invention relates to a kind of high dynamic range (High Dynamic Range；HDR) video signal processing system and side
Method, in particular to one kind can support high dynamic range display devices and standard dynamic range (Standard Dynamic simultaneously
Range；SDR) the high dynamic range signal processing system and method with low computational complexity of display device.
Background technique
In the past, what traditional monitor was supported more was the display of standard dynamic range signal, however recently as development in science and technology,
The display of the display of high dynamic range signal is supported to start to occur, for example, to support the HDR under ITU BT.2020 specification
The display device of signal format is the extremely wide high dynamic range display devices of current display colour gamut.Then, in standard dynamic model
It encloses with two kinds of display specifications of high dynamic range and in the case where depositing, just often needs to turn input signal by processing system
The display device of user's end could be allowed to play out after changing.
However, specific processing system corresponds to specific display specification.In addition, high dynamic range signal and standard
The operation converted while being related between color gamut space, brightness and coloration of dynamic range signal between the two, therefore believe in conversion
Number process must carry out the high operation of complexity.
Summary of the invention
The embodiment of the present invention provides a kind of HDR signal processing system, while supporting HDR display device and SDR display device.
HDR signal processing system includes pre-processing module, coding module, decoder module and post-processing module.Pre-processing module receives the
One linear HDR signal, and the first linear HDR signal is converted into the first SDR signal and the first mapping signal.Coding module connection
It in pre-processing module, receives and the first SDR signal and the first mapping signal is encoded to bit element flow, with the transmission of sharp signal.Decoding
Module is connected to coding module, receives and decodes the first SDR signal and the first mapping signal by bit element flow.Post-processing module connects
It is connected to decoder module, receive and the first SDR signal and the first mapping signal that are decoded by bit element flow are redeveloped into first is linear
HDR signal.Wherein, decoder module more connects SDR display device, and transmits the first SDR signal to SDR display device to be shown
Show, and post-processing module more connects HDR display device, and transmits the first linear HDR signal to HDR display device to be shown
Show.
The embodiment of the present invention separately provides a kind of HDR signal processing method, is suitable for HDR signal processing system, wherein this HDR
Signal processing system supports HDR display device and SDR display device simultaneously.HDR signal processing method comprises the following steps that reception
And the first linear HDR signal is converted into the first SDR signal and the first mapping signal；It receives and by the first SDR signal and first
Mapping signal is encoded to bit element flow, with the transmission of sharp signal；It receives and the first SDR signal and the first mapping letter is decoded by bit element flow
Number；And it receives and the first SDR signal and the first mapping signal that are decoded by bit element flow is redeveloped into the first linear HDR and believe
Number.
In conclusion high dynamic range signal processing system proposed by the invention and method are the fortune by brightness and coloration
Point counting does not carry out, and to convert HDR signal to the calculating process of SDR signal and be greatly simplified.Furthermore pass through permanent brightness list
Member, the HDR signal that high dynamic range signal processing system proposed by the invention is exported are the images for meeting ITU BT.2020
Signal gamut standards can support the wide colour gamut display device of higher order.In addition to this, in by the operation of brightness and coloration respectively into
In the case where row, compared to input signal, in output signal, original white point (White Point) can still be maintained, and three
A primary chromaticities can still maintain its primary colors (Three Color Primaries).
Be further understood that feature and technology contents of the invention to be enabled, please refer to below in connection with it is of the invention specifically
Bright and attached drawing, but these explanations are intended merely to illustrate the present invention with Figure of description, rather than interest field of the invention is made
Any limitation.
Detailed description of the invention
Fig. 1 is the block diagram of high dynamic range signal processing system in the embodiment of the present invention.
Fig. 2 is the block diagram of the pre-processing module of high dynamic range signal processing system in the embodiment of the present invention.
Fig. 3 is the block diagram of the post-processing module of high dynamic range signal processing system in the embodiment of the present invention.
Fig. 4 is the flow chart of high dynamic range signal processing method in the embodiment of the present invention.
Fig. 5 is the flow chart of pre-treatment step in high dynamic range signal processing method in the embodiment of the present invention.
Fig. 6 is the flow chart of post-processing step in high dynamic range signal processing method in the embodiment of the present invention.
Description of symbols:
100 pre-processing modules
200 coding modules
300 decoder modules
400 post-processing modules
110 first colour gamut modules
111 first colour gamut units
112 first permanent brightness transition units
120 first brightness modules
121 linear inverse transform units
122 first luma units
130 first chromaticity modules
131 down-sampled units
132 second permanent brightness inverse transform units
133 second luma units
134 first chrominance units
300 decoder modules
410 second brightness modules
411 third luma units
412 non-linear conversion units
420 second chromaticity modules
421 second chrominance units
422 second colour gamut units
423 third perseverance brightness transition units
424 liters of sampling units
430 the 4th permanent brightness inverse transform units
S100~S400, S110~S130, S111~S112, S121~S122, S131~S134,
S410~S430, S411~S412, S421~S424 step
Specific embodiment
Various exemplary embodiments will be more fully described referring to Figure of description below, shown in Figure of description
Some exemplary embodiments.However, concept of the present invention may embody in many different forms, and should not be construed as limited by herein
Middle illustrated exemplary embodiment.Specifically, provide these exemplary embodiments make the present invention will to be detailed and complete,
And the scope for concept of the present invention sufficiently being conveyed to those who familiarize themselves with the technology.In all attached drawings, can be lavished praise on oneself in order to clear layer and
The size and relative size in area.Similar number indicates similar component always.
It should be understood that although various elements, these yuan may be described using term first, second, third, etc. herein
Part should not be limited by these terms.These terms are to distinguish an element and another element.Therefore, first yuan be discussed herein below
Part can be described as second element without departing from the teaching of concept of the present invention.As used herein, term " and/or " include associated
All combinations for listing any one of project and one or more.
Attached drawing will be cooperated to illustrate the high dynamic range signal processing system and method with various embodiments below, so
And following embodiments are not intended to limit the invention.
(embodiment of high dynamic range signal processing system)
Fig. 1 is please referred to, Fig. 1 is the block diagram of high dynamic range signal processing system in the embodiment of the present invention.The present invention is real
Apply (the High Dynamic Range of high dynamic range provided by example；HDR) signal processing system can not only support HDR display dress
It sets, while also can directly support SDR display device, and can be carried out between HDR signal and SDR signal with the operation of low complex degree
Conversion.
As shown in Figure 1, HDR signal processing system 1 provided by the embodiment of the present invention includes pre-processing module 100, coding
Module 200, decoder module 300 and post-processing module 400.Currently processed module 100 receives the HDR transmitted by outside source
Signal (is defined as the first linear HDR signal H in this1) when, HDR signal processing system 1 provided by the embodiment of the present invention
By first first linear HDR signal H received to institute1Carry out pre-treatment.In pretreatment process, pre-processing module 100 is first by
One linear HDR signal H1Be converted to the first SDR signal S1With the first mapping signal M1, wherein the first mapping signal M1Being is first
Linear HDR signal H1With the first SDR signal S1Between mapping relations.
Then, the coding module 200 for being connected to pre-processing module 100 receives and by the first SDR signal S1It first is reflected with this
Penetrate signal M1It is encoded to bit element flow BS (Bit Stream), with the transmission of sharp signal.Meanwhile coding module 200 is connected to decoding mould
Block 300, decoder module 300 decode it out the first SDR signal S after receiving the bit element flow transmitted by coding module 2001With first
Mapping signal M1.It must be explanatorily that the present invention is not intended to limit the framework configuration of coding module 200 Yu decoder module 300 in this.This
Outside, it is notably, if the display device that user's end is configured is for SDR display device, as long as by this SDR display device
Connection decoder module 300 can directly show the first SDR signal decoded at this time, without remaking at additional signal
Reason.
However, if the display device that user's end is configured is the first SDR letter decoded at this time for HDR display device
Number with the first mapping signal M1It will be transferred into the post-processing module 400 for being connected to decoder module 300, by post-processing module
400 are post-processed, in last handling process by the first SDR signal S1With the first mapping signal M1It is redeveloped into the first linear HDR
Signal H1, the HDR display device that user's end is configured is to the first linear HDR signal H1It is shown.
It follows that in this present embodiment, no matter the display device that user's end is configured is shown for high dynamic range
Device or standard dynamic range display device, through this embodiment provided by high dynamic range signal processing system 1
High dynamic range signal provided by signal source is converted into suitable high dynamic range display devices or standard dynamic range is shown
The signal format of showing device plays.
In next narration, the working principle of pretreatment process in the present embodiment will be further illustrated.
Before explaining the pretreatment process that HDR signal processing system 1 is carried out provided by the present embodiment in detail, below
Narration will be further explained first execute pretreatment process pre-processing module 100 construction configuration.
Referring to figure 2., Fig. 2 is the square of the pre-processing module of high dynamic range signal processing system in the embodiment of the present invention
Figure.As shown in Fig. 2, pre-processing module 100 includes the first colour gamut module 110, the first brightness module 120 and the first chromaticity module
130.First brightness module 120 and the first chromaticity module 130 are all connected to the first colour gamut module 110.In more detail, the first color
Domain module 110 includes the first colour gamut unit 111 and the first permanent brightness transition unit 112.First brightness module 120 includes linear anti-
Converting unit 121 and the first luma unit 122.First chromaticity module 130 includes the permanent brightness reversion of down-sampled unit 131, second
Change unit 132, the second luma unit 133 and the first chrominance unit 134.
Hold the first above-mentioned, the currently processed reception of module 100 is transmitted by outside source linear HDR signal H1When, it is preceding
Processing module 100 will be first to a received first linear HDR signal H1Carry out pre-treatment.In this present embodiment, outside source
The linear HDR signal that it is RGB that provided signal, which is for color gamut space, and format is 4:4:4, and in order to support SDR display dress
It sets, this HDR signal first can be converted into the SDR signal that signal format is YUV 4:2:0 by pre-processing module 100.
It further illustrates, in pretreatment process, the first colour gamut unit 111 of the first colour gamut module 110 receives First Line
Property HDR signal H1Afterwards, i.e., by the first linear HDR signal H1In RGB component multiplied by matrix A, to calculate linear luminance Y.More in detail
It carefully says, the first colour gamut unit 111 passes through matrix A for the first linear HDR signal H1Color gamut space converted by RGB color domain space
To YUV color gamut space, to obtain linear luminance Y.
(matrix A)
Then, the first of the first colour gamut module 110 the permanent brightness transition unit 112 passes through formula (1) and formula (2-1) to formula (2-
3) operation is by the first linear HDR signal H1Be converted to the first non-linear permanent brightness HDR signal H '1。
(formula 1)
Wherein,
Y′c=(0.2627R+0.6780G+0.0593B) (formula 2-1)
(formula 2-2)
(formula 2-3)
Wherein,
PB=0.7910, NB=-0.9702
PR=0.4969, NR=-0.8591
It further illustrates, by formula (1), the first permanent brightness transition unit 112 is first by the first linear HDR signal H1Middle R points
Amount, G component and B component linear transformation are nonlinear R ' component, G ' component and B ' component, and by linear luminance Y line above-mentioned
Property be converted to non-linear brightness Y ' (R, G, B, Y substitute into the L in formula (1) respectively, calculated value be respectively R ', G ', B ',
Y').Then, by formula (2-1) to formula (2-3), the first permanent brightness transition unit 112 calculates non-linear chroma U ' (i.e. formula (2-
2) C ' inBC) and non-linear chroma the V ' (C ' i.e. in formula (2-3)RC), finally output includes non-linear brightness Y ', non-linear color
Spend the first non-linear permanent brightness HDR signal H ' of U ' and non-linear chroma V '1。
It must be explanatorily the first non-linear permanent brightness HDR signal H ' that the first permanent brightness transition unit 112 is exported1Packet
Include the first non-linear HDR luminance signal Hl '1With the first non-linear HDR carrier chrominance signal Hc '1, wherein the first non-linear permanent brightness HDR
Signal H '1I.e. comprising non-linear brightness Y ', non-linear chroma U ' and V ', the first non-linear HDR luminance signal Hl '1I.e. comprising non-thread
Property brightness Y ', the first non-linear HDR carrier chrominance signal Hc '1It include non-linear chroma U ' and V '.It meanwhile being notably formula
(2-1) is to the permanent brightness that formula (2-3) is under ITU BT.2020 standard, when the domain RGB signal is converted to the domain YUV signal
(Constant Luminance) arithmetic expression, therefore it is found that the first non-linear permanent brightness HDR signal H '1It is to meet ITU BT.2020
The signal format of permanent brightness under standard.
Then, pre-processing module 100 is by the first non-linear permanent brightness HDR signal H '1In the first non-linear HDR brightness letter
Number Hl '1With the first non-linear HDR carrier chrominance signal Hc '1Calculation process is carried out respectively.
With continued reference to Fig. 2, primarily with respect to the part of brightness operation, it is bright that the first brightness module 120 receives the first non-linear HDR
Spend signal Hl '1, by the linear inverse transform unit 121 of the first brightness module 120 by the first non-linear HDR luminance signal Hl '1Conversion
Return the first linear HDR luminance signal Hl1, to carry out subsequent arithmetic.
Next, the first luma unit 122 passes through formula (3) and formula (4) for the first linear HDR luminance signal Hl1It is converted to
First SDR luminance signal Sl1With the first mapping signal M1。
(formula 3)
(formula 4)
It further illustrates, by formula (3), the first luma unit 122 is first by the first linear HDR luminance signal Hl1Substitution formula
(3) Y in0With the brightness value Y being mapped as in formula (3)t, wherein f is for the parameter of the function curvature of control formula (3).Then lead to
Formula (4) are crossed, by this brightness value YtIt is quantified as the first SDR luminance signal Sl1, i.e., brightness value Y in formula (4)s, wherein P is for formula
(3) Y in0Maximum value, and N is expressed as the first SDR luminance signal Sl1(i.e. Ys) signal digit, representative value be 8 or 10.Together
When, the first luma unit 122 is according to parameter f, by the first linear HDR luminance signal Hl1With the first SDR luminance signal Sl1Between
Mapping relations are converted to the first mapping signal M1.
On the other hand, the part about coloration operation, it is known that the SDR signal and signal lattice that signal format is YUV 4:2:0
Formula is that the linear HDR signal of RGB 4:4:4 is compared, four times of the resolution difference of the carrier chrominance signal of the two, therefore the first chromaticity module
130 down-sampled unit 131 receives the first non-linear permanent brightness HDR signal H1' after just convert thereof into format be YUV 4:2:0
The second non-linear permanent brightness HDR signal H2', with sharp subsequent arithmetic.
That is, the second down-sampled non-linear permanent brightness HDR signal H '2The non-linear HDR of included second is bright
Spend signal Hl '2(non-linear brightness Y ') and the second non-linear HDR carrier chrominance signal Hc '2The resolution of (non-linear chroma U ' and V ')
It is original a quarter, therefore in this present embodiment, the part of coloration operation is the letter in YUV4:2:0 in pretreatment process
It is carried out under number format.In this way, since signal resolution degree is original a quarter, the computational complexity in pretreatment process
Just it therefore greatly reduces.
Then, the second permanent brightness inverse transform unit 132 receives the non-linear permanent brightness HDR signal H of down-sampled second2’
Afterwards, also by the second non-linear permanent brightness HDR signal H2' in luminance part and chrominance section carry out operation respectively.In detail,
About brightness arithmetic section, the second permanent brightness inverse transform unit 132 is by the second non-linear permanent brightness HDR signal H2' in second
Non-linear HDR luminance signal Hl '2Linear reversion is changed to the second linear HDR luminance signal Hl2, and connect by the second luma unit 133
Receive the second linear HDR luminance signal Hl2Afterwards, it will pass through previously described formula (4) and be converted into the 2nd SDR luminance signal Sl2, in addition, the
Two luma units 133 separately calculate the second linear HDR luminance signal Hl2With the 2nd SDR luminance signal Sl2Ratio, in order into
Row coloration operation.
And on the other hand, about coloration arithmetic section, the second permanent brightness inverse transform unit 132 is by the second non-linear HDR color
Spend signal Hc '2It carries out linear reversion and is changed to the second linear HDR carrier chrominance signal Hc2Afterwards, further the second linear HDR coloration is believed
Number Hc2Color gamut space converted by YUV to RGB, in subsequent arithmetic in RGB color gamut space carry out signal coloration turn
It changes.
It is notably that the second permanent brightness inverse transform unit 132 believes the second down-sampled non-linear perseverance brightness HDR
Number H '2The operation carried out is actually the inverse operation of previously described formula (1) and formula (2-1) to formula (2-3).In other words, second
Permanent brightness inverse transform unit 132 is to the second down-sampled non-linear permanent brightness HDR signal H '2The operation carried out is actually i.e.
It is the first permanent brightness transition unit 112 to the first linear HDR signal H1The inverse operation of the operation carried out.First chrominance unit
134 receive the 2nd SDR luminance signal Sl2With the second linear HDR carrier chrominance signal Hc2Afterwards, first by the second linear HDR carrier chrominance signal Hc2
Multiplied by by the 133 calculated 2nd SDR luminance signal Sl of institute of the second luma unit2With the second linear HDR luminance signal Hl2Ratio
Value, to be converted into the first SDR carrier chrominance signal Sc1.Then, the first chrominance unit 134 is again by matrix above-mentioned (A) by the
One SDR carrier chrominance signal Sc1Color gamut space YUV is converted to by RGB.
It holds, by pretreatment process, pretreatment unit 100 is that the first linear HDR signal is converted to the first SDR brightness
Signal Sl1, the first mapping signal M1With the first SDR carrier chrominance signal Sc1, and it is input to coding module 200, by coding mould
Block 200 is by the first SDR luminance signal Sl1, the first mapping signal M1With the first SDR carrier chrominance signal Sc1It is encoded to and is conducive to signal transmission
Bit element flow BS, wherein the first SDR luminance signal Sl1With the first SDR carrier chrominance signal Sc1As the first SDR signal S1。
It is the post-processing of high dynamic range signal processing system in the embodiment of the present invention referring to Fig. 1 and Fig. 3, Fig. 3
The block diagram of module.
Firstly, as shown in Figure 1, including the first SDR luminance signal Sl1, the first mapping signal M1With the first SDR carrier chrominance signal
Sc1Bit element flow BS be sent to decoder module 300 to be decoded.As shown in figure 3, decoder module 300 is by the received bit of institute
Stream BS is decoded as the first SDR signal S1, the first SDR luminance signal Sl1With the first mapping signal M1.At this point, since the first SDR believes
Number S1The as format SDR signal that is YUV 4:2:0, if therefore the display device that is configured of user's end be common at present non-
The SDR display device of permanent brightness (Non-Constant Luminance) specification, decoder module 300 can be by the first SDR signal
S1So far SDR display device is to be shown for output, without remaking additional signal processing.However, if user's end is matched
The display device set just must for the SDR display device or HDR display device of permanent brightness (Constant Luminance) specification
The first SDR signal S that will successively be decoded by bit element flow BS by post-processing module 4001, the first SDR luminance signal Sl1With
First mapping signal M1It is post-processed.
In next narration, the working principle of last handling process in the present embodiment will be further illustrated.
Before explaining the last handling process that HDR signal processing system 1 is carried out provided by the present embodiment in detail, below
Narration will be further explained first execute last handling process post-processing module 400 construction configuration.
Referring to figure 3., Fig. 3 is the square of the post-processing module of high dynamic range signal processing system in the embodiment of the present invention
Figure.As shown in figure 3, post-processing module 400 includes that the second brightness module 410, the second chromaticity module 420 and the 4th permanent brightness invert
Change unit 430, wherein the second brightness module 410 is all connected to decoder module 300 with the second chromaticity module 420 and the 4th perseverance is bright
It spends between inverse transform unit 430.In more detail, the second brightness module 410 includes third luma unit 411 and non-linear conversion
Unit 412, and the second chromaticity module 420 includes the second chrominance unit 421, the second colour gamut unit 422, third perseverance brightness transition list
Member 423 and liter sampling unit 424.
It is same as pretreatment process, in the last handling process of the present embodiment, post-processing module 400 is also by received signal
Middle luminance part and chrominance section distinguish operation.That is, in last handling process, the first SDR luminance signal Sl1With first
Mapping signal M1It is that operation, and the first SDR signal S are carried out by the second brightness module 4101It is to be transported by the second chromaticity module 420
It calculates.
Operation described below by explanation about the luminance part of signal in last handling process.Firstly, the second brightness module
410 third luma unit 411 is according to the first mapping signal M1By the first SDR luminance signal Sl1It is bright to be mapped as third linear HDR
Spend signal Hl3.Then, third luma unit 411 calculates third linear HDR luminance signal Hl3With the first SDR luminance signal Sl1
Ratio, wherein the second linear HDR luminance signal Hl in this ratio i.e. pretreatment process above-mentioned2With the 2nd SDR brightness
Signal Sl2Ratio.Then, the non-linear conversion unit 412 of the second brightness module 410 is just by third linear HDR luminance signal
Hl3Carry out the second non-linear HDR luminance signal Hl ' that non-linear conversion is returned in aforementioned pretreatment process2。
On the other hand, the operation described below by explanation about the chrominance section of signal in last handling process.Firstly, second
Second chrominance unit 421 of chromaticity module 420 is by the received first SDR luminance signal Sl of institute1With the first SDR carrier chrominance signal Sc1?
Multiplied by third linear HDR luminance signal Hl3With the first SDR luminance signal Sl1Ratio, to be converted into the second linear HDR letter
Number H2.It must be explanatorily third linear HDR luminance signal Hl3With the first SDR luminance signal Sl1Ratio i.e. it is aforementioned before place
Second linear HDR luminance signal Hl during reason2With the 2nd SDR luminance signal Sl2Ratio.
Then, the second colour gamut unit 422 receives the second linear HDR signal H2Afterwards, just by the second linear HDR signal H2Color
Domain space is converted by YUV to RGB by the inverse matrix of aforementioned matrix (A), with can be in the color gamut space of RGB in the operation of connecting
Carry out the chroma conversion of signal.
Third perseverance brightness transition unit 423 is connected to third luma unit 411 and the second colour gamut unit 422, therefore third is permanent
Brightness transition unit 423 receives third linear HDR luminance signal Hl3, also receive color gamut space convert it is second linear to RGB
HDR signal H2。
Then, on the one hand, third perseverance brightness transition unit 423 is by the second linear HDR signal H2Pass through formula above-mentioned (2-1)
Its color gamut space is converted by RGB to YUV to formula (2-3), then by third linear HDR luminance signal Hl3Believe with the second linear HDR
Number H2In chromatic component be converted to third linear HDR signal H3。
In this, third linear HDR signal H3It is for the HDR signal of YUV 4:2:0 format, and must is explanatorily formula (2-
1) to the permanent brightness (Constant that formula (2-3) is under ITU BT.2020 standard, when the domain RGB signal is converted to the domain YUV signal
Luminance) arithmetic expression, therefore it is found that third linear HDR signal H3It is the signal for meeting permanent brightness under ITU BT.2020 standard
Format.At this point, if user's end can play the HDR signal of the YUV 4:2:0 format of permanent brightness under ITU BT.2020 standard, just
Third linear HDR signal H can be received by third perseverance brightness transition unit 4233To be shown.
On the other hand, third perseverance brightness transition unit 423 is by the second linear HDR signal H2Color gamut space converted by RGB
To YUV, further by the second linear HDR signal H2Linear transformation is the second non-linear permanent brightness HDR signal H '2.It connects
, third perseverance brightness transition unit 423 is by the second non-linear permanent brightness HDR signal H '2In the second non-linear HDR carrier chrominance signal
Hc’2Be sent to liter sampling unit 424, with by liter sampling unit 424 by the second non-linear HDR carrier chrominance signal Hc '2Signal format
YUV 4:4:4 is converted to by YUV4:2:0.
Finally, the 4th permanent brightness inverse transform unit 430 receives the second non-linear HDR that signal format is YUV 4:4:4
Luminance signal Hl '2With the second non-linear HDR carrier chrominance signal Hc '2Afterwards, just by its by formula (2-1) to formula (2-3) inverse operation with
Reconstruct the first linear HDR signal H that signal format is RGB 4:4:41。
In this, must be explanatorily, formula (2-1) to formula (2-3) be under ITU BT.2020 standard, the domain RGB signal convert to
Permanent brightness (Constant Luminance) arithmetic expression when signal of the domain YUV, therefore it is found that the first linear HDR signal reconstructed
H1It is the signal format for meeting permanent brightness under ITU BT.2020 standard.At this point, if user's end can play ITU BT.2020 mark
The HDR signal of the RGB 4:4:4 format of the lower permanent brightness of standard can connect the 4th permanent brightness inverse transform list of post-processing module 400
Member 430 is to receive the first linear HDR signal H1To be shown.
It follows that high dynamic range signal processing system 1 provided by through this embodiment, can be by signal format
The HDR signal of RGB 4:4:4 is converted to the non-linear perseverance brightness HDR letter that format is the SDR signal of YUV4:2:0, YUV 4:2:0
Linear HDR signal number with RGB 4:4:4, to be respectively suitable for the HDR display dress of existing SDR display device or different size
It sets.
This exterior palpi is explanatorily, in the high dynamic range signal processing system 1 provided by the present embodiment, although HDR believes
Conversion number between SDR signal is respectively to calculate the luminance part of signal with chrominance section, but in calculating process
In mainly using luminance signal ratio between the two as conversion coefficient, therefore actually compared to input signal, in output letter
In number, the part of original white point (White Point) can still be maintained, and three Essential colour can still maintain its primary colors (Three
Color Primaries).In other words, in this present embodiment, the first linear HDR signal H inputted compared to signal source1,
The first linear HDR signal H after reconstructed1In, originally the part (the white part of grey black) of coloration can still not maintain, and
Three Essential colour can still maintain its primary colors (red, green, blue).
(embodiment of high dynamic range signal processing method)
Referring to figure 4., Fig. 4 is the flow chart of high dynamic range signal processing method in the embodiment of the present invention.Described in this example
Method can with high dynamic range signal shown in FIG. 1 handle 1 execute, therefore please together according to Fig. 1 with benefit understand.
It is the step of high dynamic range signal processing method such as following provided by the present embodiment.In step S100, receive
And the first linear HDR signal is converted into the first SDR signal and the first mapping signal.In step S200, receive and by first
SDR signal and the first mapping signal are encoded to bit element flow, with the transmission of sharp signal.Then, it in step S300, receives and by bit
Stream decodes the first SDR signal and the first mapping signal.Finally, in step S400, receives and will be decoded by bit element flow
First SDR signal and the first mapping signal are redeveloped into the first linear HDR signal.
It further illustrates, aforementioned step S100 is in high dynamic range signal processing method provided by the present embodiment
Pre-treatment step, and aforementioned step S400 is for after in high dynamic range signal processing method provided by the present embodiment
Processing step.
Referring to figure 5., Fig. 5 is the process of the pre-treatment step of high dynamic range signal processing method in the embodiment of the present invention
Figure.The pre-treatment step S100 of high dynamic range signal processing method provided by the present embodiment includes the following steps.
Firstly, receiving in step S110 and the first linear HDR signal being converted to the first non-linear perseverance brightness HDR and believe
Number, wherein the first non-linear permanent brightness HDR signal includes that the first non-linear HDR luminance signal is believed with the first non-linear HDR coloration
Number.It further illustrates, the detailed carry out step of step S110 is for another example following.In step S111, receive and by the first linear HDR
The color gamut space of signal is converted by RGB color domain space to YUV color gamut space, then in step S112, is received and by First Line
Property HDR signal be converted to the first non-linear permanent brightness HDR signal.
S120 is entered step after step S110, in step S120, receives and believes the first non-linear perseverance brightness HDR
The first non-linear HDR luminance signal in number is converted to the first SDR luminance signal and the first mapping signal.It further illustrates, step
The detailed carry out step of rapid S120 is for another example following.In step S121, receive and will be in the first non-linear permanent brightness HDR signal
First non-linear HDR luminance signal is converted to the first linear HDR luminance signal.Then it in step S122, receives and by first
Linear HDR luminance signal is converted to the first SDR luminance signal and the first mapping signal.
Finally, enter step S130 after step S120, in step S130, receive and by the first non-linear permanent brightness
The first non-linear HDR carrier chrominance signal in HDR signal is converted to the first SDR carrier chrominance signal, wherein the first SDR carrier chrominance signal
Resolution is a quarter of the resolution of the first SDR luminance signal.It further illustrates, the detailed carry out step of step S130 is again
It is such as following.In step S131, receives and the first non-linear permanent brightness HDR signal is converted into the second non-linear permanent brightness HDR
Signal, wherein the signal format of the second non-linear permanent brightness HDR signal is YUV 4:2:0.In step S132, it is non-to receive second
Linear perseverance brightness HDR signal, exports the second linear HDR luminance signal and the second linear HDR carrier chrominance signal after operation, wherein the
The color gamut space of bilinear HDR carrier chrominance signal is for RGB color domain space.Then it in step S133, receives and linear by second
HDR luminance signal is converted to the 2nd SDR luminance signal.Finally in step S134, receive and by the 2nd SDR luminance signal and the
Bilinear HDR carrier chrominance signal is converted to the first SDR carrier chrominance signal.
Next Fig. 6 is please referred to, Fig. 6 is the post-processing step of high dynamic range signal processing method in the embodiment of the present invention
Flow chart.The post-processing step S400 of high dynamic range signal processing method provided by the present embodiment includes the following steps.
Firstly, in step S410, receives and that the first SDR luminance signal is converted to second with the first mapping signal is non-thread
Property HDR luminance signal.It further illustrates, the detailed carry out step of step S410 is for another example following.In step S411, reception simultaneously will
First SDR luminance signal and the first mapping signal are converted to third linear HDR luminance signal.Then it in step S412, receives
And third linear HDR luminance signal is converted into the second non-linear HDR luminance signal.
Then, S420 is entered step after step S410.In step S420, receive and by the first SDR carrier chrominance signal
Be converted to the second non-linear HDR carrier chrominance signal.It further illustrates, the detailed carry out step of step S420 is for another example following.In step
In S421, receives and the first SDR luminance signal, the first mapping signal and the first SDR carrier chrominance signal are converted into the second linear HDR
Signal.In step S422, receives and convert the color gamut space of the second linear HDR signal to RGB color domain by YUV color gamut space
Space.
After step S422, S423 is on the one hand entered step, receives third linear HDR luminance signal and the second linear HDR
After signal, the color gamut space of the second linear HDR signal is converted by RGB color domain space to YUV color gamut space, and linear by second
HDR signal and third linear HDR luminance signal are converted to third linear HDR signal.
At this point, if user's end can play the HDR signal of the YUV4:2:0 format of permanent brightness under ITU BT.2020 standard,
Third linear HDR signal H can be received3To be shown.
On the other hand, it enters step S424 after step S422, receives and by third linear HDR luminance signal and the second line
Property HDR signal be converted to the second non-linear permanent brightness HDR signal, wherein the color gamut space of the second non-linear permanent brightness HDR signal
It is for YUV color gamut space and including the second non-linear HDR carrier chrominance signal.Then, it in step S425, receives and non-thread by second
The resolution of property HDR carrier chrominance signal is promoted to original four times.Finally, the second non-linear HDR brightness is believed in step S426
Number with the second non-linear HDR carrier chrominance signal be redeveloped into the first linear HDR signal.
At this point, if user's end can play the HDR signal of the RGB4:4:4 format of permanent brightness under ITU BT.2020 standard,
The first linear HDR signal H can be received1To be shown.
It must be explanatorily about high dynamic range signal processing method and pretreatment process therein and to post-process in this
Correlative detail embodiment depicted in above-mentioned Fig. 1 to Fig. 3 of each step of journey has been described in detail, herein without repeating.
In addition to this, each step of embodiment depicted in fig. 4 to fig. 6 be only described for convenience need, this hair
Bright embodiment is not using each step sequence to each other as the restrictive condition for implementing each embodiment of the present invention.
(the possibility technical effect of embodiment)
In conclusion high dynamic range signal processing system proposed by the invention and method are the fortune by brightness and coloration
Point counting does not carry out, so that the calculating process that HDR signal is converted to SDR signal is greatly simplified.Furthermore pass through permanent brightness list
Member, the HDR signal that high dynamic range signal processing system proposed by the invention is exported are the images for meeting ITU BT.2020
Signal gamut standards can support the wide colour gamut display device of higher order.In addition to this, in by the operation of brightness and coloration respectively into
In the case where row, compared to input signal, in output signal, original white point (White Point) can still be maintained, and three
A primary chromaticities can still maintain its primary colors (Three Color Primaries).
The above description is only an embodiment of the present invention, not to limit to the scope of the patents of the invention.
Claims (9)
1. a kind of HDR signal processing system, comprising:
One pre-processing module receives one first linear HDR signal, and the first linear HDR signal is converted to one the oneth SDR letter
Number with one first mapping signal；
One coding module is connected to the pre-processing module, receives and is encoded to the first SDR signal and first mapping signal
One bit element flow, with the transmission of sharp signal；
One decoder module, is connected to the coding module, receives and decodes the first SDR signal by the bit element flow and first reflects with this
Penetrate signal；And
One post-processing module, is connected to the decoder module, receive and by the first SDR signal decoded by the bit element flow with should
First mapping signal is redeveloped into the first linear HDR signal；
Wherein, which includes: one first colour gamut module, receives and the first linear HDR signal is converted to one the
One non-linear permanent brightness HDR signal, wherein the first non-linear permanent brightness HDR signal includes one first non-linear HDR brightness letter
Number with one first non-linear HDR carrier chrominance signal；One first brightness module, is connected to the first colour gamut module, receive and by this
The first non-linear HDR luminance signal in one non-linear permanent brightness HDR signal be mapped as one the oneth SDR luminance signal and this
One mapping signal；And one first chromaticity module, it is connected to the first colour gamut module, is received and by the first non-linear permanent brightness
The first non-linear HDR luminance signal and the first non-linear HDR carrier chrominance signal in HDR signal are converted to one the oneth SDR color
Spend signal；Wherein, the resolution of the first SDR carrier chrominance signal is a quarter of the resolution of the first SDR luminance signal, should
Decoder module more connects a SDR display device, and transmits the first SDR signal to the SDR display device to be shown, and should
Post-processing module more connects a HDR display device, and transmits the reconstructed first linear HDR signal to the HDR display device
To be shown.
2. HDR signal processing system as described in claim 1,
Wherein the coding module receives and by the first SDR luminance signal, first mapping signal and the first SDR carrier chrominance signal
It is encoded to the bit element flow, with the transmission of sharp signal；And
Wherein the decoder module receives and is decoded the first SDR luminance signal, first mapping signal by the bit element flow and be somebody's turn to do
First SDR carrier chrominance signal.
3. HDR signal processing system as claimed in claim 2, wherein the post-processing module includes:
One second brightness module, is connected to the decoder module, receives and by the first SDR luminance signal and first mapping signal
Be converted to one second non-linear HDR luminance signal；
One second chromaticity module, is connected to the decoder module, receives and that the first SDR carrier chrominance signal is converted to one second is non-thread
Property HDR carrier chrominance signal；And
One the 4th permanent brightness inverse transform unit, is connected to second brightness module and second chromaticity module, reception and by this
Two non-linear HDR luminance signals and the second non-linear HDR carrier chrominance signal are redeveloped into the first linear HDR signal.
4. HDR signal processing system as described in claim 1, wherein the first colour gamut module includes:
One first colour gamut unit receives and converts the color gamut space of the first linear HDR signal to YUV by RGB color domain space
Color gamut space；And
One first permanent brightness transition unit, is connected to the first colour gamut unit, receives and be converted to the first linear HDR signal
The first non-linear permanent brightness HDR signal.
5. HDR signal processing system as claimed in claim 4, wherein first brightness module includes:
One linear inverse transform unit is connected to the first permanent brightness transition unit, receives and by the first non-linear permanent brightness HDR
The first non-linear HDR luminance signal in signal is converted to one first linear HDR luminance signal；And
One first luma unit is connected to the linear inverse transform unit, receives and is mapped as the first linear HDR luminance signal
First SDR luminance signal and first mapping signal.
6. HDR signal processing system as claimed in claim 4, wherein first chromaticity module includes:
One down-sampled unit is connected to the first permanent brightness transition unit, receives and by the first non-linear permanent brightness HDR signal
One second non-linear permanent brightness HDR signal is converted to, wherein the signal format of the second non-linear permanent brightness HDR signal is YUV
4:2:0；
One second permanent brightness inverse transform unit, is connected to the down-sampled unit, receives the second non-linear permanent brightness HDR signal,
One second linear HDR luminance signal and one second linear HDR carrier chrominance signal are exported after operation, wherein the second linear HDR color
The color gamut space for spending signal is for RGB color domain space；
One second luma unit is connected to the second permanent brightness inverse transform unit, receives and by the second linear HDR luminance signal
It is mapped as one the 2nd SDR luminance signal, and calculates the ratio of second linear the HDR luminance signal and the 2nd SDR luminance signal
Value；And
One first chrominance unit is connected to the second permanent brightness inverse transform unit and second luma unit, receive and by this
Bilinear HDR carrier chrominance signal multiplied by second linear the HDR luminance signal and the 2nd SDR luminance signal ratio, to calculate
First SDR carrier chrominance signal.
7. HDR signal processing system as claimed in claim 3, wherein second brightness module includes:
One third luma unit is connected to the decoder module, receives and is believed the first SDR brightness according to first mapping signal
Number it is mapped as a third linear HDR luminance signal, and calculates third linear HDR luminance signal and the first SDR brightness letter
Number ratio；And
One non-linear conversion unit is connected to the third luma unit, receives and is converted to third linear HDR luminance signal
The second non-linear HDR luminance signal.
8. HDR signal processing system as claimed in claim 7, wherein second chromaticity module includes:
One second chrominance unit, is connected to the decoder module, after receiving the first SDR signal, by being somebody's turn to do in the first SDR signal
First SDR luminance signal and the first SDR carrier chrominance signal are multiplied by third linear HDR luminance signal and the first SDR brightness
One second linear HDR signal is converted to after the ratio of signal；
One second colour gamut unit, is connected to second chrominance unit, receive and by the color gamut space of the second linear HDR signal by
YUV color gamut space is converted to RGB color domain space；
One third perseverance brightness transition unit, is connected to the third luma unit and the second colour gamut unit, receives and by the third
Linear HDR luminance signal and the second linear HDR signal are converted to one second non-linear permanent brightness HDR signal, wherein this second
The color gamut space of non-linear perseverance brightness HDR signal is for YUV color gamut space and including one second non-linear HDR carrier chrominance signal；With
And
One liter of sampling unit, is connected to the third perseverance brightness transition unit, receives and by the second non-linear HDR carrier chrominance signal
Resolution is promoted to original four times；
Wherein, the second non-linear HDR luminance signal and the second non-linear HDR carrier chrominance signal are by the 4th permanent brightness inverse transform
Unit is redeveloped into the first linear HDR signal.
9. HDR signal processing system as claimed in claim 8, wherein the third perseverance brightness transition unit by receive this
The color gamut space of bilinear HDR signal is converted by RGB color domain space to YUV color gamut space, and by the second linear HDR signal with
Third linear HDR luminance signal is converted to a third linear HDR signal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW105124094A TWI599230B (en) | 2015-12-10 | 2016-07-29 | System for processing hdr signal |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201562265431P | 2015-12-10 | 2015-12-10 | |
| US62/265,431 | 2015-12-10 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106878694A CN106878694A (en) | 2017-06-20 |
| CN106878694B true CN106878694B (en) | 2018-12-18 |
Family
ID=59239314
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610078509.7A Active CN106878694B (en) | 2015-12-10 | 2016-02-04 | high dynamic range signal processing system and method |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106878694B (en) |
| TW (1) | TWI599230B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107404624B (en) * | 2017-07-11 | 2021-04-16 | 深圳Tcl新技术有限公司 | Method and device for optimizing HDR signal processing and computer readable storage medium |
| CN107682673B (en) * | 2017-10-09 | 2019-11-12 | 成都索贝数码科技股份有限公司 | A method of 4KHDR and HDSDR signal is supervised based on GPU and video IO card simultaneously |
| US10972767B2 (en) * | 2017-11-01 | 2021-04-06 | Realtek Semiconductor Corp. | Device and method of handling multiple formats of a video sequence |
| TW201946430A (en) | 2018-04-30 | 2019-12-01 | 圓剛科技股份有限公司 | Video signal conversion device and method thereof |
| CN108900823B (en) * | 2018-07-05 | 2019-07-12 | 华为技术有限公司 | A kind of method and device of video frequency signal processing |
| CN109274985B (en) * | 2018-10-12 | 2020-04-28 | 腾讯科技（深圳）有限公司 | Video transcoding method and device, computer equipment and storage medium |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101212545A (en) * | 2007-12-24 | 2008-07-02 | 电子科技大学 | Method and device for mapping high-dynamic range graphics to low-dynamic range graphics |
| CN101707666A (en) * | 2009-11-26 | 2010-05-12 | 北京中星微电子有限公司 | Adjusting method and device with high dynamic range |
| TWI479898B (en) * | 2010-08-25 | 2015-04-01 | Dolby Lab Licensing Corp | Extending image dynamic range |
| US9129445B2 (en) * | 2012-03-14 | 2015-09-08 | Dolby Laboratories Licensing Corporation | Efficient tone-mapping of high-bit-depth video to low-bit-depth display |
| CN105787909B (en) * | 2012-08-08 | 2018-07-20 | 杜比实验室特许公司 | Image procossing for high dynamic range images |
| ES2770426T3 (en) * | 2013-02-21 | 2020-07-01 | Koninklijke Philips Nv | Improved HDR image encoding and decoding methods and devices |
| CN116320394A (en) * | 2014-02-25 | 2023-06-23 | 苹果公司 | Adaptive transfer function for video encoding and decoding |
-
2016
- 2016-02-04 CN CN201610078509.7A patent/CN106878694B/en active Active
- 2016-07-29 TW TW105124094A patent/TWI599230B/en active
Also Published As
| Publication number | Publication date |
|---|---|
| TWI599230B (en) | 2017-09-11 |
| TW201722146A (en) | 2017-06-16 |
| CN106878694A (en) | 2017-06-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106878694B (en) | high dynamic range signal processing system and method | |
| US11289002B2 (en) | System and method for a six-primary wide gamut color system | |
| US11183098B2 (en) | System and method for a six-primary wide gamut color system | |
| WO2019114369A1 (en) | Primary color conversion method and converter therefor, display control method, and display device | |
| CN101867831B (en) | Strategies for processing image information using a color information data structure | |
| KR100782818B1 (en) | Method and system for luminance preserving color conversion from YUV to RGB | |
| US11721266B2 (en) | System and method for a multi-primary wide gamut color system | |
| CN101416220B (en) | For strengthening the pre-processing image data of compression | |
| JP6234920B2 (en) | High dynamic range image signal generation and processing | |
| CN1910901B (en) | Smart clipper for mobile displays | |
| CN102598114A (en) | Method for producing a color image and imaging device employing same | |
| EP3070925B1 (en) | Color matching for imaging systems | |
| US11488510B2 (en) | System and method for a multi-primary wide gamut color system | |
| CN102870418A (en) | Image transmission and displaying method based on principle of chroma and visual fidelity | |
| CN100474936C (en) | Apparatus and method for transforming three color signals into multi-color signal | |
| CN111179801B (en) | Color space adjustment method, device and system of display panel | |
| CN100488258C (en) | Apparatus and method for controlling hue and luminance in image display device | |
| CN101378515A (en) | Method for transferring video signal colors and television set | |
| CN104952383B (en) | Color monitor is driven to show the circuit and data converting circuit of black and white grey-tone image | |
| CN106303485B (en) | The method of the more primary colors expanded color gamuts of compatible transmission | |
| CN1860798A (en) | Universal color decoder and method for decoding input signal for a multiple primary color display system | |
| US20040240563A1 (en) | Video preprocessor | |
| CN101394470B (en) | Method and apparatus for decoding a video signal | |
| CN107948652A (en) | A kind of method and apparatus for carrying out image conversion | |
| KR20040091667A (en) | Method and device for coding and decoding a digital color video sequence |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |