CN104246866A - Display power reduction using SEI information - Google Patents
Display power reduction using SEI information Download PDFInfo
- Publication number
- CN104246866A CN104246866A CN201380020811.1A CN201380020811A CN104246866A CN 104246866 A CN104246866 A CN 104246866A CN 201380020811 A CN201380020811 A CN 201380020811A CN 104246866 A CN104246866 A CN 104246866A
- Authority
- CN
- China
- Prior art keywords
- display
- data
- pixel
- video segment
- adaptive information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
- G06F1/325—Power saving in peripheral device
- G06F1/3265—Power saving in display device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/10—Intensity circuits
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/23614—Multiplexing of additional data and video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
- H04N21/4436—Power management, e.g. shutting down unused components of the receiver
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/654—Transmission by server directed to the client
- H04N21/6547—Transmission by server directed to the client comprising parameters, e.g. for client setup
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/06—Adjustment of display parameters
- G09G2320/0613—The adjustment depending on the type of the information to be displayed
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/06—Adjustment of display parameters
- G09G2320/0626—Adjustment of display parameters for control of overall brightness
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/06—Adjustment of display parameters
- G09G2320/0626—Adjustment of display parameters for control of overall brightness
- G09G2320/0646—Modulation of illumination source brightness and image signal correlated to each other
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2330/00—Aspects of power supply; Aspects of display protection and defect management
- G09G2330/02—Details of power systems and of start or stop of display operation
- G09G2330/021—Power management, e.g. power saving
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/02—Handling of images in compressed format, e.g. JPEG, MPEG
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2360/00—Aspects of the architecture of display systems
- G09G2360/16—Calculation or use of calculated indices related to luminance levels in display data
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/02—Networking aspects
- G09G2370/022—Centralised management of display operation, e.g. in a server instead of locally
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
- G09G3/3406—Control of illumination source
- G09G3/3413—Details of control of colour illumination sources
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
- G09G3/36—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using liquid crystals
- G09G3/3611—Control of matrices with row and column drivers
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
- Electroluminescent Light Sources (AREA)
- Control Of El Displays (AREA)
- Liquid Crystal Display Device Control (AREA)
Abstract
Segments for a video are transmitted in payload units with a supplemental enhancement information (SEI) message within which is embedded display adaptation information that may be employed to control display brightness and thereby reduce power consumption during display of the respective segment. The display adaptation information includes at least a maximum pixel brightness that may be used to scale pixel brightness to maximum and correspondingly reduce backlighting for liquid crystal displays, or to adjust the supply voltage for OLED displays. The display adaptation information may optionally include a minimum pixel brightness, a pixel histogram step size, and an indicator of scaling method.
Description
Technical field
The disclosure relates generally to reduce energy ezpenditure in mobile radio communication device, and more specifically, relates to the content-based display adaptive control to the video content shown on mobile radio communication device.
Background technology
In recent years, the display resolution of mobile device is significantly improved, wherein, for intelligent telephone set and panel computer, 720p and even higher super liquid crystal display (LCD) or OLED Organic Light Emitting Diode (OLED) display become or will become main flow very soon.But for reproduction (particularly for wherein high-frequency frame buffering and display panel refresh requisite video), so high display resolution needs more energy.
For LCD display, power consumption is the monotonic quantity of backlight illumination level; For OLED display, power consumption is controlled by supply voltage and displaying contents itself.Although achieve brilliance control on some mobile devices, those control generally must (namely before starting to play video) adjustment before issue new task.Such as, brightness can be arranged on 100%, 50% and even 25% before viewing video, but dynamically can not change when not interrupting the broadcasting to video.In addition, because for OLED display, determine power consumption by supply voltage and input picture, so current realization does not provide the mechanism changing (adapt) voltage adaptively.
Therefore, exist in the art for improving mobile device display by making it possible to change LCD display backlight illumination or OLED supply voltage adaptively according to the content that will show thus saving the demand of a large amount of display energy.
Summary of the invention
Therefore, made the present invention to solve the problems referred to above occurred in prior art, and the method that the invention provides for effectively reducing display power and device.
Technical scheme
According to an aspect of the present invention, a kind of method is provided, comprise: the data of receiver, video fragment, the data received comprise Supplemental Enhancement Information (supplemental enhancement information, SEI) message, described SEI message comprises the display adaptive information for changing the one or more display parameter affecting display brightness and power consumption adaptively; And during the display of video segment, change at least one display parameter of display adaptively based on the display adaptive information from SEI message.
According to a further aspect of the invention, a kind of system is provided, it comprises: receiver, be configured to the data of receiver, video fragment, the data received comprise Supplemental Enhancement Information (SEI) message, and described SEI message comprises the display adaptive information for changing the one or more display parameter affecting display brightness and power consumption adaptively; And processor, be configured to during the display of video segment, change at least one display parameter of display based on the display adaptive information from SEI message adaptively.
According to another aspect of the invention, a kind of method is provided, it comprises: the data of format video fragment are for transmission, data through format comprise Supplemental Enhancement Information (SEI) message and comprise one or more PU Payload Units of the data for display video fragment, and described SEI message comprises the display adaptive information for changing the one or more display parameter affecting display brightness and power consumption adaptively.
According to the present invention still on the one hand, a kind of system is provided, it comprises: video server, be configured to the data of format video fragment for transmission, data through format comprise Supplemental Enhancement Information (SEI) message and comprise one or more PU Payload Unit of the data for showing described video segment, and described SEI message comprises the display adaptive information for changing the one or more display parameter affecting display brightness and power consumption adaptively.
According to a further aspect of the present invention, a kind of method is provided, it comprises: the data of receiver, video fragment are for transmission, described data comprise Supplemental Enhancement Information (SEI) message and comprise one or more PU Payload Units of the data for display video fragment, and described SEI message comprises the display adaptive information for changing the one or more display parameter affecting display brightness and power consumption adaptively; And to wanting the equipment sending data of display video fragment thereon.
There is the PU Payload Unit of Supplemental Enhancement Information (SEI) message to send video segment, wherein be embedded in display adaptive information in SEI message, described display adaptive information can be used to during the display of each fragment, control display brightness and reduce power consumption thus.Display adaptive information at least comprises maximum pixel brightness, and it can be used to pixel intensity calibration is maximal value and correspondingly reduces the backlight of liquid crystal display, or the supply voltage of adjustment OLED display.Display adaptive information can comprise the designator of minimum pixel brightness, pixel histogram step-length and calibrating method alternatively.
Before being described in detail below, it can be favourable for setting forth the definition running through some vocabulary and the phrase used in this patent document: term " comprises " and " comprising " and derivative implication thereof are hard-core comprising; Comprising property of term "or", be meant to and/or; Phrase " with ... be associated " and the implication of " associated with it " and derivative thereof can be comprise, be included, with ... interconnect, comprise, be included, be connected to or with ... connect, be couple to or with ... couple, can be with ... communication, collaborative, interweave, side by side, close to, be tied to or with ... bind, have, have ... character etc.; And term " controller " implication is arbitrary equipment, system or their parts of controlling at least one operation, wherein such equipment, system or parts can by the hardware of firmware or software programming in realize.It should be noted that the function be associated with any specific controller can be concentrated or distributed, or in this locality or long-range.Run through the definition that this patent document provides specific vocabulary and phrase, those of ordinary skill in the art are to be understood that, even if be not in most of the cases, be so also in many cases, these definition be also applicable to existing and in the future to these define the use of vocabulary and phrase.
Accompanying drawing explanation
In order to the comprehend disclosure and advantage thereof, now provide the following description carried out by reference to the accompanying drawings, in the accompanying drawings, the parts of same reference marker TYP:
Figure 1A is diagram can realize the under powered network of dynamic, content-based display high-level diagram according to the equipment within it of the one or more embodiment of the disclosure;
Figure 1B be according to a disclosure embodiment from the front view that can realize the wireless device of dynamic, content-based display self-adaptation and corresponding under powered network within it shown in Figure 1A;
Fig. 1 C is the high-level diagram of the functional module of illustrated wireless device in Figure 1B;
Fig. 2 A and 2B illustrates the display self-adaptation of the display adaptive information maintenance brightness be embedded in for dynamic, content-based display self-adaptation and corresponding under powered SEI message according to the utilization of a disclosure embodiment;
Fig. 3 A and 3B illustrates inserting for the SEI message in dynamic, content-based display self-adaptation and corresponding under powered video data bitstream according to a disclosure embodiment;
Fig. 4 is the high-level flow inserting the process of encoded video according to the utilization of a disclosure embodiment for dynamic, content-based display self-adaptation and corresponding under powered SEI message; And
Fig. 5 is the high-level flow based on the video decode of SEI message inserted in order to dynamic, content-based display self-adaptation and corresponding power reduction and the process of display according to a disclosure embodiment.
Embodiment
The various embodiments being used for describing disclosure principle in Fig. 1 to the Fig. 5 below discussed and this patent document are only exemplary, should not make an explanation in any mode limiting disclosure scope.It will be understood by those skilled in the art that and can realize principle of the present disclosure in the wireless communication system of any suitable configuration.
Can be embedded in video flowing as Supplemental Enhancement Information (supplemental enhancement information, SEI) message for showing adaptive metadata.
In the disclosure, by utilizing Supplemental Enhancement Information (SEI) message, display self-adaptation is embedded in video content information, and wherein SEI message is resolved to help to show power reduction in a decoder subsequently.For LCD display, display brightness is adjusted, and for OLED display, display supply voltage is changed adaptively.The element in the SEI message of expansion can be derived at scrambler place during Video coding.
By enabling SEI message (namely, display_adaptation ()) define display self-adaptation, depend on application and the hardware capabilities of lower floor, described SEI message can by frame by frame, one by one picture group (GOP), one by one scene ground so that be inserted in stream to the time interval one by one.Compared with frame rank solution, in message insertion, need less expense based on GOP, scene or the method in the time interval.For not supporting that high frequency shows self-adaptation (such as the video of 30 hertz (Hz), display self-adaptation every 33 milliseconds (ms)) processor, better than the solution based on frame based on GOP, scene or the scheme in the time interval.However, mainly utilize the solution of frame rank to explain this design here.
Figure 1A is diagram can realize dynamic, content-based display self-adaptation and corresponding under powered network high-level diagram according to the equipment within it of the one or more embodiment of the disclosure.Network 100 comprises content encoder data handling system 101, and it comprises according to existing process but with the Coder controller being embedded into the display adaptive information video content in (one or more) NALU head as described in more detail below.Content encoder 101 is couple to communicatedly (or alternatively integrated with it) to subscriber equipment sends the content server data handling system 102 of video content.Content server 102 is coupled by the communication network of such as internet 103 and the wireless communication system that comprises base station (BS) 104, in order to send video content to subscriber equipment 105, wherein subscriber equipment 105 also can be called as subscriber equipment (UE) or movement station (MS).As noted above, subscriber equipment 105 can be " intelligence " telephone set of function or tablet device that can carry out playing video content at least comprising except wireless voice communication.Alternatively, subscriber equipment 105 can be portable computer or has LCD or OLED display and during video playback, benefit from dynamic, content-based display other wireless device under powered, such as at least during the period of typical operation primarily of battery powered any equipment.
Figure 1B is the front view that can realize the wireless device of dynamic, content-based display self-adaptation and corresponding under powered network within it from Fig. 1 according to a disclosure embodiment, and Fig. 1 C is the high level block diagram of the functional module of this wireless device.Subscriber equipment 105 is mobile phone and comprises backlight type LCD (it is included in the optional brightness source described in 1C) or OLED display 106.The processor 107 being couple to display 106 controls the content shown over the display.Other assembly in processor 107 and subscriber equipment 105 is powered by battery (not shown), and battery can be charged by external power source (also not shown), or alternatively can by external power source.The storer 108 being couple to processor 107 can store or buffering video content for being reset by processor 107 and showing on display 106, and the video player application (or " app ") 109 for performing such video playback can be stored.Can via the playback of the transceiver 110 with video content that are connected to antenna 111 side by side (such as, the overlap time on) or before described playback, receive the video content just play.As mentioned above, can in wireless communications from base station 104 receiver, video content.In the exemplary embodiment, the video content for the display in playback wherein and display 106 received by mobile device 105 comprises the display adaptive information be embedded in (one or more) SEI message.Display adaptive information is used for arranging the display control 112 for optional brightness source and display 106 by processor 107.
At International Telecommunications Union (ITU) (ITU) telecommunication standardization part (ITU-T) Video Coding Experts group (VCEG) standard advanced video coding (AVC H.264, be also referred to as mobile motion picture expert group version 4 the 10th part or " MPEG-4 the 10th part ") and its expansion in, each SEI message (one or more) is inserted in useful load bit stream, as described in more detail below.There is the new SEI message of payloadType (PT Payload Type)=47 as shown in Table 1 below.(be in this example, only for illustrative purposes to the selection of payloadType=47; Alternatively can use any previous unspecified payloadType value).In bit stream, run into SEI message, demoder is all resolved this SEI message and is enabled the display self-adaptation of frame rank, GOP rank, scene rank or time interval rank as defined in Table 2 at every turn.
By expansion, the current definition of SEI message is modified to support the embedding to the information that display self-adaptation is correlated with.H.264/AVC and the SEI message (with italic, amendment being shown in Table 1) of expansion of expansion table 1 shows for:
[table 1]
Table 2 shows the display self-adaptation SEI message syntax (with italic, amendment being shown in table 2) H.264/AVC:
[table 2]
| display_adaptation(payloadSize){ | C | Descriptor |
| display_scaling_method | 5 | f(4) |
| distortion_percentage | 5 | f(7) |
| if(display＝scaling_method＝＝BrightNESS_PRESERVED){ | ||
| max_pixel_value | 5 | f(8) |
| }else if(display＝scaling_method＝＝CONTRAST_PRESERVED){ | ||
| max_pixel_value | 5 | f(8) |
| min_pixel_value | 5 | f(8) |
| }else if(display＝scaling_method＝＝PERCEPTUAL_LOSSLESS){ | ||
| pixel_hist_stepsize | 5 | f(8) |
| max_pixel_value | 5 | f(8) |
| min_pixel_value | 5 | f(8) |
| } |
Obviously known from table 2, consider three kinds of dissimilar display self-adaptations (" display_scaling_method (display calibrating method) "): the display self-adaptation (" BRIGHTNESS_PRESERVED (maintenance brightness) ") keeping (preserve) pixel intensity; Keep the display self-adaptation (" CONTRAST_PRESERVED (maintenance contrast) ") of contrast; And the display self-adaptation that sense organ can't harm (" PERCEPTUAL_LOSSLESS (sense organ can't harm) ").Keep the display self-adaptation of brightness using single value as parameter: coding has maximum pixel the brightness value (" max_pixel_value (max pixel value) in the histogram of the pixel brightness value of the reconstructed frame of respective NALU head ").Contrast is kept to show self-adaptation really using the maximum pixel brightness value in the histogram of the pixel brightness value of reconstructed frame and minimum pixel brightness value (" min_pixel_value (minimum pixel value) ") both as parameter.Display self-adaptation harmless on the sense organ of both brightness and contrasts is kept to adopt three parameters: the minimum and maximum pixel brightness value (" max_pixel_value ") in histogram and the step-length (" pixel_hist_stepsize ") of pixel brightness value used when generating histogram.
At (the Joint Collaborative Team on Video Coding of the associating cooperative groups about Video coding of ITU VCEG and International Standards Organization (ISO)/International Electrotechnical Commission (IEC) mobile motion picture expert group version (MPEG), JCT-VC), in standard efficient video coding H.265 (HVEC), SEI and Video Usability Information (VUI) metadata are both allowed.Therefore, it will be appreciated by those skilled in the art that above-mentioned technology uses together with how can being easily suitable for flowing with HVEC.
Fig. 2 A and 2B illustrates the display self-adaptation of the display adaptive information maintenance brightness be embedded in for dynamic, content-based display self-adaptation and corresponding under powered SEI message according to the utilization of a disclosure embodiment.Before each frame of decoding, resolve SEI message to extract the max pixel value being used for pari passu the frame of current reconstruct being amplified (255/max_pixel_value).Make p (i) indicate original brightness as (with raster scan order) i-th pixel value in the histogram of the pixel intensity of reconstructed frame illustrated in Fig. 2 A, then the pixel intensity pnew (i) through calibrating of illustrated this pixel in the frame histogram of calibration is in (for 8 pixel brightness values) Fig. 2 B:
pnew(i)＝p(i)*Y， (1)
Wherein, Y=(255/max_pixel_value) and max_pixel_value is the parameter of specifying in SEI message as above.Obvious known by Fig. 2 A and Fig. 2 B, to be shifted histogram by linear scaled.
Meanwhile, by increasing pixel intensity, less brightness backlights (for LCD display) or lower supply voltage (for OLED display) can be used to the clean minimizing of energy.That is, for LCD display, the pixel intensity through calibrating is adopted together with the backlight illumination reduced.Can arrange through determining target value with ratio (max_pixel_value/255) * 100%.That is, through the backlight illumination bnew of calibration be:
bnew＝b/Y， (2)
Wherein b is initial backlight brightness, and through the supply voltage of calibration is:
Vnew＝V/Y， (3)
Wherein V is original supply voltage.For reducing energy further, max pixel value can also be changed to and allow certain pixel distortion (that is, saturated after calibration), but without the difference on any sense organ, that is,
max_pixel_value＝(1-distortion_percentage)*max_pixel_value (4)
Can parameter min_pixel_value be adopted together with max_pixel_value similarly for the self-adaptation when calibrating with CONTRAST_PRESERVED pattern.Scope between minimum and maximum pixel intensity can be adjusted to keep contrast.Similarly, can together with max_pixel_value operation parameter min_pixel_value and pixel_hist_stepsize, for the self-adaptation when calibrating with CONTRAST_PRESERVED pattern.Scope between minimum and maximum pixel intensity and the distribution of pixel intensity can be adjusted.Although more than suppose the linear scaled of backlight illumination and supply voltage, in practical implementations, calibration can be nonlinear.Linear or nonlinear adjustment can be realized by look-up table, wherein can build look-up table by measuring display power at the varying level place of backlight illumination or supply voltage.
Fig. 3 A and 3B illustrates inserting for the SEI message in dynamic, content-based display self-adaptation and corresponding under powered video data bitstream according to a disclosure embodiment.The SEI message that Fig. 3 A illustrates based on frame is inserted, and the SEI message that Fig. 3 B illustrates based on GOP is inserted.Insert for based on scene or based on the SEI message in the time interval, similar interleaved plan can be adopted.
For the LCD of the backlight of separating of each had in red (R), green (G) and blue (B) Color Channel, pixel intensity as above calibration and backlight illumination reduction can be realized for the pixel of each in RGB color and backlight illumination dividually.Just supply voltage is separately adopted for the red, green and blue LED in OLED display, pixel intensity as above calibration and supply voltage reduction can be realized dividually for each RGB color.Like that, different color component can be changed adaptively individually.
Fig. 4 is the high-level flow inserting the process of encoded video according to the utilization of a disclosure embodiment for dynamic, content-based display self-adaptation and corresponding under powered SEI message.Described process is performed by the Coder controller in scrambler 101.Identical process can be adopted and no matter whether video is shown adaptive equipment, this is because do not support that showing adaptive equipment can ignore the display adaptive information be embedded in SEI message simply by intended for delivery to support for encoded video.Process 400 is started by the pixel data (step 401) of the frame of the video of encoding, GOP, scene or time interval fragment to receive.
For the histogram (step 402) of the video data determination pixel intensity of just processed fragment, describedly determine at least to comprise the determination to max_pixel_value, and also comprise the determination to min_pixel_value and pixel_hist_stepsize alternatively.Fragment for just processed video data generates SEI message (step 403), and described SEI message comprises calibrating method and suitable parameter.SEI message is inserted in the payload stream be associated with respective segments data subsequently, and encoded video data is sent out (step 404).If do not complete Video coding (step 405), then align another iteration being performed described process by the pixel data of the next frame of the video of encoding, GOP, scene or time interval fragment.
Fig. 5 is the high-level flow based on the video decode of SEI message inserted in order to dynamic, content-based display self-adaptation and corresponding power reduction and the process of display according to a disclosure embodiment.Described process is performed by subscriber equipment 105.Process 500 starts with the useful load (step 501) receiving the frame of SEI message and the just decoded video that is associated, GOP, scene or time interval fragment.From SEI message, extract calibrating method and (one or more) parameter (step 502), and change pixel intensity and supply voltage or (for LCD display) adaptively based on calibrating method and (one or more) parameter (for OLED display) and change pixel and backlight illumination (step 503) adaptively.The video content (step 504) showing and decode from the useful load of respective frame, GOP, scene or time interval fragment is set with the display through changing adaptively.If video decode does not complete (step 505), then align another iteration that the next frame of decoded video, GOP, scene or time interval fragment perform described process.
Illustrate the display self-adaptation of the SEI message utilized based on the algorithm keeping brightness in the foregoing disclosure.It is the same with embedded information that such algorithm needs max pixel value to remain.But disclosed principle is not limited to only such realization.In another embodiment, any information derived from video encoder can be embedded into help to show self-adaptation as a part for SEI message, described information such as minimum and maximum pixel brightness value or even histogram distribution.
The disclosure will make the product of such as intelligent telephone set and tablet device and so on more power efficiency while reduction data cost, thus improves the experience that user applies for mobile flow transmission.
Although each process flow that describe in figure and described above and/or burst depict the order of step and/or signal continuously or in tandem, unless but obviously statement or otherwise self evident (such as, signal can not be received before transmission), otherwise should do not inferred from the following: about that order of specific execution sequence, serial but not the execution of step parallel or in an overlapping arrangement or part or the transmission to signal, or the execution of the special step of description or the transmission to signal when there is not intervenient or middle step or signal.And, those skilled in the art will recognize that complete process and signal sequence are not illustrated or describe.As an alternative, for simple and clear for the purpose of, only describe and describe the disclosure unique or understand necessary each the so much process of the disclosure and burst.
Although describe the disclosure with exemplary embodiment, various change and amendment can be advised to those skilled in the art.Disclosure intention comprises the such change and amendment that fall into right.
Claims (17)
1. a method, comprising:
The data of receiver, video fragment, the data received comprise Supplemental Enhancement Information (SEI) message, and described SEI message comprises the display adaptive information for changing the one or more display parameter affecting display brightness and power consumption adaptively; And
During the display of described video segment, change at least one display parameter of display adaptively based on the display adaptive information from described SEI message.
2. the method for claim 1, also comprises:
During being the described video segment of the upper display of backlight liquid crystal displays (LCD), according to pixel intensity and the backlight illumination of the maximum pixel brightness value calibration pixel from described display adaptive information.
3. method as claimed in claim 2, also comprises:
Be described backlight type LCD shows during described video segment, calibrate described pixel intensity and described backlight illumination according to from the maximum pixel brightness value of described display adaptive information and minimum pixel brightness value.
4. method as claimed in claim 3, also comprises:
Be described LCD shows during described video segment, calibrate described pixel intensity and described backlight illumination according to from the maximum pixel brightness value of described display adaptive information, minimum pixel brightness value and pixel histogram step value.
5. the method for claim 1, also comprises:
During being that Organic Light Emitting Diode (OLED) display shows described video segment, according to the maximum pixel brightness value calibration supply voltage from described display adaptive information.
6. a system, comprising:
Receiver, be configured to the data of receiver, video fragment, the data received comprise Supplemental Enhancement Information (SEI) message, and described SEI message comprises the display adaptive information for changing the one or more display parameter affecting display brightness and power consumption adaptively; And
Processor, is configured to during the display of described video segment, changes at least one display parameter of display according to the display adaptive information from described SEI message adaptively.
7. system as claimed in claim 6, wherein, according to the pixel intensity of the maximum pixel brightness value calibration pixel from described display adaptive information and backlight illumination during described processor is configured to be the described video segment of the upper display of backlight liquid crystal displays (LCD).
8. system as claimed in claim 7, wherein, described pixel intensity and described backlight illumination is calibrated according to from the maximum pixel brightness value of described display adaptive information and minimum pixel brightness value during described processor is configured to be that described backlight type LCD shows described video segment.
9. system as claimed in claim 8, wherein, described pixel intensity and described backlight illumination is calibrated according to from the maximum pixel brightness value of described display adaptive information, minimum pixel brightness value and pixel histogram step value during described processor is configured to be that described LCD shows described video segment.
10. system as claimed in claim 6, wherein, according to the maximum pixel brightness value calibration supply voltage from described display adaptive information during described processor is configured to be that Organic Light Emitting Diode (OLED) display shows described video segment.
11. 1 kinds of mobile communication equipments comprising system as claimed in claim 6, wherein, described system is configured in wireless communications from the data of base station receiver, video fragment.
12. 1 kinds of panel computers comprising system as claimed in claim 6, wherein, described system is configured in wireless communications from the data of network reception video segment.
13. 1 kinds of methods, comprising:
The data of format video fragment are for transmission, and the data through format comprise
Supplemental Enhancement Information (SEI) message and comprise one or more PU Payload Unit of the data for showing described video segment, described SEI message comprises the display adaptive information for changing the one or more display parameter affecting display brightness and power consumption adaptively.
14. 1 kinds of systems, comprising:
Video server, the data being configured to format video fragment are for transmission, and the data through format comprise
Supplemental Enhancement Information (SEI) message and comprise one or more PU Payload Unit of the data for showing described video segment, described SEI message comprises the display adaptive information for changing the one or more display parameter affecting display brightness and power consumption adaptively.
15. 1 kinds of methods, comprising:
The data of receiver, video fragment are for transmission, and described data comprise
Supplemental Enhancement Information (SEI) message and comprise one or more PU Payload Unit of the data for showing described video segment, described SEI message comprises the display adaptive information for changing the one or more display parameter affecting display brightness and power consumption adaptively; And
Described data are sent to the equipment that will show described video segment thereon.
16. methods as claimed in claim 11, system as claimed in claim 6, method as claimed in claim 13, system as claimed in claim 14 or method as claimed in claim 15, wherein, what described display adaptive information comprised in maximum pixel brightness value, minimum pixel brightness value and pixel intensity histogram step value is one or more.
17. methods as claimed in claim 11, system as claimed in claim 6, method as claimed in claim 13, system as claimed in claim 14 or method as claimed in claim 15, wherein, described display adaptive information comprises the identifier of the calibrating method that instruction is selected from the calibrating method keeping the calibrating method of brightness, keep the calibrating method of contrast and sense organ can't harm.
Applications Claiming Priority (9)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201261636549P | 2012-04-20 | 2012-04-20 | |
| US201261636543P | 2012-04-20 | 2012-04-20 | |
| US201261636561P | 2012-04-20 | 2012-04-20 | |
| US61/636,543 | 2012-04-20 | ||
| US61/636,549 | 2012-04-20 | ||
| US61/636,561 | 2012-04-20 | ||
| US13/793,576 US20140253601A1 (en) | 2013-03-11 | 2013-03-11 | Display power reduction using sei information |
| US13/793,576 | 2013-03-11 | ||
| PCT/KR2013/003363 WO2013157895A1 (en) | 2012-04-20 | 2013-04-19 | Display power reduction using sei information |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104246866A true CN104246866A (en) | 2014-12-24 |
Family
ID=49383766
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201380020811.1A Pending CN104246866A (en) | 2012-04-20 | 2013-04-19 | Display power reduction using SEI information |
Country Status (4)
| Country | Link |
|---|---|
| EP (1) | EP2839456A4 (en) |
| JP (1) | JP2015520406A (en) |
| CN (1) | CN104246866A (en) |
| WO (1) | WO2013157895A1 (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10165218B2 (en) | 2013-07-24 | 2018-12-25 | Samsung Electronics Co., Ltd. | Display power reduction using histogram metadata |
| US9520079B2 (en) * | 2014-03-26 | 2016-12-13 | Samsung Electronics Co., Ltd. | Storage and carriage of green metadata for display adaptation |
| WO2016200576A1 (en) * | 2015-06-09 | 2016-12-15 | Technicolor Usa, Inc. | Method, appartus and system for the rendering of content |
| KR102286130B1 (en) | 2016-05-25 | 2021-08-06 | 한국전자통신연구원 | Method and system for providing video |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006033953A1 (en) * | 2004-09-16 | 2006-03-30 | Thomson Licensing | Video codec with weighted prediction utilizing local brightness variation |
| WO2007043746A1 (en) * | 2005-10-11 | 2007-04-19 | Samsung Electronics Co., Ltd. | Method and apparatus for encoding multimedia contents and method and system for applying encoded multimedia contents |
| CN101779230A (en) * | 2007-06-26 | 2010-07-14 | 苹果公司 | Dynamic backlight is adaptive |
| CN101952892A (en) * | 2008-01-31 | 2011-01-19 | 汤姆森许可贸易公司 | Method and system for look data definition and transmission |
| CN102017651A (en) * | 2008-04-21 | 2011-04-13 | 三星电子株式会社 | Apparatus and method for composing scenes using rich media contents |
| CN102026010A (en) * | 2009-09-17 | 2011-04-20 | 索尼公司 | Image signal processing device, image signal processing method, image signal processing program, image signal processing system and transmitting device |
| US20110299604A1 (en) * | 2010-06-04 | 2011-12-08 | Apple Inc. | Method and apparatus for adaptive video sharpening |
| US8144186B2 (en) * | 2007-03-09 | 2012-03-27 | Polycom, Inc. | Appearance matching for videoconferencing |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7873229B2 (en) * | 2006-02-08 | 2011-01-18 | Moxair, Inc. | Distributed processing for video enhancement and display power management |
| WO2009126124A1 (en) * | 2008-04-09 | 2009-10-15 | Moxair, Inc. | Dynamic backlight control for video displays |
| US20090226152A1 (en) * | 2008-03-10 | 2009-09-10 | Hanes Brett E | Method for media playback optimization |
| EP2378508A1 (en) * | 2010-04-15 | 2011-10-19 | Koninklijke Philips Electronics N.V. | Display control for multi-primary display |
-
2013
- 2013-04-19 EP EP13778254.6A patent/EP2839456A4/en not_active Withdrawn
- 2013-04-19 WO PCT/KR2013/003363 patent/WO2013157895A1/en active Application Filing
- 2013-04-19 CN CN201380020811.1A patent/CN104246866A/en active Pending
- 2013-04-19 JP JP2015506908A patent/JP2015520406A/en not_active Withdrawn
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006033953A1 (en) * | 2004-09-16 | 2006-03-30 | Thomson Licensing | Video codec with weighted prediction utilizing local brightness variation |
| WO2007043746A1 (en) * | 2005-10-11 | 2007-04-19 | Samsung Electronics Co., Ltd. | Method and apparatus for encoding multimedia contents and method and system for applying encoded multimedia contents |
| US8144186B2 (en) * | 2007-03-09 | 2012-03-27 | Polycom, Inc. | Appearance matching for videoconferencing |
| CN101779230A (en) * | 2007-06-26 | 2010-07-14 | 苹果公司 | Dynamic backlight is adaptive |
| CN101952892A (en) * | 2008-01-31 | 2011-01-19 | 汤姆森许可贸易公司 | Method and system for look data definition and transmission |
| CN102017651A (en) * | 2008-04-21 | 2011-04-13 | 三星电子株式会社 | Apparatus and method for composing scenes using rich media contents |
| CN102026010A (en) * | 2009-09-17 | 2011-04-20 | 索尼公司 | Image signal processing device, image signal processing method, image signal processing program, image signal processing system and transmitting device |
| US20110299604A1 (en) * | 2010-06-04 | 2011-12-08 | Apple Inc. | Method and apparatus for adaptive video sharpening |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2013157895A1 (en) | 2013-10-24 |
| EP2839456A4 (en) | 2016-02-24 |
| EP2839456A1 (en) | 2015-02-25 |
| JP2015520406A (en) | 2015-07-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20130278834A1 (en) | Display power reduction using extended nal unit header information | |
| KR102516828B1 (en) | Image processing apparatus, mage processing method and multi-screen display | |
| US10356444B2 (en) | Method and apparatus for encoding and decoding high dynamic range (HDR) videos | |
| EP3025213B1 (en) | Display power reduction using histogram metadata | |
| US20210110777A1 (en) | Light source control for displaying video | |
| RU2667083C1 (en) | Transmission device, transmission method, reception device and reception method | |
| US20140253601A1 (en) | Display power reduction using sei information | |
| JP2017204864A (en) | Display apparatus and methods | |
| KR20170115528A (en) | Method and device for mapping an HDR image to an SDR image and corresponding SDR to HDR mapping method and device | |
| EP3051486A1 (en) | Method and apparatus for encoding and decoding high dynamic range (HDR) videos | |
| CN106416261A (en) | Transmission device, transmission method, reception device, and reception method | |
| KR20150002440A (en) | A image processing device and a image processing method | |
| CN104246866A (en) | Display power reduction using SEI information | |
| Fernandes et al. | The green metadata standard for energy-efficient video consumption | |
| CN104754332A (en) | Smart wearing device video image transmitting method | |
| KR102622736B1 (en) | Display apparatus and controlling method thereof | |
| Chen et al. | VCAS: Viewing context aware power-efficient mobile video embedded memory | |
| EP3657770A1 (en) | Method for generating a bitstream relative to image/video signal, bitstream carrying specific information data and method for obtaining such specific information | |
| US11783771B2 (en) | Display apparatus and method for controlling same | |
| US20200294454A1 (en) | Image processing apparatus, image processing method, transmission apparatus, transmission method, and reception apparatus | |
| Léonce et al. | An intelligent high dynamic range video codec for handheld devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20141224 |