WO2012172460A1 - Graphics processing for high dynamic range video - Google Patents

Graphics processing for high dynamic range video Download PDF

Info

Publication number
WO2012172460A1
WO2012172460A1 PCT/IB2012/052873 IB2012052873W WO2012172460A1 WO 2012172460 A1 WO2012172460 A1 WO 2012172460A1 IB 2012052873 W IB2012052873 W IB 2012052873W WO 2012172460 A1 WO2012172460 A1 WO 2012172460A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
hdr
processing
graphics
display mode
Prior art date
Application number
PCT/IB2012/052873
Other languages
French (fr)
Inventor
Philip Steven Newton
Wiebe De Haan
Charles Leonardus Cornelius Maria KNIBBELER
Original Assignee
Koninklijke Philips Electronics N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics N.V. filed Critical Koninklijke Philips Electronics N.V.
Priority to CN201280029106.3A priority Critical patent/CN103597812B/en
Priority to US14/125,319 priority patent/US9443495B2/en
Priority to BR112013031870-8A priority patent/BR112013031870B1/en
Priority to EP12730652.0A priority patent/EP2721811B1/en
Priority to JP2014515315A priority patent/JP6053767B2/en
Priority to RU2014100893/07A priority patent/RU2605435C2/en
Priority to PL12730652T priority patent/PL2721811T3/en
Priority to ES12730652T priority patent/ES2774219T3/en
Priority to MX2013014545A priority patent/MX340266B/en
Publication of WO2012172460A1 publication Critical patent/WO2012172460A1/en

Links

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/37—Details of the operation on graphic patterns
    • G09G5/377—Details of the operation on graphic patterns for mixing or overlaying two or more graphic patterns
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/445—Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G11B27/30—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on the same track as the main recording
    • G11B27/3027—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on the same track as the main recording used signal is digitally coded
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G11B27/30—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on the same track as the main recording
    • G11B27/309—Table of contents
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G11B27/32—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier
    • G11B27/327—Table of contents
    • G11B27/329—Table of contents on a disc [VTOC]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H04N21/42653—Internal components of the client ; Characteristics thereof for processing graphics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/432—Content retrieval operation from a local storage medium, e.g. hard-disk
    • H04N21/4325—Content retrieval operation from a local storage medium, e.g. hard-disk by playing back content from the storage medium
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • H04N21/43632—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wired protocol, e.g. IEEE 1394
    • H04N21/43635—HDMI
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H04N21/4854—End-user interface for client configuration for modifying image parameters, e.g. image brightness, contrast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H04N21/42646—Internal components of the client ; Characteristics thereof for reading from or writing on a non-volatile solid state storage medium, e.g. DVD, CD-ROM

Definitions

  • the invention relates to a device for processing video information, the device comprising an input unit for receiving the video information, the video information comprising low dynamic range [LDR] video data and/or high dynamic range [HDR] video data, and a video processor for generating a display signal by processing the video data for display in a specific display mode being any one of a LDR display mode and a HDR display mode, and processing graphics data for generating an overlay for overlaying the video data.
  • LDR low dynamic range
  • HDR high dynamic range
  • the invention further relates to a video signal for transferring video information, and a device for generating video information, a method for processing video information and a method for generating video information.
  • the invention relates to the field of displaying video information on a high dynamic range [HDR] display.
  • Display units are currently being developed that are able to provide a high brightness level and a very high contrast between dark parts of the image and bright parts of the image.
  • video information may be enhanced by providing adapted video information, e.g. having a higher resolution taking into account the higher brightness and the HDR contrast range.
  • the traditional video information is called low dynamic range [LDR] video in this document.
  • LDR video information may be displayed on a HDR display unit in HDR display mode for improved contrast.
  • a more compelling image is achieved when the video information itself is generated in a HDR video format, e.g.
  • movie directors can locally enhance the experience, by e.g. emphasizing explosions, and/or improve visibility in bright or dark scenes/areas.
  • Graphical data such as pop-up menus or subtitles, may be included in video information for overlaying.
  • the video processing device may be a Blu-ray Disc player and may be coupled to a display device like a HDR enabled TV set or monitor via a suitable interface, preferably a high-speed digital interface like HDMI.
  • the HDR display may also be integrated with the video processing device.
  • the document US2004/0067041 describes a recording medium having a data structure for managing reproduction of graphic data and recording and reproducing methods and apparatuses.
  • the recording medium includes a graphic information area having at least one graphic image information segment and at least one palette information segment recorded therein.
  • Each palette information segment provides color information.
  • Each graphic image information segment provides reproduction information for reproducing one or more graphic images.
  • Multiple color palettes are proposed, each palette corresponding to a different color depth of the main video that is between 8 bits and 24 bits.
  • the proposed data structure for graphical data in US2004/0067041 enables one of different color palettes to be used, the different palettes corresponding to different resolutions of the graphical data.
  • Different graphical images may be simultaneously overlaid on main video, the different graphical images having different sizes and color depths.
  • a respective palette must be included for displaying graphical images at a specific color depth.
  • the actual color depth may be determined in a reproducing device depending on the degree of importance and size of the graphical image.
  • the known graphical data structure has the problem that, when a preferred display mode in a reproducing device varies, the different palettes and sizes of the graphical data structure result in a predefined and fixed generation of an overlay based on the graphical images using the predefined palettes.
  • the input unit is constituted for receiving graphics processing control data comprised in the video information, the graphics processing control data including at least one HDR processing instruction for overlaying the graphics data in the HDR display mode, and the video processor is constituted for adapting the processing when overlaying the graphics data in dependence on the specific display mode and the HDR processing instruction.
  • HDR video or images is encoded, that can be done in different ways. E.g., one may use a 12 or 16 bit word for the luma of the pixel colors, and use a faint non-linearity for encoding the wide range of luminances in a scene.
  • any graphics like subtitles may be encoded in such a way that if one were to immediately without further optimizing use a graphics pixel code (e.g. some value which is "graphics white”), then depending on the actual display at the rendering, and viewing environment etc., but potentially also on a class of the graphics like e.g. its size or position on the screen, that white may be perceived as being e.g. too bright or too dim.
  • a graphics pixel code e.g. some value which is "graphics white”
  • one may optimally tune graphics (which usually are perceived as LDR, but in the end are also HDR, at least when coordinated by showing together on an HDR picture), whether it has to be upwards for some configurations like the display used for rendering, or downwards for other configurations, and in whichever of the different ways the (HDR) image(s) and graphics are encoded.
  • Control information allows the receiving display to be steered as one of the types foreseen by the creation side, or to determine by itself which of the offered co-rendering options of the video/image and graphics is optimal.
  • the video signal is for transferring video information to the video processing device, the video information comprising low dynamic range [LDR] video data and/or high dynamic range [HDR] video data, the video signal comprising graphics processing control data comprised in the video information, the graphics processing control data including at least one HDR processing instruction for overlaying the graphics data in the HDR display mode for adapting the processing when overlaying the graphics data in dependence on the specific display mode and the HDR processing instruction.
  • the video information comprising low dynamic range [LDR] video data and/or high dynamic range [HDR] video data
  • the video signal comprising graphics processing control data comprised in the video information
  • the graphics processing control data including at least one HDR processing instruction for overlaying the graphics data in the HDR display mode for adapting the processing when overlaying the graphics data in dependence on the specific display mode and the HDR processing instruction.
  • an optical record carrier comprises a track of optically readable marks, wherein the marks represent the above video signal.
  • a device for generating video information comprises an output unit for transferring video information to a video processing device, the video information comprising low dynamic range [LDR] video data and/or high dynamic range [HDR] video data, the video processing device being arranged for generating a display signal by processing the video data for display in a specific display mode being any one of a LDR display mode and a HDR display mode, and processing graphics data for generating an overlay for overlaying the video data, and a video processor for generating the video information including graphics processing control data, the graphics processing control data including at least one HDR processing instruction for overlaying the graphics data in the HDR display mode for, in the video processing device, adapting the processing when overlaying the graphics data in dependence on the specific display mode and the HDR processing instruction.
  • LDR low dynamic range
  • HDR high dynamic range
  • a method of processing the video information comprises processing the video data for display in a specific display mode being any one of a LDR display mode and a HDR display mode, and processing graphics data for generating an overlay for overlaying the video data, and receiving graphics processing control data comprised in the video information, the graphics processing control data including at least one HDR processing instruction for overlaying the graphics data in the HDR display mode, and adapting the processing when overlaying the graphics data in dependence on the specific display mode and the HDR processing instruction.
  • a method of generating the video information comprises generating graphics processing control data, the graphics processing control data including at least one HDR processing instruction for overlaying the graphics data in the HDR display mode for, in the video processing device, adapting the processing when overlaying the graphics data in dependence on the specific display mode and the HDR processing instruction, and including the graphics processing control data in the video information.
  • a computer program product for processing video information is operative to cause a processor to perform the methods as defined above.
  • the graphics processing control data comprises HDR processing instructions for overlaying the graphics data, such as graphical commands or settings to be applied for adapting the processing in HDR mode for generating the overlay or for adapting the processing of the main video.
  • the graphical instructions define the processing to be applied when the specific display is the HDR display mode.
  • the video processor is arranged for adapting the processing of the graphics data and/or the video data when overlaying the graphics data.
  • the measures have the effect that the adapting of the processing of the graphics data and/or the video data is controlled depending on the specific display mode as determined in the video processing device according to said respective HDR processing instruction included in the graphics processing control data.
  • the graphics processing control data defines and controls the actual processing operations performed in a reproducing device, because the respective HDR processing instruction is provided at the source of the video information.
  • the author of the video information is enabled to control the displaying of the graphics data when a display is generated in HDR display mode. For example, the effort of making separate graphic assets for displaying video in either LDR mode or HDR mode may be avoided, because a single set of graphic assets can be used by suitably adapting the processing at the receiving side under the control of the authoring side.
  • the invention is also based on the following recognition. While extending the existing video systems for HDR the high contrast ratio available in advanced display devices is used to achieve vivid and realistic video images. However, the inventors have seen that, when overlaying graphics in such a HDR display mode, several problems may occur. For example, a problem that can occur with (semi-transparent) graphics overlays on top of HDR video is that some scenes in HDR video can be exceptionally bright. This will significantly reduce the legibility of the graphics such as subtitles or menu's shown at the same time. Another problem that can occur is that the characters in the subtitles might become so bright that it becomes annoying or fatiguing for the reader. Also extreme bright subtitles or menus may cause halo effects or glare and thus degrade the perceived quality of the video. The inventors have addressed such problems by providing said HDR processing instructions in the video information, which can be handled by novel video processing devices, which process the incoming video by decoding the main video and then overlay the graphics data as instructed by said HDR processing instructions.
  • the video information comprises segments defining parameters for generating the overlay, the segments having respective segment types, the segments comprising a HDR processing definition segment of a HDR processing definition type for constituting the graphics processing control data, and the video processor is arranged for adapting the processing according to the HDR processing instruction from the HDR processing definition segment.
  • the format of the video information is extended using segments that define video parameters, which segments may also be used for other decoding information.
  • the graphics data comprises LDR palette information defining at least one LDR color palette and HDR palette information defining at least one HDR color palette and the graphics processing control data comprises a palette selection instruction for selecting the HDR palette, and the video processor is arranged for selecting the HDR color palette in the HDR display mode in dependence on the palette selection instruction.
  • the video data comprises both an LDR color palette and a HDR color palette, and the palette selection instruction enable selecting a respective palette in the HDR display mode.
  • the graphics processing control data comprises a transparency instruction defining a reduction of transparency with respect to the transparency in LDR display mode
  • the video processor is arranged for adapting transparency of the graphics data in the overlay in the HDR display mode in dependence on the transparency instruction.
  • the transparency of the graphics data may be adjusted to the respective HDR video scene.
  • the graphics processing control data comprises a video switch instruction defining whether to switch the processing of the video data to LDR display mode while the specific display mode is the HDR display mode, and the video processor is arranged for switching the video data to LDR display mode while overlaying the video data when the specific display mode is the HDR display mode in dependence on the video switch instruction, or the graphics processing control data comprises a graphics selection instruction defining whether to retrieve a stream of HDR graphics data while the specific display mode is the HDR display mode, and the video processor is arranged for using the HDR graphics data while overlaying the video data when the specific display mode is the HDR display mode in dependence on the graphics selection instruction.
  • the video display may be temporarily switched to LDR mode while overlaying the graphics data, or the graphics processing may be set to use a dedicated HDR graphics stream.
  • the graphics processing control data comprises a luminance instruction defining a reduction of luminance with respect to the luminance in LDR display mode
  • the video processor is arranged for defining luminance of the graphics data in the overlay in the HDR display mode in dependence on the luminance instruction.
  • the luminance of the graphics data may be adjusted to be convenient when displayed in HDR display mode.
  • the graphics processing control data comprises a pop-up process descriptor defining a HDR processing instruction when overlaying pop-up graphic data in the HDR display mode.
  • the processing is adapted when the device is activated to display a pop-up, e.g. a menu or button, according to the respective HDR processing instruction.
  • the graphics processing control data comprises a subtitle process descriptor defining a HDR processing instruction when overlaying subtitle graphic data in the HDR display mode.
  • the processing is adapted when the device is activated to display a subtitle, according to the respective HDR processing instruction. Hence specific processing is active when displaying subtitles in HDR mode.
  • the video processor is arranged for setting the specific display mode in dependence of display capability information acquired from a display device connected to receive the display signal.
  • the video processor is arranged for setting the specific display mode in dependence of display mode information received from a display device connected to receive the display signal.
  • the processing may be adapted automatically to the respective display mode.
  • the video processor is arranged for setting the specific display mode in dependence of dynamic range information included in the video information, indicative of a dynamic range of the video information.
  • the processing may be adapted automatically to the received video information.
  • the video processor is arranged for setting the specific display mode in dependence of a display mode preference based on a user setting.
  • the processing may be adapted to the respective display mode according to the user setting.
  • Figure 1 shows a system for transferring video information
  • Figure 2 shows a video processing system in a receiving device
  • Figure 3 shows a BD data stream with graphics
  • Figure 4 shows types of segments
  • Figure 5 shows graphics processing control data
  • Figure 6 shows HDR graphics processing instructions for pop-up graphics
  • Figure 7 shows HDR graphics processing instructions for subtitle graphics
  • Figure 8 shows HDR graphics processing instructions for an input stream of video information with only LDR video data
  • Figure 9 shows video processing controlled via graphics processing control data and the display mode for an input stream of video information with only LDR video data
  • Figure 10 shows video processing controlled via graphics processing control data and the display mode for an input stream of video information with LDR and HDR video data.
  • High Dynamic Range (HDR) displays can provide a much higher light output and contrast between black and white than regular displays.
  • Such displays may have a matrix of high efficiency LED's in the backlight that provide the display with a dynamic range of 40.000: 1 and more.
  • Such a large dynamic range in combination with a high (local) light output greatly increases the realism of the images shown on the display.
  • the content must also support enough fidelity and resolution in luminance and color.
  • A/V content Distribution of audio video (A/V) content is described in several standards, such as for example DVB for broadcasting and Blu-ray Disc or DVD for packaged media.
  • the digital video content transmitted using these standards is sampled as YUV 4:2:0 or better YUV 4:2:2 and encoded using standards from the MPEG group. After transmission the content is decoded and played back on a device that implements the related standards such as a Blu-ray Disc player. The decoded content is then transmitted to a display using a suitable interface.
  • Video encoded according to the traditional standards is called low dynamic range (LDR) video in this document.
  • LDR low dynamic range
  • the standards may be extended to support HDR video.
  • the Blu-ray Disc (BD) standard supports graphics overlays for subtitles, full screen menus, animations and pop-up graphics.
  • BD players typically feature On Screen Display (OSD) menus.
  • OSD On Screen Display
  • graphics information may also be generated locally.
  • Several issues are addressed related to overlay of graphics on top of video background on a HDR display. For example a problem that can occur is that the characters in the subtitles might become so bright that it becomes annoying or fatiguing for the reader.
  • Another problem that can occur with (semi-transparent) graphics overlays on top of HDR video is that some scenes in HDR video can be exceptionally bright. This will significantly reduce the legibility of the graphics such as subtitles or menus shown at the same time.
  • - extreme bright subtitles or pop-up menus can have a negative effect on the perceived quality of the video. This can be caused by a halo effect or by glare;
  • the required graphics processing in case of displaying on a HDR display may differ for different types of graphics content, for example menus and subtitles.
  • FIG. 1 shows a system for transferring video information.
  • the system has a video source 100, which provides a video transfer signal 104 to be transferred to a video processing device 110 via a transfer medium 130, e.g. an optical disc 140, the internet or a broadcast network.
  • the processing device constitutes a receiver, which receives a video signal 111 from the recording medium or broadcast in an input unit 112.
  • the receiver provides a display signal 114 to a HDR display device 120, for example a HDMI signal to TV or projection system capable of displaying video in a high dynamic range (HDR) display mode.
  • the receiver may be connected to an LDR display device (not shown) and may then generate an LDR display signal.
  • LDR display device not shown
  • the receiver may be a separate device like a Blu-ray Disc (BD) player, or a set top box (STB) or satellite receiver.
  • the receiver 110 and the HDR display 120 are combined in a single device, like a digital HDR TV having a digital tuner and a video processor build in.
  • the system is arranged for transferring the video information in multiple data streams multiplexed in a video transfer signal, e.g. according to a video format known as such.
  • the video information includes low dynamic range [LDR] video data and/or high dynamic range [HDR] video data, and may also include graphics data, like subtitles or menus.
  • the HDR video data is provided on main input 101 of video source device 100.
  • the graphics data may be provided on auxiliary input 102 of video source 100, and is arranged for display in an overlay on the main video data, such as subtitles. It is noted that multiple streams of graphic data may be included.
  • Further graphics data like pop-up menus may be encoded in a separate graphics stream, usually separately transferred outside the multiplexed real-time video data streams (so-called out-of-mux), to enable preloading and activating at any time.
  • additional graphic data may be generated downstream, e.g. menus generated at the receiving side in the receiver 110.
  • the system accommodates the functions for including, in the video transfer signal, graphic processing control data as described below.
  • the graphics processing control data includes at least one HDR processing instruction for overlaying the graphics data in the HDR display mode.
  • the functions may be implemented in a video processor 103 in the source device, but may also be performed in an authoring system based on dedicated computer programs, in a broadcasting studio, etc.
  • the main video is processed by arranging the HDR video data according to a video transmission format.
  • the system provides control data for indicating parameters to a receiver for enabling the receiver to reproduce the main video data and overlaying the graphics data.
  • a data transport stream in the video transfer signal 104 is assembled as described above, including the graphic processing control data as described in detail below, for transmission via the transfer medium 130.
  • the video transfer signal 104 for transferring the HDR video information and the graphic processing control data is transferred via the transfer medium 130, e.g. an optical disc 140 like BD, a public TV transmission network, a satellite network, internet, etc.
  • a transport stream represents the HDR video information.
  • a video information transfer platform is Digital Video Broadcast (DVB).
  • DVB applies various standards for terrestrial, cable, satellite and mobile for transport and associated signaling of audio/video, graphics (subtitles etc) and interactive applications (Java applications or HTML XML). Current advances in display technology are making it possible to introduce HDR video for a mass market audience. Therefore to enable widespread distribution of HDR content the DVB standards may be extended to allow broadcast of HDR content.
  • Further transfer media include the BD optical disc, the internet, etc, and the respective video formats may also be adapted for HDR video.
  • video formats may be enhanced by defining the video transfer signal to include the proposed graphic processing control data.
  • the video information may be further arranged for displaying three dimensional (3D) video data, optionally in combination with the HDR enhanced video information.
  • the receiver 110 has the input unit 112 for receiving the video signal 111, i.e. the video transfer signal 104 after transferring via the transfer medium 130 as described above.
  • the video information and the graphic processing control data are retrieved and coupled to a video processor 113.
  • the video processor has a signal processing structure for generating a display signal 114 by processing the video data for display in a specific display mode being any one of a LDR display mode and a HDR display mode, and processing graphics data for generating an overlay for overlaying the video data.
  • the video processor adapts the processing when overlaying the graphics data in dependence on the specific display mode and the HDR processing instruction, as elucidated below in detail.
  • the source device 100 is for generating video information, and the device has an output unit 105 for transferring video information to the video processing device 110.
  • the source device has a video processor 103 for generating the video information including the graphics processing control data, the graphics processing control data including at least one HDR processing instruction for overlaying the graphics data in the HDR display mode for, in the video processing device, adapting the processing when overlaying the graphics data in dependence on the specific display mode and the HDR processing instruction.
  • the video signal 111 is for transferring video information to a video processing device, the video processing device being arranged for generating a display signal by processing the video data for display in a specific display mode being any one of a LDR display mode and a HDR display mode, and processing graphics data for generating an overlay for overlaying the video data.
  • the video signal includes the graphics processing control data in the video information.
  • the graphics processing control data has at least one HDR processing instruction for overlaying the graphics data in the HDR display mode for adapting the processing when overlaying the graphics data in dependence on the specific display mode and the HDR processing instruction.
  • the video signal is provided on an optical record carrier 140, for example a DVD or BD.
  • the optical record carrier has a track of optically readable marks, wherein the marks represent the video signal as described above.
  • a practical example of the specific video format used to store the video information including the graphic processing control data based on BD is described below.
  • FIG. 2 shows a video processing system in a receiving device.
  • the device may for example be a BD player, digital TV set or a set top box.
  • An input unit 201 comprises a demodulator for retrieving the video information from the video signal.
  • the input unit may also include an optical record carrier unit for retrieving the video information from an optical record carrier.
  • the demodulator retrieves the transport stream from the video signal, which transport stream is coupled to a de-multiplexer unit 202, which also may include a descrambler, for retrieving the various data streams and control data from the transport stream.
  • the data streams are coupled to a main decoder 203 for decoding the video and audio data, and to an auxiliary decoder 204 for decoding graphics data and control data.
  • the decoders and further elements are coupled via a system bus 209 to a central processing unit (CPU), a graphics processor 206, a memory 207, and an output stage 208 for generating the display signal, for example according to HDMI.
  • processing pipeline of video and subtitles are different and separate. Processing and high bandwidth operations such as A/V decoding and graphics processing (filter operations etc.) is done in a dedicated ASIC whilst processing of low bandwidth information such as the subtitles is done by a low power general purpose processer. The subtitles and the video are not combined until at the very end of the processing pipeline.
  • the video information is discussed according to the Blu-ray disc format. It is to be noted that the BD format is a practical example, and that similar graphic processing control data may be included in any other suitable video format.
  • FIG. 3 shows a BD data stream with graphics.
  • the Blu-ray Disc data stream comprises a transport stream 31 having transport packets 34.
  • a subset of the packets 34 may have the same packet identifier PID and then forms a dedicated stream of elementary packets (PES), said PES Packets constituting a Graphics Elementary Stream 32.
  • Segments 33 are data structures that are embedded in the stream of PES packets. Further information on the BD system can be found in US applications US2006580647 and US20090103895 and the BD- ROM A/V White Paper l 00604(1)- 15916 available from the Blu-ray Disc Association .
  • the documents describe how streams are processed in a Blu-ray Disc player and how video is combined with synchronized graphics and audio data to create a compelling movie experience.
  • the audio and graphics data may be embedded into the main transport stream or may be embedded into another auxiliary transport stream that contains data that may be presented in sync with the content of the main transport stream dependent on input from the user.
  • a playlist may be defined with multiple subtitle streams for different languages.
  • the Blu-ray Disc graphics segment consists of a segment descriptor and the segment data.
  • the segment descriptor contains the type of the segment and the length.
  • a Presentation Graphics or Interactive Graphics or Text subtitle stream on a HDR enabled disc additionally contains an HDR Processing definition segment.
  • This segment defines the way the decoder processes Presentation Graphics or Text subtitle graphics in High Definition Movie (HDMV) mode and/or BD Java (BD-J) mode and Interactive Graphics (HDMV mode) in case of HDR Video.
  • the HDR Processing definition segment may contain for every palette definition segment in the stream also a new
  • the composition buffers for the HDMV Presentation Graphics decoder, the HDMV Interactive Graphics decoder and the HDMV Text subtitle decoder in the BD graphics decoder model is extended to be able to store the palette data for both the LDR and the HDR presentation.
  • the graphics decoder model checks the display mode through a new register or newly defined (initially reserved) register bits that indicates the LDR/HDR playback mode.
  • the graphics decoder model processes the graphics as defined in
  • the graphics decoder model may ignore the standard palette definition and instead load the new HDR palette definition from the composition buffer into the CLUT (Color Lookup Table). When switching back to LDR mode the standard palette definition segment is loaded into the CLUT from the composition buffer and the HDR palette is ignored.
  • CLUT Color Lookup Table
  • Other algorithms for graphics processing may also be defined in the HDR Processing definition segment.
  • a set of two different graphics streams is defined.
  • One graphics stream is provided for LDR and the other one has at least substantially the same contents but is adapted for HDR.
  • a HDR graphics indication may be provided in an attribute of the graphics stream.
  • a linking mechanism between the LDR graphics stream and the corresponding HDR graphics stream may be provided to indicate which graphics stream is the HDR graphics stream corresponding to a particular LDR graphics stream, for example a pointer.
  • the HDR version indication may be included in extension data of e.g. a PlayList file and may contain a link to the corresponding LDR version. Hence the reproducing device is enabled to select the respective one of both streams.
  • the graphics processing control data may comprise a graphics selection instruction defining whether to retrieve a stream of HDR graphics data while the specific display mode is the HDR display mode, and the video processor is arranged for using the HDR graphics data while overlaying the video data when the specific display mode is the HDR display mode in dependence on the graphics selection instruction.
  • Figure 4 shows types of segments.
  • Various types of segment such as Palette Definition Segment, Object Definition Segment, etc, are defined in the Blu-ray Disc standard, where value 0x83 to OxFF are reserved.
  • the table comprises a new segment type 41 with for example value 0x83 that indicates a segment that contains the HDR Processing definition segment.
  • the HDR Processing definition segment contains parameters and/or instructions that affect the way the graphics decoder processes the graphics in HDR display mode. So in the event that the display mode is HDR the parameters and/or instructions modify the result of the regular processing.
  • Figure 5 shows graphics processing control data.
  • the table shows an example of how the structure of the HDR Processing definition segment may look like.
  • HDR Processing definition segment contains two processing
  • the segment may also contain HDR palettes 53 to be used when display mode is HDR.
  • the original palettes (now called LDR palettes) are provided in other segments as defined in the BD standard.
  • the HDR palette contains the same number of entries as the original LDR palette but the entries are adapted to HDR display mode such that • the Y, Cr and Cb values in the palette have the same color matrix as the associated HDR video stream.
  • Y, Cr, Cb, and T are adapted to reduce the problems when combining graphics in HDR display mode.
  • Figure 6 shows HDR graphics processing instructions for pop-up graphics.
  • the instruction Pop-up_process_descriptor specifies the extra processing of the graphics in the case of pop-up graphics in combination with HDR video.
  • this parameter can have the following values:
  • Pop-up_process_descriptor 0x00 is an instruction which instructs that the graphics processing for HDR video is equal to processing for LDR video;
  • Pop-up_process_descriptor 0x01 to 0x09 are transparency instructions 61, which instruct that the transparency is to be reduced to a specific percentage of LDR transparency value;
  • Pop-up_process_descriptor OxOA is a video switch instruction 62, and instructs the player to switch to LBR video when pop-up graphics is activated and to switch back to HDR when pop-up graphics is de-activated;
  • Pop-up_process_descriptor 0x0B2 is a HDR instruction 63 that instructs the graphics processor to use the HDR palettes.
  • the player simply responds to the pre-defined PopUp On() and PopUp Off() User Operations and an optional preference setting in a to be defined field of a Player status register (PSR).
  • PSR Player status register
  • the preference could be set through a value in the Playlist for the title and indicate that video should switch back to LDR when a pop-up menu is shown. If the preference is set to switch back to LDR, the player will automatically switch to LDR when the PopUp On() User Operation is activated, and switch back to HDR when the PopUp Off() is activated.
  • BD-J mode the same kind of behavior can be achieved by having the BD-J program respond to VK POPUP MENU BD-J Events and appropriately control the video steam selection and playback.
  • FIG. 7 shows HDR graphics processing instructions for subtitle graphics (e.g. Presentation Graphics or Text subtitles).
  • the instruction Subtitle_process_descriptor specifies the extra processing of the graphics in the case of subtitle graphics in combination with HDR video.
  • this parameter can have the following values:
  • Subtitle_process_descriptor 0x00 is an instruction which instructs that the graphics processing in HDR video is equal to the LDR mode;
  • Subtitle_process_descriptor 0x01 to 0x09 are luminance instructions 71, which instruct that the the luma value is to be reduced to a specific percentage of LDR luma value (the luma value is representing the luminance, usually denoted as Y);
  • Subtitle_process_descriptor OxOA is a HDR instruction that instructs the graphics processor to use the HDR palettes.
  • HDR graphics processing instructions for pop-up graphics and/or for subtitle graphics may further include the graphics selection instruction as described above.
  • the HDR graphics processing instructions may further include instructions to change the position of the graphics and/or the video on the screen.
  • the overlap of graphics and very bright areas of the video may be avoided by changing at least one of said positions.
  • the video can be moved up and the subtitles can be positioned in the black bar below the video.
  • the display mode may be determined based on the capabilities of the display device coupled to the video processing device, e.g. via a HDMI signal.
  • user settings in the display device for selecting the display mode may be communicated to the processing device.
  • HDMI provides for communication (such as EDID or Display Port) of display capabilities of the sink device to the source device, e.g. an indication of 1 bit defining that HDR is supported.
  • a BD player may use this indication to set the Display Capability Register.
  • the user may set the display capability during a set up procedure.
  • the user may also dynamically switch the display mode, i.e. the user selects a different display mode during playback based on changing preferences.
  • Figure 8 shows HDR graphics processing instructions for an input stream of video information with only LDR video data.
  • the video may originally be LDR video, which is now displayed in HDR display mode.
  • the video information is provided with HDR graphics processing instructions for controlling the graphics processing when the display mode is HDR. Actual instructions are similar to Figure 6, but the switch instruction 62 is not present.
  • Figure 9 shows video processing controlled via graphics processing control data and the display mode for an input stream of video information with only LDR video data.
  • a video processing system 91 e.g. a BD player, receives an input stream of video information, e.g. a BD data stream 92.
  • LDR video data is processed in LDR video decoder LDR-dec 94.
  • a mode controller MOD-CTR 98 may receive a display mode signal 154 indicative of the display mode set by the sink device coupled to the output of the video processing system.
  • the mode controller may also receive user command, such as a user display mode setting 150 or a user temporary setting 151 for temporarily inverting the display mode.
  • the mode controller may control a one bit setting in a register that indicates the actual display mode, e.g. in the player register of a BD player.
  • the mode controller provides, to the extra graphics processor, mode data 153 indicative of the display mode being any one of a LDR display mode and a HDR display mode.
  • the extra graphics processor also receives the graphics processing control data 152 including the HDR processing instructions as described above.
  • the processed graphics data constitutes an overlay that is used in overlay processor OVR 95 to overlay the video to generate the display signal 93, e.g. a HDMI signal.
  • graphics processing is dictated by the HDR instructions as defined by the HDR Processing definition segment, and the mode data 153 indicating whether the display mode is LDR or HDR.
  • Figure 10 shows video processing controlled via graphics processing control data and the display mode for an input stream of video information with LDR and HDR video data.
  • the system has similar elements like in Figure 9.
  • a video processing system 191 e.g. a BD player, receives an input stream of video information, e.g. a BD data stream 192 having both LDR video data and HDR video data.
  • a mode controller MOD-CTR 198 may receive a display mode signal 154 indicative of the display mode set by the sink device coupled to the output of the video processing system.
  • the mode controller may also receive user command, such as a user display mode setting 150 or a user temporary setting 151 for temporarily inverting the display mode.
  • the mode controller may control a one bit setting in a register that indicates the actual display mode, e.g.
  • the mode controller provides, to the extra graphics processor, mode data 153 indicative of the display mode being any one of a LDR display mode and a HDR display mode.
  • the mode controller also controls selection of either a LDR decoder 194 or a HDR decoder 199 for decoding the respective LDR video data stream or HDR video data stream via a video stream selection signal 155.
  • Graphics data is processed in graphics decoder GR-dec 196, and further additionally processed in extra graphics processor GR-ex 197.
  • the extra graphics processor also receives the graphics processing control data 152 including the HDR processing instructions as described above.
  • the processed graphics data constitutes an overlay that is used in overlay processor OVR 195 to overlay the video to generate the display signal 193, e.g. a HDMI signal.
  • graphics processing is dictated by the HDR instructions as defined by the HDR Processing definition segment and the mode data 153 indicating whether the display mode is LDR or HDR, whereas the decoding of the video stream is selected correspondingly.
  • a processing system similar Figure 10 to is provided with the extra graphics processing 197 and the mode controller 198, but is not provided with the HDR decoder 199, e.g. a low cost player.
  • the system may be connected to a HDR display.
  • the input stream may be a video data stream 192 having both LDR video data and HDR video data.
  • the system will automatically select the LDR video data stream to be decoded via the LDR decoder, but will control the extra graphics processing 197 in dependence of the display mode as determined by the mode controller.
  • the video signal is for transferring video information to the video processing device, the video information comprising low dynamic range [LDR] video data and/or high dynamic range [HDR] video data, and the video signal comprising both LDR graphics data and HDR graphics data comprised in the video information.
  • Both streams of graphics data may be fully
  • a HDR indication is included in an attribute of the graphics stream and a linking mechanism between the LDR graphics stream and the corresponding HDR graphics stream is provided.
  • separate versions may also be provided only for limited periods in the video signal, e.g. only when the source decides that the above problems actually occur.
  • the reproducing device will select either the LDR version or HDR version depending on the display mode.
  • the reproducing device will use the single graphics stream as provided.
  • the periods having two versions may be marked by special graphics selection indicator data included in the video signal.
  • a video processing system similar to Figure 10 has a graphics selection unit for selecting one of the LDR graphics stream and the HDR graphics stream depending on the specific display mode of the HDR display.
  • the device for processing video information comprises an input unit for receiving the video information, the video information
  • LDR video data and/or HDR video data comprising LDR video data and/or HDR video data
  • a video processor for generating a display signal by processing the video data for display in a specific display mode being any one of a LDR display mode and a HDR display mode
  • the video information comprises LDR graphics data and HDR graphics data.
  • the input unit is constituted for retrieving either the LDR graphics data or the HDR graphics data for the video information
  • the video processor is constituted for selecting either the LDR graphics data or the HDR graphics data when overlaying the graphics data in dependence on the specific display mode.
  • both LDR graphics data and HDR graphics data are provided in the video signal using an authoring system or in a method of generating video information for transferring to a video processing device, e.g. implemented in a computer program.
  • the author is enabled to fully control the graphics that will be displayed in the respective display mode.
  • the corresponding LDR or HDR graphics data may be used for generating the display signal at the reproducing side.
  • the video data may comprise only HDR video data but still have both the LDR graphics data and the HDR graphics data. While the video signal only contains a single video data stream, this still enables selecting the LDR graphics data when the HDR video data is reproduced for display on a traditional (LDR) display unit. The HDR graphics data will be selected for display in the HDR display mode.
  • the video data may comprise only LDR video data but still have both the LDR graphics data and the HDR graphics data. The LDR graphics data will be selected for display in the LDR display mode. While the video signal only contains a single video data stream, this still enables to select the HDR graphics data when the LDR video data is reproduced for display on an enhanced HDR display unit.
  • the invention may be implemented in hardware and/or software, using programmable components.
  • Methods for generating video information or processing video information for implementing the invention have the steps corresponding to the functions defined for the system as described with reference to Figure 1.
  • the invention has been mainly explained by embodiments using signal transfer via BD, the invention is also suitable for any distribution of video via a digital channel, e.g. DVB broadcast or the internet.
  • a digital channel e.g. DVB broadcast or the internet.

Abstract

A device for processing video information has an input unit (112) for receiving the video information having low dynamic range [LDR] video data and/or high dynamic range [HDR] video data, and a video processor (113) for generating a display signal for display in a LDR display mode or HDR display mode. Graphics data is processed for generating an overlay for overlaying the video data. The input unit receives graphics processing control data comprised in the video information, the graphics processing control data including at least one HDR processing instruction for overlaying the graphics data in the HDR display mode. The video processor is constituted for adapting the processing when overlaying the graphics data in dependence on the specific display mode and the HDR processing instruction. Advantageously the source of the video information is enabled to control the processing of graphics in HDR display mode via the HDR processing instruction.

Description

Graphics processing for high dynamic range video
FIELD OF THE INVENTION
The invention relates to a device for processing video information, the device comprising an input unit for receiving the video information, the video information comprising low dynamic range [LDR] video data and/or high dynamic range [HDR] video data, and a video processor for generating a display signal by processing the video data for display in a specific display mode being any one of a LDR display mode and a HDR display mode, and processing graphics data for generating an overlay for overlaying the video data.
The invention further relates to a video signal for transferring video information, and a device for generating video information, a method for processing video information and a method for generating video information.
The invention relates to the field of displaying video information on a high dynamic range [HDR] display. Display units are currently being developed that are able to provide a high brightness level and a very high contrast between dark parts of the image and bright parts of the image. For fully exploiting the capabilities of such displays video information may be enhanced by providing adapted video information, e.g. having a higher resolution taking into account the higher brightness and the HDR contrast range. For distinguishing from HDR, the traditional video information is called low dynamic range [LDR] video in this document. As such, LDR video information may be displayed on a HDR display unit in HDR display mode for improved contrast. However, a more compelling image is achieved when the video information itself is generated in a HDR video format, e.g.
exploiting the enhanced resolution for better visual effects or for improving visibility in bright or dark areas while avoiding visual banding by using slightly different colors. In addition to enhancing the precision of the image data, movie directors can locally enhance the experience, by e.g. emphasizing explosions, and/or improve visibility in bright or dark scenes/areas. Graphical data, such as pop-up menus or subtitles, may be included in video information for overlaying.
The video processing device may be a Blu-ray Disc player and may be coupled to a display device like a HDR enabled TV set or monitor via a suitable interface, preferably a high-speed digital interface like HDMI. The HDR display may also be integrated with the video processing device.
BACKGROUND OF THE INVENTION
The document US2004/0067041 describes a recording medium having a data structure for managing reproduction of graphic data and recording and reproducing methods and apparatuses. The recording medium includes a graphic information area having at least one graphic image information segment and at least one palette information segment recorded therein. Each palette information segment provides color information. Each graphic image information segment provides reproduction information for reproducing one or more graphic images. Multiple color palettes are proposed, each palette corresponding to a different color depth of the main video that is between 8 bits and 24 bits.
SUMMARY OF THE INVENTION
The proposed data structure for graphical data in US2004/0067041 enables one of different color palettes to be used, the different palettes corresponding to different resolutions of the graphical data. Different graphical images may be simultaneously overlaid on main video, the different graphical images having different sizes and color depths.
However, such a video information format may result in difficulties or additional cost at the receiver. For example, a respective palette must be included for displaying graphical images at a specific color depth. The actual color depth may be determined in a reproducing device depending on the degree of importance and size of the graphical image.
The known graphical data structure has the problem that, when a preferred display mode in a reproducing device varies, the different palettes and sizes of the graphical data structure result in a predefined and fixed generation of an overlay based on the graphical images using the predefined palettes.
It is an object of the invention to provide a system for displaying video information where generating the overlay is adaptable to a preferred display mode.
For this purpose, according to a first aspect of the invention, in the device for processing video information as described in the opening paragraph, the input unit is constituted for receiving graphics processing control data comprised in the video information, the graphics processing control data including at least one HDR processing instruction for overlaying the graphics data in the HDR display mode, and the video processor is constituted for adapting the processing when overlaying the graphics data in dependence on the specific display mode and the HDR processing instruction. When HDR video or images is encoded, that can be done in different ways. E.g., one may use a 12 or 16 bit word for the luma of the pixel colors, and use a faint non-linearity for encoding the wide range of luminances in a scene. One may also encode with a strong non-linearity the HDR scene in an 8 bit word, which is then also relatively suited for immediate display on an LDR display too, but also convertible to what driving signal is optimal for rendering the full HDR content of the scene on any HDR display (e.g. 2000 or 15000 nit peak brightness). Now any graphics like subtitles may be encoded in such a way that if one were to immediately without further optimizing use a graphics pixel code (e.g. some value which is "graphics white"), then depending on the actual display at the rendering, and viewing environment etc., but potentially also on a class of the graphics like e.g. its size or position on the screen, that white may be perceived as being e.g. too bright or too dim. With the proposed HDR processing instructions, one may optimally tune graphics (which usually are perceived as LDR, but in the end are also HDR, at least when coordinated by showing together on an HDR picture), whether it has to be upwards for some configurations like the display used for rendering, or downwards for other configurations, and in whichever of the different ways the (HDR) image(s) and graphics are encoded. Control information allows the receiving display to be steered as one of the types foreseen by the creation side, or to determine by itself which of the offered co-rendering options of the video/image and graphics is optimal.
According to a further aspect of the invention, the video signal is for transferring video information to the video processing device, the video information comprising low dynamic range [LDR] video data and/or high dynamic range [HDR] video data, the video signal comprising graphics processing control data comprised in the video information, the graphics processing control data including at least one HDR processing instruction for overlaying the graphics data in the HDR display mode for adapting the processing when overlaying the graphics data in dependence on the specific display mode and the HDR processing instruction.
According to a further aspect of the invention an optical record carrier comprises a track of optically readable marks, wherein the marks represent the above video signal.
According to a further aspect of the invention a device for generating video information comprises an output unit for transferring video information to a video processing device, the video information comprising low dynamic range [LDR] video data and/or high dynamic range [HDR] video data, the video processing device being arranged for generating a display signal by processing the video data for display in a specific display mode being any one of a LDR display mode and a HDR display mode, and processing graphics data for generating an overlay for overlaying the video data, and a video processor for generating the video information including graphics processing control data, the graphics processing control data including at least one HDR processing instruction for overlaying the graphics data in the HDR display mode for, in the video processing device, adapting the processing when overlaying the graphics data in dependence on the specific display mode and the HDR processing instruction.
According to a further aspect of the invention a method of processing the video information comprises processing the video data for display in a specific display mode being any one of a LDR display mode and a HDR display mode, and processing graphics data for generating an overlay for overlaying the video data, and receiving graphics processing control data comprised in the video information, the graphics processing control data including at least one HDR processing instruction for overlaying the graphics data in the HDR display mode, and adapting the processing when overlaying the graphics data in dependence on the specific display mode and the HDR processing instruction.
According to a further aspect of the invention a method of generating the video information comprises generating graphics processing control data, the graphics processing control data including at least one HDR processing instruction for overlaying the graphics data in the HDR display mode for, in the video processing device, adapting the processing when overlaying the graphics data in dependence on the specific display mode and the HDR processing instruction, and including the graphics processing control data in the video information.
Also, a computer program product for processing video information is operative to cause a processor to perform the methods as defined above.
The graphics processing control data comprises HDR processing instructions for overlaying the graphics data, such as graphical commands or settings to be applied for adapting the processing in HDR mode for generating the overlay or for adapting the processing of the main video. In particular, the graphical instructions define the processing to be applied when the specific display is the HDR display mode. The video processor is arranged for adapting the processing of the graphics data and/or the video data when overlaying the graphics data.
The measures have the effect that the adapting of the processing of the graphics data and/or the video data is controlled depending on the specific display mode as determined in the video processing device according to said respective HDR processing instruction included in the graphics processing control data. Hence the graphics processing control data defines and controls the actual processing operations performed in a reproducing device, because the respective HDR processing instruction is provided at the source of the video information. Advantageously the author of the video information is enabled to control the displaying of the graphics data when a display is generated in HDR display mode. For example, the effort of making separate graphic assets for displaying video in either LDR mode or HDR mode may be avoided, because a single set of graphic assets can be used by suitably adapting the processing at the receiving side under the control of the authoring side.
The invention is also based on the following recognition. While extending the existing video systems for HDR the high contrast ratio available in advanced display devices is used to achieve vivid and realistic video images. However, the inventors have seen that, when overlaying graphics in such a HDR display mode, several problems may occur. For example, a problem that can occur with (semi-transparent) graphics overlays on top of HDR video is that some scenes in HDR video can be exceptionally bright. This will significantly reduce the legibility of the graphics such as subtitles or menu's shown at the same time. Another problem that can occur is that the characters in the subtitles might become so bright that it becomes annoying or fatiguing for the reader. Also extreme bright subtitles or menus may cause halo effects or glare and thus degrade the perceived quality of the video. The inventors have addressed such problems by providing said HDR processing instructions in the video information, which can be handled by novel video processing devices, which process the incoming video by decoding the main video and then overlay the graphics data as instructed by said HDR processing instructions.
Optionally the video information comprises segments defining parameters for generating the overlay, the segments having respective segment types, the segments comprising a HDR processing definition segment of a HDR processing definition type for constituting the graphics processing control data, and the video processor is arranged for adapting the processing according to the HDR processing instruction from the HDR processing definition segment. Advantageously the format of the video information is extended using segments that define video parameters, which segments may also be used for other decoding information.
Optionally, the graphics data comprises LDR palette information defining at least one LDR color palette and HDR palette information defining at least one HDR color palette and the graphics processing control data comprises a palette selection instruction for selecting the HDR palette, and the video processor is arranged for selecting the HDR color palette in the HDR display mode in dependence on the palette selection instruction. The video data comprises both an LDR color palette and a HDR color palette, and the palette selection instruction enable selecting a respective palette in the HDR display mode.
Optionally, the graphics processing control data comprises a transparency instruction defining a reduction of transparency with respect to the transparency in LDR display mode, and the video processor is arranged for adapting transparency of the graphics data in the overlay in the HDR display mode in dependence on the transparency instruction. Advantageously, the transparency of the graphics data may be adjusted to the respective HDR video scene.
Optionally, the graphics processing control data comprises a video switch instruction defining whether to switch the processing of the video data to LDR display mode while the specific display mode is the HDR display mode, and the video processor is arranged for switching the video data to LDR display mode while overlaying the video data when the specific display mode is the HDR display mode in dependence on the video switch instruction, or the graphics processing control data comprises a graphics selection instruction defining whether to retrieve a stream of HDR graphics data while the specific display mode is the HDR display mode, and the video processor is arranged for using the HDR graphics data while overlaying the video data when the specific display mode is the HDR display mode in dependence on the graphics selection instruction. Advantageously, the video display may be temporarily switched to LDR mode while overlaying the graphics data, or the graphics processing may be set to use a dedicated HDR graphics stream.
Optionally, the graphics processing control data comprises a luminance instruction defining a reduction of luminance with respect to the luminance in LDR display mode, and the video processor is arranged for defining luminance of the graphics data in the overlay in the HDR display mode in dependence on the luminance instruction.
Advantageously, the luminance of the graphics data may be adjusted to be convenient when displayed in HDR display mode.
Optionally, the graphics processing control data comprises a pop-up process descriptor defining a HDR processing instruction when overlaying pop-up graphic data in the HDR display mode. Advantageously, the processing is adapted when the device is activated to display a pop-up, e.g. a menu or button, according to the respective HDR processing instruction. Optionally, the graphics processing control data comprises a subtitle process descriptor defining a HDR processing instruction when overlaying subtitle graphic data in the HDR display mode. Advantageously, the processing is adapted when the device is activated to display a subtitle, according to the respective HDR processing instruction. Hence specific processing is active when displaying subtitles in HDR mode.
Optionally, the video processor is arranged for setting the specific display mode in dependence of display capability information acquired from a display device connected to receive the display signal.
Optionally, the video processor is arranged for setting the specific display mode in dependence of display mode information received from a display device connected to receive the display signal. Advantageously, the processing may be adapted automatically to the respective display mode.
Optionally, the video processor is arranged for setting the specific display mode in dependence of dynamic range information included in the video information, indicative of a dynamic range of the video information. Advantageously, the processing may be adapted automatically to the received video information.
Optionally, the video processor is arranged for setting the specific display mode in dependence of a display mode preference based on a user setting. Advantageously, the processing may be adapted to the respective display mode according to the user setting.
The above options may be suitably combined for constituting further preferred embodiments of devices and methods according to the invention. Further embodiments are given in the appended claims, disclosure of which is incorporated herein by reference.
Features defined above or in dependent claims for a particular method or device
correspondingly apply to other devices or methods.
BRIEF DESCRIPTION OF THE DRAWINGS
These and other aspects of the invention will be apparent from and elucidated further with reference to the embodiments described by way of example in the following description and with reference to the accompanying drawings, in which
Figure 1 shows a system for transferring video information,
Figure 2 shows a video processing system in a receiving device,
Figure 3 shows a BD data stream with graphics,
Figure 4 shows types of segments,
Figure 5 shows graphics processing control data, Figure 6 shows HDR graphics processing instructions for pop-up graphics, Figure 7 shows HDR graphics processing instructions for subtitle graphics, Figure 8 shows HDR graphics processing instructions for an input stream of video information with only LDR video data,
Figure 9 shows video processing controlled via graphics processing control data and the display mode for an input stream of video information with only LDR video data, and
Figure 10 shows video processing controlled via graphics processing control data and the display mode for an input stream of video information with LDR and HDR video data.
The figures are purely diagrammatic and not drawn to scale. In the Figures, elements which correspond to elements already described have the same reference numerals.
DETAILED DESCRIPTION OF EMBODIMENTS
High Dynamic Range (HDR) displays can provide a much higher light output and contrast between black and white than regular displays. Such displays may have a matrix of high efficiency LED's in the backlight that provide the display with a dynamic range of 40.000: 1 and more. Such a large dynamic range in combination with a high (local) light output greatly increases the realism of the images shown on the display. To make full use of the large dynamic range and high brightness of these displays, the content must also support enough fidelity and resolution in luminance and color.
Distribution of audio video (A/V) content is described in several standards, such as for example DVB for broadcasting and Blu-ray Disc or DVD for packaged media. The digital video content transmitted using these standards is sampled as YUV 4:2:0 or better YUV 4:2:2 and encoded using standards from the MPEG group. After transmission the content is decoded and played back on a device that implements the related standards such as a Blu-ray Disc player. The decoded content is then transmitted to a display using a suitable interface. Video encoded according to the traditional standards is called low dynamic range (LDR) video in this document. The standards may be extended to support HDR video.
The Blu-ray Disc (BD) standard supports graphics overlays for subtitles, full screen menus, animations and pop-up graphics. Also, BD players typically feature On Screen Display (OSD) menus. Hence graphics information may also be generated locally. Several issues are addressed related to overlay of graphics on top of video background on a HDR display. For example a problem that can occur is that the characters in the subtitles might become so bright that it becomes annoying or fatiguing for the reader. Another problem that can occur with (semi-transparent) graphics overlays on top of HDR video is that some scenes in HDR video can be exceptionally bright. This will significantly reduce the legibility of the graphics such as subtitles or menus shown at the same time. It is described to adjust the processing of graphics like subtitles or pop-up menus depending on the type of video being displayed (LDR or HDR video). Also in the case that the data stream contains only one type of video (LDR or HDR), problems can occur when displaying this video in combination with graphics on a HDR display. Hence the solutions proposed are relevant for video information containing LDR, HDR or both LDR and HDR video data.
Summarized various issues are addressed by the proposed system, such as:
- ensuring that a HDR enabled disc plays correctly on a legacy player;
- semi-transparent overlays of graphics and exceptionally bright areas of the video background can make the graphics, such as subtitles or menu's unreadable;
- subtitles can become annoying or fatiguing because of extreme brightness;
- extreme bright subtitles or pop-up menus can have a negative effect on the perceived quality of the video. This can be caused by a halo effect or by glare;
- the required graphics processing in case of displaying on a HDR display may differ for different types of graphics content, for example menus and subtitles.
Figure 1 shows a system for transferring video information. The system has a video source 100, which provides a video transfer signal 104 to be transferred to a video processing device 110 via a transfer medium 130, e.g. an optical disc 140, the internet or a broadcast network. The processing device constitutes a receiver, which receives a video signal 111 from the recording medium or broadcast in an input unit 112. The receiver provides a display signal 114 to a HDR display device 120, for example a HDMI signal to TV or projection system capable of displaying video in a high dynamic range (HDR) display mode. Alternatively the receiver may be connected to an LDR display device (not shown) and may then generate an LDR display signal. The receiver may be a separate device like a Blu-ray Disc (BD) player, or a set top box (STB) or satellite receiver. Alternatively, the receiver 110 and the HDR display 120 are combined in a single device, like a digital HDR TV having a digital tuner and a video processor build in.
The system is arranged for transferring the video information in multiple data streams multiplexed in a video transfer signal, e.g. according to a video format known as such. The video information includes low dynamic range [LDR] video data and/or high dynamic range [HDR] video data, and may also include graphics data, like subtitles or menus. The HDR video data is provided on main input 101 of video source device 100. The graphics data may be provided on auxiliary input 102 of video source 100, and is arranged for display in an overlay on the main video data, such as subtitles. It is noted that multiple streams of graphic data may be included. Further graphics data like pop-up menus may be encoded in a separate graphics stream, usually separately transferred outside the multiplexed real-time video data streams (so-called out-of-mux), to enable preloading and activating at any time. Also, additional graphic data may be generated downstream, e.g. menus generated at the receiving side in the receiver 110.
The system, at the source side, accommodates the functions for including, in the video transfer signal, graphic processing control data as described below. The graphics processing control data includes at least one HDR processing instruction for overlaying the graphics data in the HDR display mode. The functions may be implemented in a video processor 103 in the source device, but may also be performed in an authoring system based on dedicated computer programs, in a broadcasting studio, etc.
The main video is processed by arranging the HDR video data according to a video transmission format. According to the applicable transmission standard, the system provides control data for indicating parameters to a receiver for enabling the receiver to reproduce the main video data and overlaying the graphics data. Finally a data transport stream in the video transfer signal 104 is assembled as described above, including the graphic processing control data as described in detail below, for transmission via the transfer medium 130.
The video transfer signal 104 for transferring the HDR video information and the graphic processing control data is transferred via the transfer medium 130, e.g. an optical disc 140 like BD, a public TV transmission network, a satellite network, internet, etc. In the video signal a transport stream represents the HDR video information. A video information transfer platform is Digital Video Broadcast (DVB). DVB applies various standards for terrestrial, cable, satellite and mobile for transport and associated signaling of audio/video, graphics (subtitles etc) and interactive applications (Java applications or HTML XML). Current advances in display technology are making it possible to introduce HDR video for a mass market audience. Therefore to enable widespread distribution of HDR content the DVB standards may be extended to allow broadcast of HDR content. Further transfer media include the BD optical disc, the internet, etc, and the respective video formats may also be adapted for HDR video. In particular, such video formats may be enhanced by defining the video transfer signal to include the proposed graphic processing control data. It is noted that the video information may be further arranged for displaying three dimensional (3D) video data, optionally in combination with the HDR enhanced video information.
The receiver 110 has the input unit 112 for receiving the video signal 111, i.e. the video transfer signal 104 after transferring via the transfer medium 130 as described above. The video information and the graphic processing control data are retrieved and coupled to a video processor 113. The video processor has a signal processing structure for generating a display signal 114 by processing the video data for display in a specific display mode being any one of a LDR display mode and a HDR display mode, and processing graphics data for generating an overlay for overlaying the video data. The video processor adapts the processing when overlaying the graphics data in dependence on the specific display mode and the HDR processing instruction, as elucidated below in detail.
The source device 100 is for generating video information, and the device has an output unit 105 for transferring video information to the video processing device 110. The source device has a video processor 103 for generating the video information including the graphics processing control data, the graphics processing control data including at least one HDR processing instruction for overlaying the graphics data in the HDR display mode for, in the video processing device, adapting the processing when overlaying the graphics data in dependence on the specific display mode and the HDR processing instruction.
The video signal 111 is for transferring video information to a video processing device, the video processing device being arranged for generating a display signal by processing the video data for display in a specific display mode being any one of a LDR display mode and a HDR display mode, and processing graphics data for generating an overlay for overlaying the video data. The video signal includes the graphics processing control data in the video information. The graphics processing control data has at least one HDR processing instruction for overlaying the graphics data in the HDR display mode for adapting the processing when overlaying the graphics data in dependence on the specific display mode and the HDR processing instruction.
In an embodiment, the video signal is provided on an optical record carrier 140, for example a DVD or BD. The optical record carrier has a track of optically readable marks, wherein the marks represent the video signal as described above. A practical example of the specific video format used to store the video information including the graphic processing control data based on BD is described below.
Figure 2 shows a video processing system in a receiving device. The device may for example be a BD player, digital TV set or a set top box. An input unit 201 comprises a demodulator for retrieving the video information from the video signal. The input unit may also include an optical record carrier unit for retrieving the video information from an optical record carrier. The demodulator retrieves the transport stream from the video signal, which transport stream is coupled to a de-multiplexer unit 202, which also may include a descrambler, for retrieving the various data streams and control data from the transport stream. The data streams are coupled to a main decoder 203 for decoding the video and audio data, and to an auxiliary decoder 204 for decoding graphics data and control data. The decoders and further elements are coupled via a system bus 209 to a central processing unit (CPU), a graphics processor 206, a memory 207, and an output stage 208 for generating the display signal, for example according to HDMI.
In some implementations the processing pipeline of video and subtitles are different and separate. Processing and high bandwidth operations such as A/V decoding and graphics processing (filter operations etc.) is done in a dedicated ASIC whilst processing of low bandwidth information such as the subtitles is done by a low power general purpose processer. The subtitles and the video are not combined until at the very end of the processing pipeline.
In the following the video information is discussed according to the Blu-ray disc format. It is to be noted that the BD format is a practical example, and that similar graphic processing control data may be included in any other suitable video format.
Figure 3 shows a BD data stream with graphics. The Blu-ray Disc data stream comprises a transport stream 31 having transport packets 34. A subset of the packets 34 may have the same packet identifier PID and then forms a dedicated stream of elementary packets (PES), said PES Packets constituting a Graphics Elementary Stream 32. Segments 33 are data structures that are embedded in the stream of PES packets. Further information on the BD system can be found in US applications US2006580647 and US20090103895 and the BD- ROM A/V White Paper l 00604(1)- 15916 available from the Blu-ray Disc Association . The documents describe how streams are processed in a Blu-ray Disc player and how video is combined with synchronized graphics and audio data to create a compelling movie experience. In Blu-ray Disc the audio and graphics data may be embedded into the main transport stream or may be embedded into another auxiliary transport stream that contains data that may be presented in sync with the content of the main transport stream dependent on input from the user. For example a playlist may be defined with multiple subtitle streams for different languages. In Blu-ray Disc this means for example that a playlist is defined with multiple playitems, whereby each playitem may have multiple sub-playitems, these sub- playitems then would contain different subtitle streams from which the system can select dependent on user input.
Synchronization with the main video is done at elementary stream level using Presentation Time Stamp (PTS) values in the PES packets. The Blu-ray Disc graphics segment consists of a segment descriptor and the segment data. The segment descriptor contains the type of the segment and the length.
It is proposed to define a new segment type that carries information on how to process graphics when the video playback mode is set to HDR, for example as follows.
A Presentation Graphics or Interactive Graphics or Text subtitle stream on a HDR enabled disc additionally contains an HDR Processing definition segment. This segment defines the way the decoder processes Presentation Graphics or Text subtitle graphics in High Definition Movie (HDMV) mode and/or BD Java (BD-J) mode and Interactive Graphics (HDMV mode) in case of HDR Video. The HDR Processing definition segment may contain for every palette definition segment in the stream also a new
HDR_palette definition. The composition buffers for the HDMV Presentation Graphics decoder, the HDMV Interactive Graphics decoder and the HDMV Text subtitle decoder in the BD graphics decoder model is extended to be able to store the palette data for both the LDR and the HDR presentation. When a menu is activated the graphics decoder model checks the display mode through a new register or newly defined (initially reserved) register bits that indicates the LDR/HDR playback mode. When the mode change from LDR to HDR is done the graphics decoder model processes the graphics as defined in
HDR Processing definition segment. The graphics decoder model may ignore the standard palette definition and instead load the new HDR palette definition from the composition buffer into the CLUT (Color Lookup Table). When switching back to LDR mode the standard palette definition segment is loaded into the CLUT from the composition buffer and the HDR palette is ignored. Other algorithms for graphics processing may also be defined in the HDR Processing definition segment.
The advantage of this approach is that it provides a backward compatible solution as existing LDR players will ignore the new segment type. Additionally it saves disc capacity and bandwidth as it doesn't require duplicate graphics objects while the additional HDR Processing definition segment requires comparatively little data. Moreover, using the palettes allows for different processing for different types of graphics content. In a further embodiment for pop-up menu's the video is automatically switched back to LDR mode when the user activates a BD-Java pop-up menu. At the moment the pop-up menu is switched off, the video is automatically switched back to HDR.
In a further embodiment a set of two different graphics streams is defined. One graphics stream is provided for LDR and the other one has at least substantially the same contents but is adapted for HDR. A HDR graphics indication may be provided in an attribute of the graphics stream. A linking mechanism between the LDR graphics stream and the corresponding HDR graphics stream may be provided to indicate which graphics stream is the HDR graphics stream corresponding to a particular LDR graphics stream, for example a pointer. The HDR version indication may be included in extension data of e.g. a PlayList file and may contain a link to the corresponding LDR version. Hence the reproducing device is enabled to select the respective one of both streams. In the embodiment the graphics processing control data may comprise a graphics selection instruction defining whether to retrieve a stream of HDR graphics data while the specific display mode is the HDR display mode, and the video processor is arranged for using the HDR graphics data while overlaying the video data when the specific display mode is the HDR display mode in dependence on the graphics selection instruction.
Figure 4 shows types of segments. Various types of segment, such as Palette Definition Segment, Object Definition Segment, etc, are defined in the Blu-ray Disc standard, where value 0x83 to OxFF are reserved. The table comprises a new segment type 41 with for example value 0x83 that indicates a segment that contains the HDR Processing definition segment. In general, the HDR Processing definition segment contains parameters and/or instructions that affect the way the graphics decoder processes the graphics in HDR display mode. So in the event that the display mode is HDR the parameters and/or instructions modify the result of the regular processing.
Figure 5 shows graphics processing control data. The table shows an example of how the structure of the HDR Processing definition segment may look like.
In this example the HDR Processing definition segment contains two processing
instructions: a Pop-up_process_descriptor 51 and a Subtitle_process descriptor 52.
The segment may also contain HDR palettes 53 to be used when display mode is HDR. It is to be noted that the original palettes (now called LDR palettes) are provided in other segments as defined in the BD standard. In addition, the HDR palette contains the same number of entries as the original LDR palette but the entries are adapted to HDR display mode such that • the Y, Cr and Cb values in the palette have the same color matrix as the associated HDR video stream.
The values of Y, Cr, Cb, and T are adapted to reduce the problems when combining graphics in HDR display mode.
Figure 6 shows HDR graphics processing instructions for pop-up graphics.
The instruction Pop-up_process_descriptor specifies the extra processing of the graphics in the case of pop-up graphics in combination with HDR video. As an example this parameter can have the following values:
Pop-up_process_descriptor = 0x00 is an instruction which instructs that the graphics processing for HDR video is equal to processing for LDR video;
Pop-up_process_descriptor = 0x01 to 0x09 are transparency instructions 61, which instruct that the transparency is to be reduced to a specific percentage of LDR transparency value;
Pop-up_process_descriptor = OxOA is a video switch instruction 62, and instructs the player to switch to LBR video when pop-up graphics is activated and to switch back to HDR when pop-up graphics is de-activated;
Pop-up_process_descriptor = 0x0B2 is a HDR instruction 63 that instructs the graphics processor to use the HDR palettes.
For the transparency instructions it is noted that transparency only needs to be reduced if the original data was transparent. Reduction values in the table are just examples, practical values may be different, e.g. have fewer levels, a logarithmic scale etc.
For the video switch instruction, the following is noted. In HDMV mode, the player simply responds to the pre-defined PopUp On() and PopUp Off() User Operations and an optional preference setting in a to be defined field of a Player status register (PSR). The preference could be set through a value in the Playlist for the title and indicate that video should switch back to LDR when a pop-up menu is shown. If the preference is set to switch back to LDR, the player will automatically switch to LDR when the PopUp On() User Operation is activated, and switch back to HDR when the PopUp Off() is activated. In BD-J mode, the same kind of behavior can be achieved by having the BD-J program respond to VK POPUP MENU BD-J Events and appropriately control the video steam selection and playback.
Figure 7 shows HDR graphics processing instructions for subtitle graphics (e.g. Presentation Graphics or Text subtitles). The instruction Subtitle_process_descriptor specifies the extra processing of the graphics in the case of subtitle graphics in combination with HDR video. As an example this parameter can have the following values:
Subtitle_process_descriptor = 0x00 is an instruction which instructs that the graphics processing in HDR video is equal to the LDR mode;
· Subtitle_process_descriptor = 0x01 to 0x09 are luminance instructions 71, which instruct that the the luma value is to be reduced to a specific percentage of LDR luma value (the luma value is representing the luminance, usually denoted as Y);
• Subtitle_process_descriptor = OxOA is a HDR instruction that instructs the graphics processor to use the HDR palettes.
Additionally the HDR graphics processing instructions for pop-up graphics and/or for subtitle graphics may further include the graphics selection instruction as described above.
Additionally the HDR graphics processing instructions may further include instructions to change the position of the graphics and/or the video on the screen. Hence, the overlap of graphics and very bright areas of the video may be avoided by changing at least one of said positions. For example, in the letterbox format, the video can be moved up and the subtitles can be positioned in the black bar below the video.
It is noted that the display mode may be determined based on the capabilities of the display device coupled to the video processing device, e.g. via a HDMI signal. Also user settings in the display device for selecting the display mode (LDR or HDR) may be communicated to the processing device. HDMI provides for communication (such as EDID or Display Port) of display capabilities of the sink device to the source device, e.g. an indication of 1 bit defining that HDR is supported. A BD player may use this indication to set the Display Capability Register. Alternatively the user may set the display capability during a set up procedure. Finally it is noted that the user may also dynamically switch the display mode, i.e. the user selects a different display mode during playback based on changing preferences. The various options for controlling the display mode and the graphics processing are elucidated by the following Figures.
Figure 8 shows HDR graphics processing instructions for an input stream of video information with only LDR video data. It is to be noted that the video may originally be LDR video, which is now displayed in HDR display mode. The video information is provided with HDR graphics processing instructions for controlling the graphics processing when the display mode is HDR. Actual instructions are similar to Figure 6, but the switch instruction 62 is not present. Figure 9 shows video processing controlled via graphics processing control data and the display mode for an input stream of video information with only LDR video data. A video processing system 91, e.g. a BD player, receives an input stream of video information, e.g. a BD data stream 92. LDR video data is processed in LDR video decoder LDR-dec 94. Graphics data is processed in graphics decoder GR-dec 96, and further additionally processed in extra graphics processor GR-ex 97. A mode controller MOD-CTR 98 may receive a display mode signal 154 indicative of the display mode set by the sink device coupled to the output of the video processing system. The mode controller may also receive user command, such as a user display mode setting 150 or a user temporary setting 151 for temporarily inverting the display mode. The mode controller may control a one bit setting in a register that indicates the actual display mode, e.g. in the player register of a BD player. The mode controller provides, to the extra graphics processor, mode data 153 indicative of the display mode being any one of a LDR display mode and a HDR display mode. The extra graphics processor also receives the graphics processing control data 152 including the HDR processing instructions as described above. The processed graphics data constitutes an overlay that is used in overlay processor OVR 95 to overlay the video to generate the display signal 93, e.g. a HDMI signal. In the embodiment graphics processing is dictated by the HDR instructions as defined by the HDR Processing definition segment, and the mode data 153 indicating whether the display mode is LDR or HDR.
Figure 10 shows video processing controlled via graphics processing control data and the display mode for an input stream of video information with LDR and HDR video data. The system has similar elements like in Figure 9. A video processing system 191, e.g. a BD player, receives an input stream of video information, e.g. a BD data stream 192 having both LDR video data and HDR video data. A mode controller MOD-CTR 198 may receive a display mode signal 154 indicative of the display mode set by the sink device coupled to the output of the video processing system. The mode controller may also receive user command, such as a user display mode setting 150 or a user temporary setting 151 for temporarily inverting the display mode. The mode controller may control a one bit setting in a register that indicates the actual display mode, e.g. in the player register of a BD player. The mode controller provides, to the extra graphics processor, mode data 153 indicative of the display mode being any one of a LDR display mode and a HDR display mode. The mode controller also controls selection of either a LDR decoder 194 or a HDR decoder 199 for decoding the respective LDR video data stream or HDR video data stream via a video stream selection signal 155. Graphics data is processed in graphics decoder GR-dec 196, and further additionally processed in extra graphics processor GR-ex 197. The extra graphics processor also receives the graphics processing control data 152 including the HDR processing instructions as described above. The processed graphics data constitutes an overlay that is used in overlay processor OVR 195 to overlay the video to generate the display signal 193, e.g. a HDMI signal. In the embodiment, graphics processing is dictated by the HDR instructions as defined by the HDR Processing definition segment and the mode data 153 indicating whether the display mode is LDR or HDR, whereas the decoding of the video stream is selected correspondingly.
In an embodiment a processing system similar Figure 10 to is provided with the extra graphics processing 197 and the mode controller 198, but is not provided with the HDR decoder 199, e.g. a low cost player. The system may be connected to a HDR display. The input stream may be a video data stream 192 having both LDR video data and HDR video data. The system will automatically select the LDR video data stream to be decoded via the LDR decoder, but will control the extra graphics processing 197 in dependence of the display mode as determined by the mode controller.
According to a different aspect of the invention, the video signal is for transferring video information to the video processing device, the video information comprising low dynamic range [LDR] video data and/or high dynamic range [HDR] video data, and the video signal comprising both LDR graphics data and HDR graphics data comprised in the video information. Both streams of graphics data may be fully
independently encoded, or may share some elements. Having two separate streams of graphics data, respectively for the LDR display mode and the HDR display mode, advantageously enables the source of the video to fully control the graphics functions for both display modes separately. Optionally, a HDR indication is included in an attribute of the graphics stream and a linking mechanism between the LDR graphics stream and the corresponding HDR graphics stream is provided.
It is noted that, traditionally, brightness and contrast during display are only controlled at the reproducing side by the user. The inventors have seen that problems will occur if traditional graphics is displayed in HDR display mode under user control. While some of the problems might be mitigated by providing further user controls, e.g. a separate user transparency setting for HDR mode, the inventors have seen that this might confuse the user, and have proposed to add, at the source side, both the LDR graphics stream and the HDR graphics stream to the video signal. This contravenes traditions in the field of signal transfer systems, which try to limit the amount of data that needs to be transferred. Optionally, either one, or all, of the pop-up graphics data, the subtitle graphics data, and other graphics data like interactive graphics applications, may be included in said two versions in the video signal. Also, separate versions may also be provided only for limited periods in the video signal, e.g. only when the source decides that the above problems actually occur. In periods having said two versions of graphics data the reproducing device will select either the LDR version or HDR version depending on the display mode. In other periods of the video signal the reproducing device will use the single graphics stream as provided. The periods having two versions may be marked by special graphics selection indicator data included in the video signal.
A video processing system similar to Figure 10 has a graphics selection unit for selecting one of the LDR graphics stream and the HDR graphics stream depending on the specific display mode of the HDR display. The device for processing video information comprises an input unit for receiving the video information, the video information
comprising LDR video data and/or HDR video data, and a video processor for generating a display signal by processing the video data for display in a specific display mode being any one of a LDR display mode and a HDR display mode, and
for processing graphics data for generating an overlay for overlaying the video data. The video information comprises LDR graphics data and HDR graphics data. In the device the input unit is constituted for retrieving either the LDR graphics data or the HDR graphics data for the video information, and the video processor is constituted for selecting either the LDR graphics data or the HDR graphics data when overlaying the graphics data in dependence on the specific display mode.
Advantageously both LDR graphics data and HDR graphics data are provided in the video signal using an authoring system or in a method of generating video information for transferring to a video processing device, e.g. implemented in a computer program. Hence the author is enabled to fully control the graphics that will be displayed in the respective display mode. When both LDR video data and HDR video data are included in the video signal, the corresponding LDR or HDR graphics data may be used for generating the display signal at the reproducing side.
In a particular case, the video data may comprise only HDR video data but still have both the LDR graphics data and the HDR graphics data. While the video signal only contains a single video data stream, this still enables selecting the LDR graphics data when the HDR video data is reproduced for display on a traditional (LDR) display unit. The HDR graphics data will be selected for display in the HDR display mode. Optionally, the video data may comprise only LDR video data but still have both the LDR graphics data and the HDR graphics data. The LDR graphics data will be selected for display in the LDR display mode. While the video signal only contains a single video data stream, this still enables to select the HDR graphics data when the LDR video data is reproduced for display on an enhanced HDR display unit.
It is to be noted that the invention may be implemented in hardware and/or software, using programmable components. Methods for generating video information or processing video information for implementing the invention have the steps corresponding to the functions defined for the system as described with reference to Figure 1.
Although the invention has been mainly explained by embodiments using signal transfer via BD, the invention is also suitable for any distribution of video via a digital channel, e.g. DVB broadcast or the internet.
It will be appreciated that the above description for clarity has described embodiments of the invention with reference to different functional units and processors. However, it will be apparent that any suitable distribution of functionality between different functional units or processors may be used without deviating from the invention. For example, functionality illustrated to be performed by separate units, processors or controllers may be performed by the same processor or controllers. Hence, references to specific functional units are only to be seen as references to suitable means for providing the described functionality rather than indicative of a strict logical or physical structure or organization. The invention can be implemented in any suitable form including hardware, software, firmware or any combination of these.
It is noted, that in this document the word 'comprising' does not exclude the presence of other elements or steps than those listed and the word 'a' or 'an' preceding an element does not exclude the presence of a plurality of such elements, that any reference signs do not limit the scope of the claims, that the invention may be implemented by means of both hardware and software, and that several 'means' or 'units' may be represented by the same item of hardware or software, and a processor may fulfill the function of one or more units, possibly in cooperation with hardware elements. Further, the invention is not limited to the embodiments, and the invention lies in each and every novel feature or combination of features described above or recited in mutually different dependent claims.

Claims

CLAIMS:
1. Device (110) for processing video information, the device comprising
- an input unit (112) for receiving the video information, the video information comprising low dynamic range [LDR] video data and/or high dynamic range [HDR] video data, and
- a video processor (113) for generating a display signal by
processing the video data for display in a specific display mode being any one of a LDR display mode and a HDR display mode, and
processing graphics data for generating an overlay for overlaying the video data, wherein
- the input unit is constituted for receiving graphics processing control data comprised in the video information, the graphics processing control data including at least one HDR processing instruction for overlaying the graphics data in the HDR display mode, and
- the video processor is constituted for adapting the processing when overlaying the graphics data in dependence on the specific display mode and the HDR processing instruction.
2. Device as claimed in claim 1, wherein the video information comprises segments defining parameters for generating the overlay, the segments having respective segment types, the segments comprising a HDR processing definition segment of a HDR processing definition type for constituting the graphics processing control data,
and the video processor (113) is arranged for adapting the processing according to the HDR processing instruction from the HDR processing definition segment.
3. Device as claimed in claim 1, wherein the graphics data comprises LDR palette information defining at least one LDR color palette and HDR palette information defining at least one HDR color palette and the graphics processing control data comprises a palette selection instruction for selecting the HDR palette, and the video processor (113) is arranged for selecting the HDR color palette in the HDR display mode in dependence on the palette selection instruction.
4. Device as claimed in claim 1, wherein the graphics processing control data comprises a transparency instruction defining a reduction of transparency with respect to the transparency in LDR display mode, and the video processor (113) is arranged for adapting transparency of the graphics data in the overlay in the HDR display mode in dependence on the transparency instruction, or the graphics processing control data comprises a luminance instruction defining a reduction of luminance with respect to the luminance in LDR display mode, and the video processor (113) is arranged for defining luminance of the graphics data in the overlay in the HDR display mode in dependence on the luminance instruction.
5. Device as claimed in claim 1, wherein the graphics processing control data comprises a video switch instruction defining whether to switch the processing of the video data to LDR display mode while the specific display mode is the HDR display mode, and the video processor (113) is arranged for switching the video data to LDR display mode while overlaying the video data when the specific display mode is the HDR display mode in dependence on the video switch instruction, or the graphics processing control data comprises a graphics selection instruction defining whether to retrieve a stream of HDR graphics data while the specific display mode is the HDR display mode, and the video processor (113) is arranged for using the HDR graphics data while overlaying the video data when the specific display mode is the HDR display mode in dependence on the graphics selection instruction.
6. Device as claimed in claim 1, wherein the graphics processing control data comprises at least one of:
- a pop-up process descriptor defining a HDR processing instruction when overlaying pop-up graphic data in the HDR display mode;
- a subtitle process descriptor defining a HDR processing instruction when overlaying subtitle graphic data in the HDR display mode.
7. Device as claimed in claim 1, wherein the video processor (113) is arranged for setting the specific display mode in dependence of at least one of
- display capability information acquired from a display device connected to receive the display signal;
- display mode information received from a display device connected to receive the display signal; - dynamic range information included in the video information, indicative of a dynamic range of the video information;
- a display mode preference based on a user setting.
8. Device as claimed in claim 1, wherein the device comprises at least one of
- a display unit for displaying the display signal in the specific display mode being any one of a LDR display mode and a HDR display mode;
- an optical record carrier unit comprised in the input unit for retrieving the video information from an optical record carrier.
9. Video signal for transferring video information to a video processing device, the video information comprising low dynamic range [LDR] video data and/or high dynamic range [HDR] video data,
the video processing device being arranged for generating a display signal by processing the video data for display in a specific display mode being any one of a LDR display mode and a HDR display mode, and processing graphics data for generating an overlay for overlaying the video data,
wherein
- the video signal comprises graphics processing control data comprised in the video information, the graphics processing control data including at least one HDR processing instruction for overlaying the graphics data in the HDR display mode for adapting the processing when overlaying the graphics data in dependence on the specific display mode and the HDR processing instruction.
10. Signal as claimed in claim 9, wherein the video information comprises segments defining parameters for generating the overlay, the segments having respective segment types, the segments comprising a HDR processing definition segment of a HDR processing definition type for constituting the graphics processing control data.
11. Signal as claimed in claim 10, wherein the HDR processing definition segment is included in a presentation graphics stream and/or an interactive graphics stream.
12. Optical record carrier (140) comprising a track of optically readable marks, wherein the marks represent the video signal as claimed in any of the claims 9,10 or 11.
13. Device for generating video information, the device (100) comprising an output unit (105) for transferring video information to a video processing device (110), the video information comprising low dynamic range [LDR] video data and/or high dynamic range [HDR] video data,
the video processing device being arranged for generating a display signal by processing the video data for display in a specific display mode being any one of a LDR display mode and a HDR display mode, and processing graphics data for generating an overlay for overlaying the video data,
wherein
- the device for generating comprises a video processor (103) for generating the video information including graphics processing control data, the graphics processing control data including at least one HDR processing instruction for overlaying the graphics data in the HDR display mode for, in the video processing device, adapting the processing when overlaying the graphics data in dependence on the specific display mode and the HDR processing instruction.
14. Method of processing video information, the video information comprising low dynamic range [LDR] video data and/or high dynamic range [HDR] video data, the method comprising
- processing the video data for display in a specific display mode being any one of a LDR display mode and a HDR display mode, and
- processing graphics data for generating an overlay for overlaying the video data, wherein the method further comprises
- receiving graphics processing control data comprised in the video information, the graphics processing control data including at least one HDR processing instruction for overlaying the graphics data in the HDR display mode, and
- adapting the processing when overlaying the graphics data in dependence on the specific display mode and the HDR processing instruction.
15. Method of generating video information for transferring to a video processing device, the video information comprising low dynamic range [LDR] video data and/or high dynamic range [HDR] video data,
the video processing device being arranged for generating a display signal by processing the video data for display in a specific display mode being any one of a LDR display mode and a HDR display mode, and processing graphics data for generating an overlay for overlaying the video data,
wherein the method comprises
- generating graphics processing control data, the graphics processing control data including at least one HDR processing instruction for overlaying the graphics data in the HDR display mode for, in the video processing device, adapting the processing when overlaying the graphics data in dependence on the specific display mode and the HDR processing instruction, and
- including the graphics processing control data in the video information.
16. Computer program product for processing video information, which program is operative to cause a processor to perform the method as claimed in any one of the claims 14 or 15.
PCT/IB2012/052873 2011-06-14 2012-06-07 Graphics processing for high dynamic range video WO2012172460A1 (en)

Priority Applications (9)

Application Number Priority Date Filing Date Title
CN201280029106.3A CN103597812B (en) 2011-06-14 2012-06-07 Graphic processing apparatus and method for high dynamic range video
US14/125,319 US9443495B2 (en) 2011-06-14 2012-06-07 Graphics processing for high dynamic range video
BR112013031870-8A BR112013031870B1 (en) 2011-06-14 2012-06-07 Device for processing video information, video signal for transferring video information to a video processing device, optical record carrier, device for generating video information, method of processing video information and method of generating video information for transferring to a video processing device
EP12730652.0A EP2721811B1 (en) 2011-06-14 2012-06-07 Graphics processing for high dynamic range video
JP2014515315A JP6053767B2 (en) 2011-06-14 2012-06-07 Graphic processing for high dynamic range video
RU2014100893/07A RU2605435C2 (en) 2011-06-14 2012-06-07 Graphics processing for high dynamic range video
PL12730652T PL2721811T3 (en) 2011-06-14 2012-06-07 Graphics processing for high dynamic range video
ES12730652T ES2774219T3 (en) 2011-06-14 2012-06-07 Graphics processing for high dynamic range video
MX2013014545A MX340266B (en) 2011-06-14 2012-06-07 Graphics processing for high dynamic range video.

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP11169746 2011-06-14
EP11169746.2 2011-06-14

Publications (1)

Publication Number Publication Date
WO2012172460A1 true WO2012172460A1 (en) 2012-12-20

Family

ID=46397346

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2012/052873 WO2012172460A1 (en) 2011-06-14 2012-06-07 Graphics processing for high dynamic range video

Country Status (10)

Country Link
US (1) US9443495B2 (en)
EP (1) EP2721811B1 (en)
JP (2) JP6053767B2 (en)
CN (1) CN103597812B (en)
BR (1) BR112013031870B1 (en)
ES (1) ES2774219T3 (en)
MX (1) MX340266B (en)
PL (1) PL2721811T3 (en)
RU (1) RU2605435C2 (en)
WO (1) WO2012172460A1 (en)

Cited By (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014130213A1 (en) * 2013-02-21 2014-08-28 Dolby Laboratories Licensing Corporation Systems and methods for appearance mapping for compositing overlay graphics
JP2015141333A (en) * 2014-01-29 2015-08-03 キヤノン株式会社 Image processing apparatus, image processing method, display device, display device control method, and program
WO2015198552A1 (en) * 2014-06-25 2015-12-30 パナソニックＩｐマネジメント株式会社 Content data generating method, video stream transmission method and video display method
WO2015198560A1 (en) * 2014-06-27 2015-12-30 パナソニックＩｐマネジメント株式会社 Data output device, data output method, and data generation method
WO2016002154A1 (en) * 2014-06-30 2016-01-07 パナソニックＩｐマネジメント株式会社 Data reproduction method and reproduction device
CN105324987A (en) * 2013-06-24 2016-02-10 索尼公司 Playback device, playback method, and recording medium
WO2016027426A1 (en) * 2014-08-19 2016-02-25 パナソニックＩｐマネジメント株式会社 Video stream generation method, playback apparatus, and recording medium
WO2016027423A1 (en) * 2014-08-19 2016-02-25 パナソニックＩｐマネジメント株式会社 Transmission method, reproduction method and reproduction device
KR20160022305A (en) * 2013-06-20 2016-02-29 소니 주식회사 Reproduction device, reproduction method, and recording medium
KR20160022304A (en) * 2013-06-20 2016-02-29 소니 주식회사 Reproduction device, reproduction method, and recording medium
KR20160024856A (en) * 2013-06-24 2016-03-07 소니 주식회사 Playback device, playback method, and recording medium
KR20160024857A (en) * 2013-06-24 2016-03-07 소니 주식회사 Playback device, playback method, and recording medium
CN105409225A (en) * 2013-07-19 2016-03-16 皇家飞利浦有限公司 HDR metadata transport
WO2016038791A1 (en) * 2014-09-10 2016-03-17 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Recording medium, playback device, and playback method
WO2016039025A1 (en) * 2014-09-08 2016-03-17 ソニー株式会社 Information processing device, information recording medium, information processing method, and program
WO2016039170A1 (en) * 2014-09-12 2016-03-17 ソニー株式会社 Information processing device, information processing method, program, and recording medium
WO2016038811A1 (en) * 2014-09-12 2016-03-17 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Recording medium, playback device, and playback method
WO2016059760A1 (en) * 2014-10-17 2016-04-21 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Recording medium, reproduction method, and reproduction device
JP2016062637A (en) * 2014-09-12 2016-04-25 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Recording medium, reproduction apparatus and reproducing method
WO2016063746A1 (en) * 2014-10-23 2016-04-28 ソニー株式会社 Information processing device, information processing method, program, and recording medium
WO2016072051A1 (en) * 2014-11-04 2016-05-12 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Reproduction method, reproduction device, and program
WO2016125691A1 (en) * 2015-02-03 2016-08-11 ソニー株式会社 Transmitting device, transmitting method, receiving device, and receiving method
JPWO2014203869A1 (en) * 2013-06-21 2017-02-23 サターン ライセンシング エルエルシーＳａｔｕｒｎ Ｌｉｃｅｎｓｉｎｇ ＬＬＣ Transmitting apparatus, high dynamic range image data transmitting method, receiving apparatus, high dynamic range image data receiving method and program
JPWO2015174109A1 (en) * 2014-05-12 2017-04-20 ソニー株式会社 COMMUNICATION DEVICE, COMMUNICATION METHOD, AND COMPUTER PROGRAM
JP2017127028A (en) * 2014-06-10 2017-07-20 パナソニックＩｐマネジメント株式会社 Display device, conversion device, display method and computer program
JP2017134420A (en) * 2014-06-10 2017-08-03 パナソニックＩｐマネジメント株式会社 Reproduction device, reproduction method and computer program
EP3145206A4 (en) * 2014-05-15 2018-01-03 Sony Corporation Communication apparatus, communication method, and computer program
EP3249910A4 (en) * 2015-01-20 2018-01-03 Panasonic Intellectual Property Corporation of America Playback control method, playback device, and playback system
US10055866B2 (en) 2013-02-21 2018-08-21 Dolby Laboratories Licensing Corporation Systems and methods for appearance mapping for compositing overlay graphics
EP3249911A4 (en) * 2015-01-23 2018-08-29 Sony Corporation Reproducing device, information processing method, and program
EP3244410A4 (en) * 2015-01-09 2018-09-12 Sony Corporation Playback device, playback method, information processing device, information processing method, program, and recording medium
RU2671945C2 (en) * 2014-05-01 2018-11-08 Сони Корпорейшн Communication apparatus or communication method and computer program
JP2019097212A (en) * 2013-07-12 2019-06-20 ソニー株式会社 Reproduction device and reproduction method
US10334141B2 (en) 2017-05-25 2019-06-25 Denso International America, Inc. Vehicle camera system
JP2019216431A (en) * 2014-06-27 2019-12-19 パナソニックＩｐマネジメント株式会社 Display
JP2019216457A (en) * 2014-06-10 2019-12-19 パナソニックＩｐマネジメント株式会社 Display unit and display method
JP2019220968A (en) * 2014-06-30 2019-12-26 パナソニックＩｐマネジメント株式会社 Method performed in reproducing apparatus and reproducing apparatus
CN110675840A (en) * 2014-06-26 2020-01-10 松下知识产权经营株式会社 Display device and display method
JP2020022179A (en) * 2014-11-04 2020-02-06 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Reproduction method, program and reproducer
US10741211B2 (en) 2014-12-22 2020-08-11 Sony Corporation Information processing device, information recording medium, and information processing method
JP2022009684A (en) * 2014-05-16 2022-01-14 パナソニックＩｐマネジメント株式会社 Method and device for picture display
RU2767328C2 (en) * 2013-11-04 2022-03-17 Долби Лэборетериз Лайсенсинг Корпорейшн Single- and multi-modulator projection systems with global brightness control

Families Citing this family (47)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20150025214A (en) * 2013-08-28 2015-03-10 삼성전자주식회사 Method for displaying visual object on video, machine-readable storage medium and electronic device
US9584786B2 (en) * 2014-03-05 2017-02-28 Dolby Laboratories Licensing Corporation Graphics blending for high dynamic range video
CN105637861B (en) * 2014-03-17 2018-11-20 富士通株式会社 Code device, method and image processing equipment based on palette
EP3157251B1 (en) * 2014-06-16 2019-08-21 Panasonic Intellectual Property Management Co., Ltd. Playback method and playback apparatus
WO2016039169A1 (en) * 2014-09-12 2016-03-17 ソニー株式会社 Playback device, playback method, information processing device, information processing method, program, and recording medium
JP5995129B2 (en) * 2014-09-22 2016-09-21 パナソニックＩｐマネジメント株式会社 Reproduction method and reproduction apparatus
EP3219108A1 (en) 2014-11-10 2017-09-20 Koninklijke Philips N.V. Method for encoding, video processor, method for decoding, video decoder
JP2016100039A (en) 2014-11-17 2016-05-30 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Recording medium, playback method, and playback device
WO2016079925A1 (en) * 2014-11-17 2016-05-26 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Recording medium, playback method, and playback device
TW201633779A (en) 2014-12-16 2016-09-16 湯姆生特許公司 Method and device of converting a HDR version of a picture to a SDR version of said picture
KR102295970B1 (en) * 2015-02-06 2021-08-30 엘지전자 주식회사 Image display apparatus
WO2016132836A1 (en) * 2015-02-16 2016-08-25 ソニー株式会社 Information processing device, information recording medium and information processing method, and program
MX2017011816A (en) * 2015-03-24 2017-12-07 Sony Corp Transmission device, transmission method, reception device, and reception method.
WO2016158554A1 (en) * 2015-04-03 2016-10-06 ソニー株式会社 Information processing device, information recording medium, and information processing method and program
WO2017002541A1 (en) * 2015-06-30 2017-01-05 ソニー株式会社 Information processing device, information processing system, information recording medium, information processing method, and program
WO2017018333A1 (en) * 2015-07-24 2017-02-02 シャープ株式会社 Reception device, display control method, and program
JP6820507B2 (en) * 2015-09-14 2021-01-27 パナソニックＩｐマネジメント株式会社 Video receiving method, video transmitting method, video receiving device and video transmitting device
EP3352467A4 (en) * 2015-09-18 2019-05-15 Sharp Kabushiki Kaisha Reception device, reception method, and program
JP6616212B2 (en) * 2015-09-28 2019-12-04 マクセル株式会社 Display control method
CN113660520A (en) 2015-09-25 2021-11-16 麦克赛尔株式会社 Display device and display control method
WO2017051808A1 (en) 2015-09-25 2017-03-30 日立マクセル株式会社 Broadcast receiving device
JP6441247B2 (en) * 2015-10-01 2018-12-19 マクセル株式会社 Display control method
EP4258673A3 (en) * 2015-10-07 2023-12-13 Panasonic Intellectual Property Management Co., Ltd. Video transmission method, video reception method, video transmission device, and video reception device
JP6830190B2 (en) * 2015-10-07 2021-02-17 パナソニックＩｐマネジメント株式会社 Video transmission method, video reception method, video transmission device and video reception device
JP6519441B2 (en) * 2015-10-22 2019-05-29 ソニー株式会社 Transmission apparatus, transmission method, reception apparatus and reception method
WO2017080927A1 (en) * 2015-11-09 2017-05-18 Thomson Licensing Method and device for adapting the video content decoded from elementary streams to the characteristics of a display
JP6872098B2 (en) * 2015-11-12 2021-05-19 ソニーグループ株式会社 Information processing equipment, information recording media, information processing methods, and programs
CN105472255B (en) * 2015-12-30 2019-02-26 深圳Tcl数字技术有限公司 Video playing control method and device
WO2017127445A1 (en) * 2016-01-21 2017-07-27 Astral Images Corporation Processing image content for enabling high dynamic range (hdr) output thereof and computer-readable program product having such hdr content
JP2017169097A (en) * 2016-03-17 2017-09-21 シャープ株式会社 Receiving device, display control method, and program
JP6700908B2 (en) * 2016-03-30 2020-05-27 キヤノン株式会社 Display device and display method
US10757361B2 (en) * 2016-10-11 2020-08-25 Sony Corporation Transmission apparatus, transmission method, reception apparatus, and reception method
CN106686363B (en) * 2016-11-01 2019-08-09 青岛海信电器股份有限公司 Signal mixed processing method and device in display terminal
EP3389278B1 (en) * 2016-11-22 2022-10-12 Saturn Licensing, LLC Transmitting device, transmitting method, receiving device and receiving method
JP6957332B2 (en) * 2017-01-17 2021-11-02 キヤノン株式会社 Image processing device and image processing method
JP2018117281A (en) * 2017-01-19 2018-07-26 日本放送協会 Character superimposition synthesizer and program thereof
JP2018180335A (en) * 2017-04-14 2018-11-15 シャープ株式会社 Image display device, external device, image display method, and image display system
US11039045B2 (en) * 2017-07-14 2021-06-15 Panasonic Intellectual Property Management Co., Ltd. Video display system and video display method
KR102523672B1 (en) 2017-11-14 2023-04-20 삼성전자주식회사 Display apparatus, control method thereof and recording media
JP6625113B2 (en) * 2017-12-27 2019-12-25 キヤノン株式会社 Electronics
CN112075083B (en) 2018-06-25 2023-04-04 华为技术有限公司 Method and device for processing high dynamic range video containing subtitles
CN108924599A (en) 2018-06-29 2018-11-30 北京优酷科技有限公司 Video caption display methods and device
US10832389B2 (en) 2018-12-13 2020-11-10 Ati Technologies Ulc Method and system for improved visibility in blended layers for high dynamic range displays
JP6958645B2 (en) * 2019-04-25 2021-11-02 ソニーグループ株式会社 Transmitter, transmitter, receiver and receiver
US20220270538A1 (en) * 2019-10-18 2022-08-25 Hewlett-Packard Development Company, L.P. Display mode setting determinations
JP7418233B2 (en) 2020-02-13 2024-01-19 キヤノン株式会社 Display device, control method and program
CN111489705B (en) * 2020-04-14 2023-05-09 深圳市隆利科技股份有限公司 Method for image partition display

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0465102A2 (en) * 1990-06-27 1992-01-08 Texas Instruments Incorporated Palette devices selection of multiple pixel depths packing the entire width of the bus
US6580647B1 (en) 1999-08-27 2003-06-17 Sony Corporation Editing apparatus, editing method, and non-volatile memory
US20040067041A1 (en) 2002-10-02 2004-04-08 Seo Kang Soo Recording medium having a data structure for managing reproduction of graphic data and recording and reproducing methods and apparatuses
JP2007216021A (en) * 2007-02-13 2007-08-30 Olympus Corp Endoscopic signal processor
US20090103895A1 (en) 2005-01-28 2009-04-23 Matsushita Electric Industrial Co., Ltd. Reproduction device, program, reproduction method

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5309551A (en) * 1990-06-27 1994-05-03 Texas Instruments Incorporated Devices, systems and methods for palette pass-through mode
JP4103192B2 (en) * 1998-09-17 2008-06-18 ソニー株式会社 Editing system and editing method
JP4508330B2 (en) * 1999-01-25 2010-07-21 キヤノン株式会社 Display device
JP4348457B2 (en) * 2002-03-13 2009-10-21 ドルビー ラボラトリーズ ライセンシング コーポレイション High dynamic range display, display controller, and image display method
JP3833653B2 (en) * 2003-06-13 2006-10-18 シャープ株式会社 INFORMATION REPRODUCING DEVICE, INFORMATION REPRODUCING DEVICE CONTROL METHOD, CONTENT RECORDING MEDIUM, CONTROL PROGRAM, COMPUTER-READABLE RECORDING MEDIUM CONTAINING CONTROL PROGRAM
EP1641260A4 (en) 2003-06-30 2009-12-16 Panasonic Corp Recording medium, reproduction device, recording method, program, and reproduction method
US7142723B2 (en) * 2003-07-18 2006-11-28 Microsoft Corporation System and process for generating high dynamic range images from multiple exposures of a moving scene
JP2005250235A (en) * 2004-03-05 2005-09-15 Seiko Epson Corp Optical modulating device, optical display device, optical modulation control program, optical display device control program, optical modulation control method, and optical display device control method
JP4029852B2 (en) * 2004-03-23 2008-01-09 セイコーエプソン株式会社 Optical display device, optical display device control program, and optical display device control method
US8218625B2 (en) * 2004-04-23 2012-07-10 Dolby Laboratories Licensing Corporation Encoding, decoding and representing high dynamic range images
US20050243176A1 (en) * 2004-04-30 2005-11-03 James Wu Method of HDR image processing and manipulation
JP3938774B2 (en) * 2004-08-05 2007-06-27 オリンパス株式会社 Endoscope signal processing apparatus, endoscope signal monitor, and endoscope system
CN100492152C (en) * 2004-08-23 2009-05-27 英华达股份有限公司 Method for changing one high dynamic-range image into a lower dynamic range image and apparatus thereof
US8050512B2 (en) 2004-11-16 2011-11-01 Sharp Laboratories Of America, Inc. High dynamic range images from low dynamic range images
JP4379408B2 (en) * 2004-12-07 2009-12-09 セイコーエプソン株式会社 Signal processing unit and imaging apparatus
JP2007206343A (en) * 2006-02-01 2007-08-16 Seiko Epson Corp Optical display device and method
WO2008020399A1 (en) 2006-08-17 2008-02-21 Koninklijke Philips Electronics N.V. Display device
US8111941B2 (en) * 2006-11-22 2012-02-07 Nik Software, Inc. Method for dynamic range editing
CN101193202A (en) * 2006-12-22 2008-06-04 陈珉 Method for display highly dynamic image on the traditional output device
CN101082992A (en) * 2007-07-06 2007-12-05 浙江大学 Drawing of real time high dynamic range image and display process
US8233738B2 (en) * 2007-07-30 2012-07-31 Dolby Laboratories Licensing Corporation Enhancing dynamic ranges of images
KR20090098247A (en) * 2008-03-13 2009-09-17 삼성전자주식회사 Image processing apparatus, image processing system having image processing apparatus and control method thereof
EP2144444B1 (en) 2008-07-10 2012-06-27 The University Of Warwick HDR video data compression devices and methods
EP2230839A1 (en) * 2009-03-17 2010-09-22 Koninklijke Philips Electronics N.V. Presentation of video content
JP5317825B2 (en) * 2009-05-18 2013-10-16 キヤノン株式会社 Image processing apparatus and image processing method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0465102A2 (en) * 1990-06-27 1992-01-08 Texas Instruments Incorporated Palette devices selection of multiple pixel depths packing the entire width of the bus
US6580647B1 (en) 1999-08-27 2003-06-17 Sony Corporation Editing apparatus, editing method, and non-volatile memory
US20040067041A1 (en) 2002-10-02 2004-04-08 Seo Kang Soo Recording medium having a data structure for managing reproduction of graphic data and recording and reproducing methods and apparatuses
US20090103895A1 (en) 2005-01-28 2009-04-23 Matsushita Electric Industrial Co., Ltd. Reproduction device, program, reproduction method
JP2007216021A (en) * 2007-02-13 2007-08-30 Olympus Corp Endoscopic signal processor

Cited By (158)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101993593B1 (en) * 2013-02-21 2019-06-28 돌비 레버러토리즈 라이쎈싱 코오포레이션 Systems and methods for appearance mapping for compositing overlay graphics
JP2019033531A (en) * 2013-02-21 2019-02-28 ドルビー ラボラトリーズ ライセンシング コーポレイション System and method for appearance mapping for compositing overlay graphic
KR20150108911A (en) * 2013-02-21 2015-09-30 돌비 레버러토리즈 라이쎈싱 코오포레이션 Systems and methods for appearance mapping for compositing overlay graphics
CN105009567A (en) * 2013-02-21 2015-10-28 杜比实验室特许公司 Systems and methods for appearance mapping for compositing overlay graphics
KR20190052173A (en) * 2013-02-21 2019-05-15 돌비 레버러토리즈 라이쎈싱 코오포레이션 Systems and methods for appearance mapping for compositing overlay graphics
US10055866B2 (en) 2013-02-21 2018-08-21 Dolby Laboratories Licensing Corporation Systems and methods for appearance mapping for compositing overlay graphics
KR101978935B1 (en) * 2013-02-21 2019-05-16 돌비 레버러토리즈 라이쎈싱 코오포레이션 Systems and methods for appearance mapping for compositing overlay graphics
JP2017127007A (en) * 2013-02-21 2017-07-20 ドルビー ラボラトリーズ ライセンシング コーポレイション System and apparatus for appearance mapping for compositing overlay graphics
CN105009567B (en) * 2013-02-21 2018-06-08 杜比实验室特许公司 For synthesizing the system and method for the appearance of superposed graph mapping
WO2014130213A1 (en) * 2013-02-21 2014-08-28 Dolby Laboratories Licensing Corporation Systems and methods for appearance mapping for compositing overlay graphics
EP3783883A1 (en) * 2013-02-21 2021-02-24 Dolby Laboratories Licensing Corp. Systems and methods for appearance mapping for compositing overlay graphics
US10977849B2 (en) 2013-02-21 2021-04-13 Dolby Laboratories Licensing Corporation Systems and methods for appearance mapping for compositing overlay graphics
JP2020043586A (en) * 2013-02-21 2020-03-19 ドルビー ラボラトリーズ ライセンシング コーポレイション System and device of appearance mapping for overlay graphics synthesis
KR20170039764A (en) * 2013-02-21 2017-04-11 돌비 레버러토리즈 라이쎈싱 코오포레이션 Systems and methods for appearance mapping for compositing overlay graphics
KR101724312B1 (en) * 2013-02-21 2017-04-07 돌비 레버러토리즈 라이쎈싱 코오포레이션 Systems and methods for appearance mapping for compositing overlay graphics
JP2016515327A (en) * 2013-02-21 2016-05-26 ドルビー ラボラトリーズ ライセンシング コーポレイション Appearance mapping system and apparatus for overlay graphics synthesis
US10497162B2 (en) 2013-02-21 2019-12-03 Dolby Laboratories Licensing Corporation Systems and methods for appearance mapping for compositing overlay graphics
KR20160022304A (en) * 2013-06-20 2016-02-29 소니 주식회사 Reproduction device, reproduction method, and recording medium
US11089260B2 (en) 2013-06-20 2021-08-10 Saturn Licensing Llc Reproduction device, reproduction method, and recording medium
US11516428B2 (en) 2013-06-20 2022-11-29 Saturn Licensing Llc Reproduction device, reproduction method, and recording medium
CN110033795A (en) * 2013-06-20 2019-07-19 索尼公司 Display device
US10951909B2 (en) 2013-06-20 2021-03-16 Saturn Licensing Llc Reproduction device reproduction method, and recording medium
KR20160022305A (en) * 2013-06-20 2016-02-29 소니 주식회사 Reproduction device, reproduction method, and recording medium
US11812046B2 (en) 2013-06-20 2023-11-07 Saturn Licensing Llc Reproduction device reproduction method, and recording medium
KR102294106B1 (en) * 2013-06-20 2021-08-27 소니그룹주식회사 Reproduction device, reproduction method, and recording medium
KR102266224B1 (en) * 2013-06-20 2021-06-18 소니그룹주식회사 Reproduction device, reproduction method, and recording medium
JPWO2014203869A1 (en) * 2013-06-21 2017-02-23 サターン ライセンシング エルエルシーＳａｔｕｒｎ Ｌｉｃｅｎｓｉｎｇ ＬＬＣ Transmitting apparatus, high dynamic range image data transmitting method, receiving apparatus, high dynamic range image data receiving method and program
CN105324987B (en) * 2013-06-24 2019-12-24 索尼公司 Reproducing apparatus, reproducing method, and recording medium
KR20160023674A (en) * 2013-06-24 2016-03-03 소니 주식회사 Playback device, playback method, and recording medium
CN110798641B (en) * 2013-06-24 2022-05-17 索尼公司 Reproducing apparatus, reproducing method, and recording medium
KR102246838B1 (en) * 2013-06-24 2021-04-30 소니 주식회사 Playback device, playback method, and recording medium
CN105324987A (en) * 2013-06-24 2016-02-10 索尼公司 Playback device, playback method, and recording medium
KR20160024857A (en) * 2013-06-24 2016-03-07 소니 주식회사 Playback device, playback method, and recording medium
KR20160024856A (en) * 2013-06-24 2016-03-07 소니 주식회사 Playback device, playback method, and recording medium
KR102225977B1 (en) * 2013-06-24 2021-03-10 소니 주식회사 Playback device, playback method, and recording medium
CN110798641A (en) * 2013-06-24 2020-02-14 索尼公司 Reproducing apparatus, reproducing method, and recording medium
KR102249202B1 (en) * 2013-06-24 2021-05-10 소니 주식회사 Playback device, playback method, and recording medium
US10880532B2 (en) 2013-06-24 2020-12-29 Sony Corporation Reproduction device, reproduction method, and recording medium
JP2019097212A (en) * 2013-07-12 2019-06-20 ソニー株式会社 Reproduction device and reproduction method
CN105409225B (en) * 2013-07-19 2019-09-17 皇家飞利浦有限公司 The transmission of HDR metadata
RU2654049C2 (en) * 2013-07-19 2018-05-16 Конинклейке Филипс Н.В. Transportation of hdr metadata
US10515667B2 (en) 2013-07-19 2019-12-24 Koninklijke Philips N.V. HDR metadata transport
CN105409225A (en) * 2013-07-19 2016-03-16 皇家飞利浦有限公司 HDR metadata transport
EP3022935A1 (en) * 2013-07-19 2016-05-25 Koninklijke Philips N.V. Hdr metadata transport
JP2016528800A (en) * 2013-07-19 2016-09-15 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． HDR metadata transfer
RU2767328C2 (en) * 2013-11-04 2022-03-17 Долби Лэборетериз Лайсенсинг Корпорейшн Single- and multi-modulator projection systems with global brightness control
JP2015141333A (en) * 2014-01-29 2015-08-03 キヤノン株式会社 Image processing apparatus, image processing method, display device, display device control method, and program
RU2671945C2 (en) * 2014-05-01 2018-11-08 Сони Корпорейшн Communication apparatus or communication method and computer program
JPWO2015174109A1 (en) * 2014-05-12 2017-04-20 ソニー株式会社 COMMUNICATION DEVICE, COMMUNICATION METHOD, AND COMPUTER PROGRAM
EP3145207A4 (en) * 2014-05-12 2017-11-08 Sony Corporation Communication apparatus, communication method, and computer program
RU2670599C9 (en) * 2014-05-12 2018-11-22 Сони Корпорейшн Communication device, method for communication and computer program
RU2670599C2 (en) * 2014-05-12 2018-10-24 Сони Корпорейшн Communication device, method for communication and computer program
JP2019075824A (en) * 2014-05-12 2019-05-16 ソニー株式会社 Communication device and communication method, and computer program
RU2669431C2 (en) * 2014-05-15 2018-10-12 Сони Корпорейшн Communication device, method for communication and computer program
EP3145206A4 (en) * 2014-05-15 2018-01-03 Sony Corporation Communication apparatus, communication method, and computer program
JP2022009684A (en) * 2014-05-16 2022-01-14 パナソニックＩｐマネジメント株式会社 Method and device for picture display
JP2017169206A (en) * 2014-06-10 2017-09-21 パナソニックＩｐマネジメント株式会社 Display device, conversion device, display method and computer program
JP2017169205A (en) * 2014-06-10 2017-09-21 パナソニックＩｐマネジメント株式会社 Display device, conversion device, display method and computer program
JP2017127028A (en) * 2014-06-10 2017-07-20 パナソニックＩｐマネジメント株式会社 Display device, conversion device, display method and computer program
JP2017134420A (en) * 2014-06-10 2017-08-03 パナソニックＩｐマネジメント株式会社 Reproduction device, reproduction method and computer program
JP2017134421A (en) * 2014-06-10 2017-08-03 パナソニックＩｐマネジメント株式会社 Reproduction device, reproduction method and computer program
JP2019216457A (en) * 2014-06-10 2019-12-19 パナソニックＩｐマネジメント株式会社 Display unit and display method
WO2015198552A1 (en) * 2014-06-25 2015-12-30 パナソニックＩｐマネジメント株式会社 Content data generating method, video stream transmission method and video display method
CN110675840A (en) * 2014-06-26 2020-01-10 松下知识产权经营株式会社 Display device and display method
CN111901599A (en) * 2014-06-27 2020-11-06 松下知识产权经营株式会社 Reproducing apparatus
JP2019216431A (en) * 2014-06-27 2019-12-19 パナソニックＩｐマネジメント株式会社 Display
JP2021153299A (en) * 2014-06-27 2021-09-30 パナソニックＩｐマネジメント株式会社 Playback unit
JP7170236B2 (en) 2014-06-27 2022-11-14 パナソニックＩｐマネジメント株式会社 playback device
WO2015198560A1 (en) * 2014-06-27 2015-12-30 パナソニックＩｐマネジメント株式会社 Data output device, data output method, and data generation method
JPWO2015198560A1 (en) * 2014-06-27 2017-04-20 パナソニックＩｐマネジメント株式会社 Data output device, data output method, and data generation method
US10171812B2 (en) 2014-06-27 2019-01-01 Panasonic Intellectual Property Management Co., Ltd. Data output apparatus, data output method, and data generation method
CN105393549A (en) * 2014-06-27 2016-03-09 松下知识产权经营株式会社 Data output device, data output method, and data generation method
US10582177B2 (en) 2014-06-30 2020-03-03 Panasonic Intellectual Property Management Co., Ltd. Playback method according to function of playback device
WO2016002154A1 (en) * 2014-06-30 2016-01-07 パナソニックＩｐマネジメント株式会社 Data reproduction method and reproduction device
JP2017200186A (en) * 2014-06-30 2017-11-02 パナソニックＩｐマネジメント株式会社 Reproduction device, reproduction method, and computer program
JP2019220968A (en) * 2014-06-30 2019-12-26 パナソニックＩｐマネジメント株式会社 Method performed in reproducing apparatus and reproducing apparatus
JP2017184253A (en) * 2014-06-30 2017-10-05 パナソニックＩｐマネジメント株式会社 Display device, conversion device, display method, and computer program
JPWO2016002154A1 (en) * 2014-06-30 2017-04-27 パナソニックＩｐマネジメント株式会社 Data reproducing method and reproducing apparatus
WO2016027423A1 (en) * 2014-08-19 2016-02-25 パナソニックＩｐマネジメント株式会社 Transmission method, reproduction method and reproduction device
WO2016027426A1 (en) * 2014-08-19 2016-02-25 パナソニックＩｐマネジメント株式会社 Video stream generation method, playback apparatus, and recording medium
JPWO2016027423A1 (en) * 2014-08-19 2017-06-01 パナソニックＩｐマネジメント株式会社 Transmission method, reproduction method, and reproduction apparatus
EP3193333A4 (en) * 2014-09-08 2018-05-02 Sony Corporation Information processing device, information recording medium, information processing method, and program
WO2016039025A1 (en) * 2014-09-08 2016-03-17 ソニー株式会社 Information processing device, information recording medium, information processing method, and program
JP2017139052A (en) * 2014-09-08 2017-08-10 ソニー株式会社 Information processing device, information recording medium, information processing method, and program
JPWO2016039025A1 (en) * 2014-09-08 2017-06-01 ソニー株式会社 Information processing apparatus, information recording medium, information processing method, and program
JPWO2016038791A1 (en) * 2014-09-10 2017-06-22 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Recording medium, reproducing apparatus and reproducing method
US10057557B2 (en) 2014-09-10 2018-08-21 Panasonic Intellectual Property Corporation Of America Recording medium, playback device, and playback method
US10687038B2 (en) 2014-09-10 2020-06-16 Panasonic Intellectual Property Corporation Of America Recording medium, playback device, and playback method
WO2016038791A1 (en) * 2014-09-10 2016-03-17 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Recording medium, playback device, and playback method
EP3370233A1 (en) * 2014-09-10 2018-09-05 Panasonic Intellectual Property Corporation of America Recording medium, playback device, and playback method
US10264232B2 (en) 2014-09-10 2019-04-16 Panasonic Intellectual Property Corporation Of America Recording medium, playback device, and playback method
JP2017182874A (en) * 2014-09-10 2017-10-05 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Playback device
JP2017152073A (en) * 2014-09-10 2017-08-31 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Playback method and device
JP2017182875A (en) * 2014-09-10 2017-10-05 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Reproduction method and reproduction device
CN111212251B (en) * 2014-09-10 2022-05-27 松下电器（美国）知识产权公司 Reproduction device and reproduction method
JP2017182873A (en) * 2014-09-10 2017-10-05 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Recording medium
US11128852B2 (en) 2014-09-10 2021-09-21 Panasonic Intellectual Property Corporation Of America Recording medium, playback device, and playback method
JP2017184263A (en) * 2014-09-10 2017-10-05 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Playback device
CN111212251A (en) * 2014-09-10 2020-05-29 松下电器（美国）知识产权公司 Reproduction device and reproduction method
JP2017182872A (en) * 2014-09-10 2017-10-05 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Reproduction device
US10432906B2 (en) 2014-09-10 2019-10-01 Panasonic Intellectual Property Corporation Of America Recording medium, playback device, and playback method
JP2017192137A (en) * 2014-09-12 2017-10-19 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Reproduction device and reproduction method
JP2017158213A (en) * 2014-09-12 2017-09-07 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Reproduction device and reproduction method
JP2017191630A (en) * 2014-09-12 2017-10-19 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Reproduction apparatus and reproduction method
JP2017158214A (en) * 2014-09-12 2017-09-07 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Recording medium
JP2017188938A (en) * 2014-09-12 2017-10-12 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Recording medium
US10362287B2 (en) 2014-09-12 2019-07-23 Sony Corporation Information processing apparatus, information processing method and program, and recording medium
JPWO2016039170A1 (en) * 2014-09-12 2017-06-22 ソニー株式会社 Information processing apparatus, information processing method, program, and recording medium
JP2016062637A (en) * 2014-09-12 2016-04-25 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Recording medium, reproduction apparatus and reproducing method
WO2016038811A1 (en) * 2014-09-12 2016-03-17 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Recording medium, playback device, and playback method
WO2016039170A1 (en) * 2014-09-12 2016-03-17 ソニー株式会社 Information processing device, information processing method, program, and recording medium
JP2017162541A (en) * 2014-09-12 2017-09-14 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Playback device and playback method
EP4280598A3 (en) * 2014-09-12 2024-02-21 Panasonic Intellectual Property Corporation of America Recording medium, playback device, and playback method
US10679664B2 (en) 2014-10-17 2020-06-09 Panasonic Intellectual Property Corporation Of America Recording medium, playback method, and playback device
CN111798880A (en) * 2014-10-17 2020-10-20 松下电器（美国）知识产权公司 Recording medium, reproduction method, and reproduction apparatus
US10026440B2 (en) 2014-10-17 2018-07-17 Panasonic Intellectual Property Corporation Of America Recording medium, playback method, and playback device
JP2017168180A (en) * 2014-10-17 2017-09-21 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Reproducing method and reproduction apparatus
JP2017168181A (en) * 2014-10-17 2017-09-21 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Record medium
JP7139543B1 (en) 2014-10-17 2022-09-20 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Playback device and playback method
JP2017168182A (en) * 2014-10-17 2017-09-21 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Reproducing method and reproduction apparatus
JP2022136168A (en) * 2014-10-17 2022-09-15 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Regeneration device, and regeneration method
JP7113107B2 (en) 2014-10-17 2022-08-04 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Playback device and playback method
US10679663B2 (en) 2014-10-17 2020-06-09 Panasonic Intellectual Property Corporation Of America Recording medium, playback method, and playback device
US11386930B2 (en) 2014-10-17 2022-07-12 Panasonic Intellectual Property Corporation Of America Recording medium, playback method, and playback device
JP2020098661A (en) * 2014-10-17 2020-06-25 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Reproduction device and reproduction method
JP2019079591A (en) * 2014-10-17 2019-05-23 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Reproduction device and reproduction method
JP2021090215A (en) * 2014-10-17 2021-06-10 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Regeneration device, and regeneration method
JP2017162544A (en) * 2014-10-17 2017-09-14 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Reproducing method and reproduction apparatus
US10867631B2 (en) 2014-10-17 2020-12-15 Panasonic Intellectual Property Corporation Of America Recording medium, playback method, and playback device
EP3594949A1 (en) * 2014-10-17 2020-01-15 Panasonic Intellectual Property Corporation of America Recording medium, playback method, and playback device
US10902881B2 (en) 2014-10-17 2021-01-26 Panasonic Intellectual Property Corporation Of America Recording medium, playback method, and playback device
JP2017191632A (en) * 2014-10-17 2017-10-19 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Record medium
WO2016059760A1 (en) * 2014-10-17 2016-04-21 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Recording medium, reproduction method, and reproduction device
EP3208802B1 (en) * 2014-10-17 2019-09-25 Panasonic Intellectual Property Corporation of America Recording medium, reproduction method, and reproduction device
US11328748B2 (en) 2014-10-17 2022-05-10 Panasonic Intellectual Property Corporation Of America Recording medium, playback method, and playback device
US10418060B2 (en) 2014-10-17 2019-09-17 Panasonic Intellectual Property Corporation Of America Recording medium, playback method, and playback device
JP2018014158A (en) * 2014-10-17 2018-01-25 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Record medium, reproducing method and reproduction apparatus
US10998000B2 (en) 2014-10-17 2021-05-04 Panasonic Intellectual Property Corporation Of America Recording medium, playback method, and playback device
JP2016081553A (en) * 2014-10-17 2016-05-16 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Record medium, reproducing method and reproduction apparatus
JPWO2016063746A1 (en) * 2014-10-23 2017-08-03 ソニー株式会社 Information processing apparatus, information processing method, program, and recording medium
WO2016063746A1 (en) * 2014-10-23 2016-04-28 ソニー株式会社 Information processing device, information processing method, program, and recording medium
US10944951B2 (en) 2014-10-23 2021-03-09 Sony Corporation Information processing apparatus, information processing method, and a recording medium
WO2016072051A1 (en) * 2014-11-04 2016-05-12 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Reproduction method, reproduction device, and program
CN106464828A (en) * 2014-11-04 2017-02-22 松下电器（美国）知识产权公司 Reproduction method, reproduction device, and program
JP2020022179A (en) * 2014-11-04 2020-02-06 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Reproduction method, program and reproducer
CN106464828B (en) * 2014-11-04 2020-03-13 松下电器（美国）知识产权公司 Reproducing method, reproducing apparatus, and recording medium
JPWO2016072051A1 (en) * 2014-11-04 2017-08-31 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ REPRODUCTION METHOD, REPRODUCTION DEVICE, AND PROGRAM
US10116908B2 (en) 2014-11-04 2018-10-30 Panasonic Intellectual Property Corporation Of America Playback method, playback device, and non-transitory computer-readable recording medium storing program
US10741211B2 (en) 2014-12-22 2020-08-11 Sony Corporation Information processing device, information recording medium, and information processing method
US10554944B2 (en) 2015-01-09 2020-02-04 Sony Corporation Playing apparatus, playing method, information processing apparatus, and information processing method
EP3244410A4 (en) * 2015-01-09 2018-09-12 Sony Corporation Playback device, playback method, information processing device, information processing method, program, and recording medium
EP3249910A4 (en) * 2015-01-20 2018-01-03 Panasonic Intellectual Property Corporation of America Playback control method, playback device, and playback system
US10210909B2 (en) 2015-01-20 2019-02-19 Panasonic Intellectual Property Corporation Of America Computer implemented method for use in a play back apparatus
US10547821B2 (en) 2015-01-23 2020-01-28 Sony Corporation Reproduction apparatus and information processing method
EP3249911A4 (en) * 2015-01-23 2018-08-29 Sony Corporation Reproducing device, information processing method, and program
US10542304B2 (en) 2015-02-03 2020-01-21 Sony Corporation Transmission device, transmission method, reception device, and reception method
WO2016125691A1 (en) * 2015-02-03 2016-08-11 ソニー株式会社 Transmitting device, transmitting method, receiving device, and receiving method
US10334141B2 (en) 2017-05-25 2019-06-25 Denso International America, Inc. Vehicle camera system

Also Published As

Publication number Publication date
US20140125696A1 (en) 2014-05-08
BR112013031870B1 (en) 2022-05-10
CN103597812A (en) 2014-02-19
RU2014100893A (en) 2015-07-20
JP2017085587A (en) 2017-05-18
EP2721811A1 (en) 2014-04-23
ES2774219T3 (en) 2020-07-17
JP2014528182A (en) 2014-10-23
JP6053767B2 (en) 2016-12-27
EP2721811B1 (en) 2019-12-25
MX2013014545A (en) 2014-02-19
CN103597812B (en) 2017-11-21
RU2605435C2 (en) 2016-12-20
JP6279694B2 (en) 2018-02-14
US9443495B2 (en) 2016-09-13
BR112013031870A2 (en) 2016-12-13
PL2721811T3 (en) 2020-06-01
MX340266B (en) 2016-07-04

Similar Documents

Publication Publication Date Title
EP2721811B1 (en) Graphics processing for high dynamic range video
JP6566320B2 (en) Data output device and data output method
JP6512458B2 (en) Data reproduction method and reproduction apparatus
JP6566271B2 (en) Transmission method and playback apparatus
JP6419807B2 (en) HDR metadata transfer
TWI528825B (en) 3d mode selection mechanism for video playback
US8576338B2 (en) Device and method for processing video data
US8237741B2 (en) Image processing apparatus, image processing method, and image processing program
WO2015198552A1 (en) Content data generating method, video stream transmission method and video display method
JP6731627B2 (en) Method Performed on Playback Device and Playback Device
JP6928885B2 (en) Display device, display method and computer program
JP6751893B2 (en) Reproduction method, reproduction device, display method and display device
CN111345034B (en) Reproduction device, reproduction method, program, and recording medium
JP2021153299A (en) Playback unit
WO2006018786A1 (en) Method of storing and transferring image signals

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12730652

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2012730652

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2014515315

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: MX/A/2013/014545

Country of ref document: MX

WWE Wipo information: entry into national phase

Ref document number: 14125319

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2014100893

Country of ref document: RU

Kind code of ref document: A

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112013031870

Country of ref document: BR

ENP Entry into the national phase

Ref document number: 112013031870

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20131211