WO2015005189A1 - 再生装置、再生方法、および記録媒体 - Google Patents
再生装置、再生方法、および記録媒体 Download PDFInfo
- Publication number
- WO2015005189A1 WO2015005189A1 PCT/JP2014/067645 JP2014067645W WO2015005189A1 WO 2015005189 A1 WO2015005189 A1 WO 2015005189A1 JP 2014067645 W JP2014067645 W JP 2014067645W WO 2015005189 A1 WO2015005189 A1 WO 2015005189A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- video
- luminance
- graphics
- hdr
- data
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
- H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/10—Digital recording or reproducing
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
- G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
- G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
- G11B27/32—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N11/00—Colour television systems
- H04N11/24—High-definition television systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
- H04N21/4854—End-user interface for client configuration for modifying image parameters, e.g. image brightness, contrast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
- H04N9/646—Circuits for processing colour signals for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B2220/00—Record carriers by type
- G11B2220/20—Disc-shaped record carriers
- G11B2220/25—Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
- G11B2220/2537—Optical discs
- G11B2220/2541—Blu-ray discs; Blue laser DVR discs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
- H04N9/67—Circuits for processing colour signals for matrixing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
- H04N9/68—Circuits for processing colour signals for controlling the amplitude of colour signals, e.g. automatic chroma control circuits
- H04N9/69—Circuits for processing colour signals for controlling the amplitude of colour signals, e.g. automatic chroma control circuits for modifying the colour signals by gamma correction
Definitions
- the present technology relates to a playback device, a playback method, and a recording medium, and in particular, a playback device, a playback method, and a recording that can display graphics with appropriate brightness on a video with a wide dynamic dynamic range. It relates to the medium.
- BD Blu-ray (registered trademark) Disc
- the master video was taken with a high-quality camera and has a dynamic range that is greater than the dynamic range that can be displayed on a standard luminance monitor. By compressing, the dynamic range of the master video is naturally lost.
- monitors that are brighter than the standard, such as 500 nit and 1000 nit, are on the market. There is a demand for content that makes use of the performance of a monitor having such a wide dynamic range.
- BD it is possible to display graphics such as subtitles overlaid on the video, but if the video with a wide dynamic range is superimposed on the video with a wide dynamic range, the graphics are difficult to see. There is a possibility.
- the present technology has been made in view of such a situation, and makes it possible to display graphics with appropriate brightness on a video having a wide dynamic range of luminance.
- a playback device includes encoded data of extended video, which is a video having a second luminance range wider than the first luminance range, luminance characteristic information indicating luminance characteristics of the extended video, and the extended
- a read unit that reads out the encoded data, the luminance characteristic information, and the graphics data from a recording medium that records the graphic data of the first luminance range to be superimposed on the video; and the encoded data
- a first decoding unit that decodes the graphics data, a second decoding unit that decodes the graphics data, and the first pixel value of the graphics obtained by the decoding in terms of the luminance characteristics of the graphics
- the display device capable of displaying the extended video may further include an output unit that outputs the extended video data synthesized with the graphics and the luminance characteristic information.
- the reading unit further reads the luminance conversion definition information recorded in the recording medium and used for luminance conversion from the extended video to the standard video.
- the conversion unit can convert the extended video into the standard video based on the luminance conversion definition information read from the recording medium.
- the synthesizing unit can synthesize the standard video and the graphics of the first pixel value.
- An output unit for outputting the standard video data obtained by synthesizing the graphics can be further provided for a display device that cannot display the extended video.
- the luminance characteristic information and the luminance conversion definition information may be inserted into the stream including the encoded data as auxiliary information of the encoded data and recorded on the recording medium.
- the encoded data may be HEVC encoded data, and the luminance characteristic information and the luminance conversion definition information may be SEI of the HEVC stream.
- the extended video encoded data that is a video having a second luminance range wider than the first luminance range, luminance characteristic information indicating the luminance characteristics of the extended video, and the extended video
- the encoded data, the luminance characteristic information, and the graphics data are read from the recording medium on which the graphic data of the first luminance range to be superimposed is recorded, and the encoded data is decoded.
- the graphics data is decoded, and the first pixel value of the graphics obtained by decoding shows the same luminance as the luminance indicated by the first pixel value on the luminance characteristic of the graphics.
- the extended video obtained by decoding the encoded data after being converted into the second pixel value on the luminance characteristic of the extended video represented by the luminance characteristic information. When the graphics of the second pixel value are combined.
- a playback device is a standard that is a video in the first luminance range obtained by performing luminance conversion of an extended video that is a video in a second luminance range wider than the first luminance range.
- a first decoding unit for decoding data, and the standard video obtained by decoding the encoded data is converted to the extended video based on the luminance conversion definition information.
- the display device capable of displaying the extended video may further include an output unit that outputs the extended video data synthesized with the graphics and the luminance characteristic information.
- the synthesizing unit can synthesize the standard video obtained by decoding the encoded data and the graphics of the first pixel value.
- An output unit for outputting the standard video data obtained by synthesizing the graphics can be further provided for a display device that cannot display the extended video.
- the luminance characteristic information and the luminance conversion definition information can be inserted into the stream including the encoded data as auxiliary information of the encoded data and recorded on the recording medium.
- the encoded data may be HEVC encoded data, and the luminance characteristic information and the luminance conversion definition information may be SEI of the HEVC stream.
- a standard video that is a video in the first luminance range obtained by performing luminance conversion of an extended video that is a video in a second luminance range wider than the first luminance range.
- the encoded data, the luminance characteristic information, the luminance conversion definition information, and the graphics data are read from a recording medium on which graphics data in the first luminance range is recorded. Further, the encoded data is decoded, and the standard video obtained by decoding the encoded data is converted into the extended video based on the luminance conversion definition information.
- the graphics data is decoded, and the first pixel value of the graphics obtained by decoding the graphics data is the first pixel value in terms of the luminance characteristics of the graphics.
- the extended video obtained by converting the standard video, converted to a second pixel value on the luminance characteristics of the extended video represented by the luminance characteristic information, showing the same luminance as The graphics of the second pixel value is synthesized.
- FIG. 1 is a diagram illustrating a configuration example of a recording / reproducing system according to an embodiment of the present technology. It is a figure which shows the example of the signal processing of the video in mode-i. It is a figure which shows the flow of the signal of the video processed in mode-i. It is a figure which shows the example of the signal processing of the video in mode-ii. It is a figure which shows the flow of the signal of the video processed in mode-ii. It is a figure which shows the structure of the access unit of HEVC. It is a figure which shows the syntax of Tone mapping information. It is a figure which shows the example of the information used as tone mapping definition information and HDR information.
- FIG. 1 It is a figure which shows the example of the production
- FIG. 25 is a diagram illustrating the syntax of ProgramInfo () of FIG. 24. It is a figure which shows the syntax of StreamCodingInfo of FIG. It is a block diagram which shows the structural example of a recording device. It is a figure which shows the structural example of PG stream and IG stream. It is a block diagram which shows the structural example of the video encoding process part of FIG. It is a figure which shows the example of the signal processing by a HDR-STD conversion part. It is a figure which shows the example of tone mapping. It is a block diagram which shows the structural example of the reproducing
- FIG. 33 is a block diagram illustrating a configuration example of a graphics processing unit in FIG. 32. It is a block diagram which shows the structural example of a display apparatus. It is a flowchart explaining the recording process of a recording device. It is a flowchart explaining the encoding process by mode-i performed in step S2 of FIG. It is a flowchart explaining the encoding process in mode-ii performed in step S3 of FIG. It is a flowchart explaining the Data Base information generation process performed in step S4 of FIG. It is a flowchart explaining the reproduction
- FIG. 10 is a diagram illustrating an example of processing for generating graphics for HDR synthesis based on BD-J graphics. It is a figure which shows the example of a synthetic
- FIG. 10 is a block diagram illustrating another configuration example of the recording apparatus.
- FIG. 38 is a block diagram illustrating another configuration example of the playback device. It is a block diagram which shows the other structural example of a graphics process part.
- FIG. 10 is a diagram illustrating an example of processing for generating HDR synthesis graphics by performing CLUT processing. It is a block diagram which shows the structure of the graphics process part which processes a CLUT.
- FIG. 44 is a flowchart for describing another HDR synthesis graphics generation process performed in step S65 of FIG. 42 or step S86 of FIG. 43.
- FIG. It is a figure which shows the concept of allocation of a pixel value. It is a block diagram which shows the structural example of a computer.
- FIG. 1 is a diagram illustrating a configuration example of a recording / reproducing system according to an embodiment of the present technology.
- the recording / reproducing system in FIG. 1 includes a recording device 1, a reproducing device 2, and a display device 3.
- the playback device 2 and the display device 3 are connected via an HDMI (registered trademark) (High Definition Multimedia Interface) cable 4.
- the playback device 2 and the display device 3 may be connected via a cable of another standard, or may be connected via wireless communication.
- Recording device 1 records content, and playback device 2 plays back the content.
- Content is provided from the recording device 1 to the playback device 2 using the optical disc 11.
- the optical disc 11 is a disc on which content is recorded, for example, in a BD-ROM (Blu-ray (registered trademark) Disc Read-Only) format.
- Recording content on the optical disc 11 may be performed in other formats such as BD-R and -RE.
- provision of content from the recording device 1 to the playback device 2 may be performed using a removable medium other than the optical disk, such as a memory card equipped with a flash memory.
- the recording device 1 is, for example, a device used by a content author. In the following description, it is assumed that the optical disc 11 on which content is recorded by the recording device 1 is provided to the playback device 2 in practice. Then, the optical disc 11 as one of them is provided to the playback device 2.
- An HDR (High Dynamic Range) video that is a video having a dynamic range greater than or equal to a dynamic range (luminance range) that can be displayed on a standard luminance monitor is input to the recording apparatus 1.
- the recording device 1 records the input master HDR video on the optical disc 11 as an HDR video, that is, as a video having a dynamic range higher than the dynamic range that can be displayed on a monitor having a standard luminance.
- information indicating the luminance characteristics of the master HDR video and information used when converting the HDR video into the STD video are also recorded on the optical disc 11.
- STD video (standard video) is a dynamic range video that can be displayed on a monitor with standard brightness.
- the dynamic range of STD video is 0-100%
- the dynamic range of HDR video is expressed as a range from 0% to 101% or more, such as 0-500%, 0-1000%.
- the recording device 1 converts the input master HDR video into STD video, that is, converts it into a video having a dynamic range that can be displayed on a monitor having a standard luminance, and records it on the optical disc 11.
- information indicating the luminance characteristics of the master HDR video and information used when converting the STD video into the HDR video are also recorded on the optical disc 11.
- the HDR video recorded by the recording device 1 or the STD video obtained by converting the HDR video is, for example, a so-called 4K resolution video having horizontal and vertical resolutions of 4096 ⁇ 2160, 3840 ⁇ 2160 pixels, and the like.
- HEVC High Efficiency Video Coding
- SEI Supplemental Enhancement Information
- the recording device 1 also records graphics data superimposed on the HDR video or STD video on the optical disc 11.
- BD graphics include graphics using a PG (Presentation Graphic) stream, an IG (Interactive Graphic) stream, and a text subtitle (TextST) stream, and BD-J graphics.
- the PG stream is a bitmap subtitle data stream that is played back in synchronization with the video stream.
- the IG stream is a stream of image data such as a menu button that is played back in synchronization with the video stream.
- the TextST stream is a subtitle text data stream that is played back in synchronization with the video stream.
- BD-J graphics are graphics displayed by a Java (registered trademark) application in the BD-J mode.
- the playback mode of the playback device 2 as a BD-ROM player includes an HDMV (High Definition Movie) mode and a BD-J mode.
- BD graphics include at least one of graphics based on PG, IG, and TextST streams.
- BD graphics and BD-J graphics recorded on the optical disc 11 are graphics having a dynamic range that can be displayed on a monitor having a standard luminance.
- the playback device 2 communicates with the display device 3 via the HDMI cable 4 and acquires information regarding the display performance of the display device 3.
- the playback device 2 identifies whether the display device 3 is a device having an HDR monitor that is a monitor capable of displaying HDR video or a device having an STD monitor that is a monitor capable of only displaying STD video.
- the playback device 2 drives the drive to read and decode the HEVC stream recorded on the optical disc 11.
- the playback device 2 displays the HDR video data obtained by decoding the HEVC stream on the display device 3. Output to.
- the playback device 2 outputs information indicating the luminance characteristics of the master HDR video to the display device 3 together with the HDR video data.
- the playback device 2 converts the HDR video obtained by decoding the HEVC stream into STD video. , Output STD video data.
- the conversion of the HDR video into the STD video is performed using information that is recorded on the optical disc 11 and used when converting the HDR video into the STD video.
- the playback device 2 converts the STD video obtained by decoding the HEVC stream into HDR video, and the HDR Video data is output to the display device 3.
- the conversion of the STD video into the HDR video is performed using information used when converting the STD video into the HDR video recorded on the optical disc 11.
- the playback device 2 outputs information indicating the luminance characteristics of the master HDR video to the display device 3 together with the HDR video.
- the playback device 2 displays the STD video data obtained by decoding the HEVC stream on the display device 3. Output to.
- Graphics are appropriately combined with the HDR video or STD video output from the playback device 2. Graphics combined with HDR video and graphics combined with STD video are both standard dynamic range graphics.
- the display device 3 receives the video data transmitted from the playback device 2 and displays the content video on the monitor. Audio data of content is also transmitted from the playback device 2. The display device 3 outputs the audio of the content from the speaker based on the audio data transmitted from the playback device 2.
- the display device 3 transmits information indicating the luminance characteristics of the master HDR video (information indicating the relationship between the pixel value and the luminance) together with the video data
- the video data transmitted from the playback device 2 is Recognize as HDR video data.
- information indicating the luminance characteristics of the master HDR video is transmitted together with the HDR video data to the display device 3 having the HDR monitor.
- the display device 3 displays the HDR video image according to the characteristics specified by the information indicating the brightness characteristics of the master HDR video.
- the display device 3 is a monitor whose own monitor has a dynamic range of 0-500%.
- the display device 3 Based on the information indicating the luminance characteristics of the master HDR video, the display device 3 has a predetermined HDR video dynamic range of 0-500%. If it is designated as a characteristic, the video is displayed with the brightness adjusted in the range of 0-500% according to the predetermined characteristic.
- the content author By enabling the specification of the luminance characteristics of the master HDR video, the content author (Author) can display the video with the intended luminance.
- a display device such as a TV recognizes an externally input video as a video having a dynamic range of 0-100%. Further, when the monitor of the display device has a wider dynamic range, the display device expands the luminance itself according to the characteristics of the monitor and displays the video. By designating the luminance characteristic and adjusting the luminance of the HDR video according to the designated characteristic, it is possible to prevent the luminance adjustment not intended by the author from being performed on the display device side.
- a playback device that outputs video to a display device such as a TV usually outputs the video after converting the luminance according to the characteristics of the transmission path.
- the display device that has received the video converts the luminance of the received video in accordance with the characteristics of the monitor and displays the video.
- the display device 3 displays the STD video image.
- STD video is transmitted from the playback device 2
- the display device 3 is a device having an STD monitor.
- mode-i the mode in which the master HDR video is recorded on the optical disc 11 as the HDR video is referred to as mode-i.
- mode-i information indicating the luminance characteristics of the master HDR video and information used when converting the HDR video into STD video are recorded on the optical disc 11.
- mode-ii the mode in which the master HDR video is converted to STD video and recorded on the optical disc 11 is called mode-ii.
- mode-ii information indicating the luminance characteristics of the master HDR video and information used when converting the STD video into the HDR video are recorded on the optical disc 11.
- FIG. 2 is a diagram showing an example of video signal processing in mode-i.
- the process on the left side indicated by the solid line L1 indicates the encoding process performed in the recording apparatus 1, and the process on the right side indicated by the solid line L2 indicates the decoding process performed in the reproduction apparatus 2.
- the recording apparatus 1 detects the brightness of the master HDR video and, as indicated by the tip of arrow # 1, HDR information that is information indicating the brightness characteristics of the master HDR video Is generated. Also, the recording device 1 encodes the master HDR video with HEVC as indicated by the tip of arrow # 2.
- the recording device 1 converts the master HDR video into STD video as indicated by the tip of arrow # 3.
- the video of the STD video obtained by the conversion is displayed on a monitor (not shown).
- the conversion of the HDR video to the STD video is appropriately performed while the author visually confirms the video of the converted STD video and adjusts the conversion parameters.
- the recording device 1 Based on the adjustment by the author, the recording device 1 generates tone-mapping definition information for HDR-STD conversion, which is information used when converting HDR video to STD video, as indicated by the tip of arrow # 4. .
- the tone mapping definition information includes each pixel value indicating the brightness of a dynamic range such as 0-400%, which is wider than the standard dynamic range, and each pixel indicating the brightness of the dynamic range of 0-100%, which is the standard dynamic range. This information defines the correspondence between values.
- the recording device 1 inserts the HDR information and tone mapping definition information as SEI into HEVC encoded data as shown at the tip of arrow # 5, and generates a HEVC stream.
- the recording device 1 records the generated HEVC stream on the optical disc 11 in the BD format and provides it to the playback device 2 as indicated by arrow # 11.
- the information indicating the luminance characteristics of the master HDR video and the information used when converting the HDR video into the STD video are provided to the playback device 2 by inserting into the stream using the SEI of HEVC. Is done.
- the playback device 2 reads the HEVC stream from the optical disc 11, and extracts the HDR information and tone mapping definition information from the SEI of the HEVC stream as indicated by arrows # 21 and # 22.
- the playback device 2 decodes the HEVC encoded data as indicated by the tip of arrow # 23.
- the playback device 2 adds the HDR information to the HDR video data obtained by decoding the encoded data, as indicated by the tip of the arrow # 24. Output to the display device 3 as shown above.
- the playback device 2 uses the tone-mapping definition information for HDR-STD conversion extracted from the HEVC stream, as indicated by the tip of arrow # 26, to generate encoded data.
- the HDR video obtained by decoding is converted to STD video.
- the playback device 2 outputs the STD video data obtained by the conversion to the display device 3 as indicated by the tip of arrow # 27.
- HDR video data obtained by decoding HEVC encoded data is output to the display device 3 having an HDR monitor together with the HDR information. Also, HDR video data obtained by decoding HEVC encoded data is converted into STD video, and then output to a display device 3 having an STD monitor.
- FIG. 3 is a diagram showing a flow of processing from when the master HDR video is input to the recording device 1 to when video data is output from the playback device 2.
- the master HDR video is transferred to the playback device 2 together with the HDR information generated in the recording device 1 based on the master HDR video and tone-mapping definition information for HDR-STD conversion, as indicated by the tip of the white arrow # 51.
- the HDR information includes information indicating that the dynamic range is extended to a range of 0 to 400%.
- the playback device 2 adds HDR information to the HDR video data obtained by decoding the HEVC encoded data, as indicated by the arrows # 52 and # 53. Is done. Also, the HDR video data to which the HDR information is added is output to the display device 3 as indicated by the tip of arrow # 54.
- the playback device 2 converts the HDR video obtained by decoding the HEVC encoded data into HDR-STD conversion as indicated by the arrows # 55 and # 56. Is converted into STD video using tone mapping definition information. Also, the STD video data obtained by the conversion is output to the display device 3 as indicated by the tip of arrow # 57.
- the amplitude of the waveform indicating the HDR video and the amplitude of the waveform indicating the STD video each indicate a dynamic range.
- the master HDR video is recorded on the optical disc 11 as the HDR video. Also, depending on the performance of the display device 3 as the output destination, the HDR video obtained by decoding the encoded data is output with the HDR information added as it is, or the HDR video is converted into the STD video and output. Can be switched.
- FIG. 4 is a diagram illustrating an example of video signal processing in mode-ii.
- the recording apparatus 1 detects the brightness of the master HDR video and generates HDR information as indicated by the tip of arrow # 71.
- Recording device 1 converts the master HDR video into STD video as indicated by the tip of arrow # 72.
- the video of the STD video obtained by the conversion is displayed on a monitor (not shown).
- the recording device 1 Based on the adjustment by the author, the recording device 1 generates tone mapping definition information for STD-HDR conversion, which is information used when converting STD video to HDR video, as indicated by the tip of arrow # 73. .
- the recording apparatus 1 encodes the STD video obtained by converting the master HDR video by HEVC.
- Recording device 1 inserts HDR information and tone mapping definition information as SEI into HEVC encoded data as shown at the tip of arrow # 75, and generates a HEVC stream.
- the recording device 1 records the generated HEVC stream on the optical disc 11 in the BD format and provides it to the playback device 2 as indicated by arrow # 91.
- the playback device 2 reads out the HEVC stream from the optical disc 11, and extracts the HDR information and tone mapping definition information from the SEI of the HEVC stream as indicated by arrows # 101 and # 102.
- the playback device 2 decodes the HEVC encoded data as indicated by the tip of arrow # 103.
- the playback device 2 outputs the STD video data obtained by decoding the encoded data to the display device 3 as indicated by the tip of arrow # 104.
- the playback device 2 uses the tone mapping definition information for STD-HDR conversion extracted from the HEVC stream, as indicated by the tip of arrow # 105, to generate encoded data.
- STD video obtained by decoding is converted to HDR video.
- the playback device 2 adds the HDR information to the HDR video data obtained by the conversion as indicated by the tip of the arrow # 106, and outputs it to the display device 3 as indicated by the tip of the arrow # 107.
- the STD video data obtained by decoding the HEVC encoded data is converted into HDR video and then output to the display device 3 having the HDR monitor together with the HDR information. Also, STD video data obtained by decoding HEVC encoded data is output as it is to the display device 3 having an STD monitor.
- FIG. 5 is a diagram showing the flow of processing from when the master HDR video is input to the recording device 1 to when the video data is output from the playback device 2.
- the master HDR video is converted into STD video as shown by the white arrow # 121, and then the HDR information generated in the recording device 1 based on the master HDR video and the tone for STD-HDR conversion are displayed. It is provided to the playback device 2 together with the mapping definition information.
- the STD video obtained by decoding the HEVC encoded data is used for STD-HDR conversion, as indicated by arrows # 122 and # 123. It is converted into HDR video using tone mapping definition information. Further, as indicated by the tip of arrows # 124 and # 125, the HDR information is added to the HDR video data obtained by converting the STD video, and is output to the display device 3 as indicated by the tip of arrow # 126.
- the playback device 2 outputs the STD video obtained by decoding the HEVC encoded data to the display device 3 as indicated by the tip of arrow # 127. .
- the master HDR video is converted to STD video and recorded on the optical disc 11. Also, depending on the performance of the display device 3 serving as the output destination, the STD video obtained by decoding the encoded data is converted into HDR video, and is output with the addition of HDR information, or the STD video is output as it is. Can be switched.
- FIG. 6 is a diagram showing the configuration of the HEVC access unit.
- the HEVC stream is composed of access units that are a collection of NAL (Network Abstraction Layer) units.
- One access unit includes one picture of video data.
- one access unit includes AU delimiter (Access Unit delimiter), VPS (Video Parameter Set), SPS (Sequence Parameter Set), PPS (Picture Parameter Set), SEI, VCL (Video Coding Layer) , EOS (End of Sequence), and EOS (End of Stream).
- AU delimiter Access Unit delimiter
- VPS Video Parameter Set
- SPS Sequence Parameter Set
- PPS Picture Parameter Set
- SEI Supplemental Coding Layer
- VCL Video Coding Layer
- EOS End of Sequence
- EOS End of Stream
- VPS includes metadata representing the contents of the bitstream.
- the SPS includes information that the HEVC decoder needs to refer to through a sequence decoding process, such as a picture size and a CTB (Coding Tree Block) size.
- the PPS includes information that the HEVC decoder needs to refer to in order to execute a picture decoding process.
- VPS, SPS, and PPS are used as header information.
- SEI is auxiliary information including timing information of each picture and information on random access. HDR information and tone mapping definition information are included in Tone mapping information which is one of SEI.
- VCL is one picture data.
- EOS End of Sequence
- EOS End of Stream
- FIG. 7 is a diagram showing the syntax of Tone mapping information.
- Tone mapping information the brightness and color of the picture obtained by decoding are converted according to the performance of the monitor that is the output destination of the picture. Note that the line numbers and colons (:) on the left side of FIG. 7 are shown for convenience of explanation, and are not information included in Tone mapping information. The main information included in Tone mapping information is explained.
- the tone_map_id on the second line is identification information of Tone mapping information.
- the purpose of Tone mapping information is identified by tone_map_id.
- an ID for mode-i and an ID for mode-ii are secured.
- an ID for mode-i is set in tone_map_id of Tone mapping information inserted in SEI of the encoded data of HDR video.
- an ID for mode-ii is set in tone_map_id of Tone mapping information inserted in the SEI of the encoded data of STD video.
- the tone_map_id of the optical disc 11 is set with any one of an ID for mode-i and an ID for mode-ii.
- the tone_map_model_id on the 8th line represents a tone map model used for conversion of coded data (coded data).
- tone_map_model_id In the recording apparatus 1, one Tone mapping ⁇ information in which any one of 0, 2, and 3 is set as tone_map_model_id and one Tone mapping information in which a value of 4 is set as tone_map_model_id are generated.
- Tone mapping information in which one of 0, 2, and 3 is set as tone_map_model_id is used as tone mapping definition information for HDR-STD conversion or STD-HDR conversion. Further, information included in Tone mapping information in which a value of 4 is set as tone_map_model_id is used as HDR information.
- tone_map_model_id 0.
- min_value and max_value are described.
- the horizontal axis indicates coded_data (RGB value before conversion), and the vertical axis indicates target_data (RGB value after conversion).
- the tone curve of FIG. 9 the RGB values below the encoded data D1 are converted into RGB values indicated by min_value, as indicated by white arrow # 151.
- the RGB value of the encoded data D2 or higher is converted into an RGB value indicated by max_value as indicated by a white arrow # 152.
- tone_map_model_id 2
- start_of_coded_interval [i] having the same number as max_target_data representing the step function is described.
- tone_map_model_id 3
- num_pivots 3
- Tone mapping information in which any value of 0,2,3 is set as tone_map_model_id is used as tone mapping definition information for STD-HDR conversion or HDR-STD conversion, and reproduced from the recording device 1 Is transmitted to the device 2.
- tone_map_model_id 4
- ref_screen_luminance_white 4
- extended_range_white_level 4
- nominal_black_level_code_value 2
- nominal_white_level_code_value 3
- extended_white_level_code_value 3
- FIG. 12 is a diagram illustrating an example of each piece of information included in the HDR information.
- the horizontal axis of FIG. 12 shows each pixel value of RGB. When the bit length is 10 bits, each pixel value is 0-1023.
- the vertical axis in FIG. 12 indicates brightness (luminance).
- the function F1 is a gamma function indicating the relationship between the pixel value and the brightness in a standard luminance monitor. The dynamic range of a standard luminance monitor is 0-100%.
- ref_screen_luminance_white indicates the brightness (cd / m 2 ) of the standard monitor.
- extended_range_white_level indicates the maximum value of the dynamic range brightness after extension. In the example of FIG. 12, 400 is set as the value of extended_range_white_level.
- Nominal_black_level_code_value indicates a pixel value of black (brightness 0%)
- nominal_white_level_code_value indicates a pixel value of white (brightness 100%) in a standard luminance monitor.
- extended_white_level_code_value indicates a white pixel value in the extended dynamic range.
- the dynamic range of 0-100% is expanded to the dynamic range of 0-400% according to the value of extended_range_white_level.
- a pixel value corresponding to 400% brightness is specified by extended_white_level_code_value.
- the luminance characteristics of HDR video are the characteristics that the values of nominal_black_level_code_value, nominal_white_level_code_value, and extended_white_level_code_value indicate 0%, 100%, and 400%, respectively.
- the luminance characteristic of the HDR video is represented by a function F2 that is a gamma function of the HDR video.
- Tone mapping information in which a value of 4 is set as tone_map_model_id, and transmitted from the recording device 1 to the playback device 2.
- the playback device 2 combines graphics such as PG and IG with the HDR video or STD video obtained by decoding the HEVC stream, and outputs the synthesized video to the display device 3.
- FIG. 13 is a diagram illustrating an example of a BD graphics gamma function.
- the horizontal axis of FIG. 13 shows each pixel value of RGB. Each pixel value is represented by 8 bits and takes a value of 0-255. The vertical axis in FIG. 13 indicates brightness. The dynamic range of BD graphics is 0-100%.
- the function F11 is a BD graphics gamma function acquired based on data recorded on the optical disc 11. As described above, gamma conversion is applied to the BD graphics. For example, when recording 2K-HD video on a BD, the same gamma conversion as ITU-709 is applied to BD graphics, which is the same as the gamma conversion applied to the video.
- FIG. 14 is a diagram showing an example of a video gamma function.
- the horizontal axis of FIG. 14 shows each pixel value of RGB. Each pixel value is represented by 10 bits and takes a value of 0-1023.
- the vertical axis in FIG. 14 indicates the brightness.
- the dynamic range of the HDR video is 0 to 400%, which is the same as the dynamic range shown in FIG.
- the dynamic range of STD video is 0-100%.
- the function F1 is a gamma function of STD video
- the function F2 is a gamma function of HDR video.
- the playback device 2 When the playback device 2 combines the HDR video obtained by decoding the HEVC stream with the BD graphics, the playback device 2 specifies the pixel value and luminance characteristics of the HDR video represented by the function F2 based on the HDR information.
- the playback device 2 converts the RGB pixel values of the BD graphics that are values in the range of 0-255 to 0- brightness in the HDR video gamma function system. Assign to a pixel value in the 100% range.
- each 8-bit pixel value of the original BD graphics before allocation is allocated to a 10-bit pixel value in the range from the value V1 to the value V2.
- the playback device 2 combines the scaled BD graphics represented by the pixel values in the HDR video gamma function system with the HDR video.
- FIG. 15 is a diagram showing the concept of pixel value assignment.
- the value V11 that is the pixel value of the original BD graphics is a pixel in the gamma function system of the HDR video that indicates the luminance within the same range of 0-100% as the luminance indicated by the value V11. It is assigned to the value V12 which is the value.
- FIG. 16 is a diagram illustrating an example of processing for generating graphics for HDR synthesis.
- the HDR composition graphics are graphics used for composition with HDR video.
- the playback device 2 calculates an allocation function based on the HDR information as indicated by the tip of arrow # 201.
- the allocation function is a function used for allocation of pixel values of BD graphics as described with reference to FIGS. 14 and 15.
- FIG. 17 is a diagram illustrating an example of an allocation function.
- the playback device 2 specifies a function F2 indicating the relationship between each pixel value of the HDR video and the luminance based on the HDR information, and inputs the brightness and outputs the pixel value as indicated by the tip of arrow # 211.
- a function F2 ′ which is a function for assigning pixel values, is obtained by calculation.
- the brightness that is input to the function F2 ′ is the brightness indicated by the 8-bit pixel value before BD graphics allocation, and the output pixel value is the 10-bit pixel value that indicates the same brightness in the HDR video gamma function system. It is.
- the playback device 2 performs conversion using CLUT (Color Lookup Table) on BD graphics obtained by decoding a PG stream, for example.
- CLUT Color Lookup Table
- BD graphics after CLUT conversion are represented by YCrCb pixel values of 8 bits each.
- the playback device 2 converts YCrCb BD graphics into 8-bit RGB BD graphics as indicated by the tip of arrow # 203.
- the playback device 2 Since gamma conversion is performed on the BD graphics, the playback device 2 performs inverse gamma conversion on the BD graphics as indicated by the tip of arrow # 204.
- the BD graphics after the inverse gamma conversion are represented by 8-bit R′G′B ′ values.
- the R′G′B ′ value and the luminance have a linear relationship.
- the playback device 2 uses the R'G'B 'value, which is the pixel value of the BD graphics after the inverse gamma conversion, as an input of an allocation function, and outputs R' 'as an output. Each G''B '' is obtained (pixel value is assigned).
- the gamma function of the HDR video specified based on the HDR information is a function that represents the relationship between the pixel value and the luminance by the following equation (1).
- X is a normalized input value (pixel value). X takes a value in the range of 0-1.
- ⁇ is a gamma coefficient, for example, 2.2.
- ⁇ is a luminance expansion coefficient and takes a value of 1 to 4, for example.
- ⁇ is obtained by dividing the value of extended_range_white_level by 100.
- L is luminance and takes a value of 0 to ⁇ .
- the playback apparatus 2 performs such pixel value assignment using each R′G′B ′ value, which is each pixel value of BD graphics, as input, and obtains R ′′ G ′′ B ′′.
- the playback apparatus 2 converts the R ′′ G ′′ ′′ B ′′ BD graphics into 10-bit Y′Cr′Cb ′ BD graphics, as indicated by the tip of arrow # 206 in FIG.
- the BD graphics of Y′Cr′Cb ′ obtained by the conversion becomes graphics for HDR synthesis.
- FIG. 18 is a diagram illustrating an example of the synthesis process.
- the playback device 2 combines the HDR synthesis graphics and the HDR video as indicated by arrows # 221 and # 222, and displays the synthesized HDR video together with the HDR information as indicated by the arrow # 223. Output to device 3.
- the HDR video used for synthesis with the HDR synthesis graphics is an HDR video generated as shown in FIG. 3 or FIG.
- BD graphics is expanded to 0-400%, for example, according to the dynamic range of HDR video, and synthesized with HDR video, graphics such as subtitles may be dazzling and difficult to see. This can be prevented.
- video is a general image source such as a movie
- an image with a large area of a high luminance part is rare, but graphics can easily create an image with a large area of a maximum luminance part.
- an image with a large area of the maximum luminance portion may be an image that is difficult to see, even if the video is an HDR video, it is preferable to display graphics within a luminance range of 0-100%.
- FIG. 19 is a diagram illustrating an example of the synthesis process of STD video and BD graphics.
- the playback device 2 performs a conversion process by CLUT on, for example, BD graphics obtained by decoding a PG stream.
- BD graphics after CLUT conversion are represented by 8bit YCrCb values. Each 8-bit YCrCb is shifted to 10 bits.
- the playback apparatus 2 combines the 10-bit YCrCb BD graphics and the STD video as indicated by the arrows # 232 and # 233, and the synthesized STD video as indicated by the arrow # 234. Is output to the display device 3. Since the dynamic range of BD graphics is 0-100%, the BD graphics after CLUT conversion are used for synthesis with STD video as they are.
- the STD video used for the synthesis with the BD graphic is an STD video generated as shown in FIG. 3 or FIG.
- the STD video synthesized with the BD graphics is acquired in the form of synthesizing the BD graphics after converting the HDR video into the STD video. This eliminates the need for assigning pixel values for BD graphics, etc., compared to when synthesizing BD graphics first and converting the HDR video after BD graphics synthesis to STD video. Becomes easier.
- FIG. 20 is a diagram illustrating an example of an AV stream management structure in the BD-ROM format.
- AV streams including HEVC streams is performed using two layers, PlayList and Clip.
- the AV stream may be recorded not only on the optical disc 11 but also on the local storage of the playback device 2.
- One AV stream and Clip Information which is information accompanying it are managed as one object.
- a pair of AV stream and ClipCInformation is called Clip.
- the AV stream is developed on the time axis, and the access point of each Clip is mainly designated in the PlayList with a time stamp. Clip Information is used to find the address where decoding in the AV stream should start.
- PlayList is a collection of AV stream playback sections.
- One playback section in the AV stream is called PlayItem.
- PlayItem is represented by a pair of IN point and OUT point of the playback section on the time axis. As shown in FIG. 20, the PlayList is composed of one or a plurality of PlayItems.
- the first PlayList from the left in FIG. 20 is composed of two PlayItems, and the two PlayItems refer to the first half and the second half of the AV stream included in the left Clip, respectively.
- the second PlayList from the left is composed of one PlayItem, so that the entire AV stream included in the right Clip is referenced.
- the third PlayList from the left is made up of two PlayItems, and the two PlayItems refer to a part of the AV stream included in the left Clip and a part of the AV stream included in the right Clip, respectively.
- the PlayList is used as playback management information for managing playback of AV streams.
- a playback path created by an array of one or more PlayItems in a PlayList is called a main path.
- a playback path created by an arrangement of one or more SubPlayItems in parallel with the Main Path is called a sub path (Sub Path).
- FIG. 21 is a diagram showing the structure of the main path and the sub path.
- the PlayList has one Main path and one or more Sub paths.
- the PlayList in FIG. 21 has one Main Path and three Sub Paths created from a sequence of three PlayItems.
- the PlayItems that make up the Main Path are set with IDs in order from the top.
- the AV stream referred to by one PlayItem includes at least a video stream (main image data).
- the AV stream may or may not include one or more audio streams that are played back at the same timing (synchronously) as the video stream included in the AV stream.
- the AV stream may or may not include one or more bitmap subtitle data (PG (Presentation Graphic)) streams that are reproduced in synchronization with the video stream included in the AV stream. .
- PG Presentation Graphic
- the AV stream may or may not include one or more IG (Interactive Graphic) streams that are played back in synchronization with the video stream included in the AV stream file.
- the IG stream is used to display graphics such as buttons operated by the user.
- a video stream and a graphics stream such as an audio stream and a PG stream that are reproduced in synchronization with the AV stream referred to by one PlayItem are multiplexed.
- one SubPlayItem refers to a video stream, an audio stream, a graphics stream, and the like, which are different from the AV stream referred to by the PlayItem.
- PlayList and Clip Information including information related to playback of the AV stream are appropriately referred to as Data ⁇ Base information.
- FIG. 22 is a diagram illustrating an example of a management structure of files recorded on the optical disc 11.
- Each file recorded on the optical disc 11 is hierarchically managed by the directory structure.
- One root directory is created on the optical disc 11.
- BDMV directory is placed under the root directory.
- an Index file that is a file with the name “Index.bdmv” and a Movie Object file that is a file with the name “MovieObject.bdmv” are stored.
- Index file for example, a list of title numbers recorded on the optical disc 11 and the types and numbers of objects executed corresponding to the title numbers are described.
- objects There are two types of objects: movie objects (Movie Object) and BD-J objects (BD-J Object).
- a movie object is an object in which navigation commands, which are commands used for PlayList playback and the like, are described.
- the BD-J object is an object in which a BD-J application is described. Movie objects are described in the Movie Object file.
- PLAYLIST directory CLIPINF directory, STREAM directory, and BDJO directory are provided under the BDMV directory.
- the PLAYLIST directory stores a PlayList file that describes the PlayList.
- Each PlayList file has a name that is a combination of a 5-digit number and an extension “.mpls”.
- One PlayList file shown in FIG. 22 has a file name “00000.mpls”.
- the Clip Information file is stored in the CLIPINF directory. Each Clip Information file is set with a name combining a five-digit number and the extension “.clpi”. File names “00001.clpi”, “00002.clpi”, and “00003.clpi” are set in the three Clip Information files in FIG. 22, respectively.
- Stream file is stored in STREAM directory.
- Each stream file has a name that is a combination of a 5-digit number and an extension “.m2ts”.
- file names “00001.m2ts”, “00002.m2ts”, and “00003.m2ts” are set, respectively.
- the clip information file in which the same 5-digit number is set as the file name and the stream file constitute a single clip.
- the “00001.m2ts” stream file is played, the “00001.clpi” ClipCInformation file is used, and when the “00002.m2ts” stream file is played, the “00002.clpi” Clip Information file is used.
- the Clip Information file used for playback of the AV stream including the HEVC stream includes information related to processing of the HDR video.
- the BDJO directory stores BD-J object files that describe BD-J objects.
- Each BD-J object file has a name that is a combination of a 5-digit number and the extension “.bdjo”.
- file names “00001.bdjo”, “00002.bdjo”, and “00003.bdjo” are set, respectively.
- FIG. 23 is a diagram showing the syntax of the PlayList file.
- the PlayList file is a file with the extension “.mpls” stored in the PLAYLIST directory of FIG.
- AppInfoPlayList stores parameters related to playback control of the PlayList, such as playback restrictions.
- PlayList stores parameters related to Main Path and Sub Path.
- PlayListMark stores PlayList mark information, that is, information about a mark that is a jump destination (jump point) in a user operation or command that commands chapter jump or the like.
- FIG. 24 is a diagram showing the syntax of the Clip® Information file.
- the Clip Information file is a file with the extension “.clpi” stored in the CLIPINF directory of FIG.
- ClipInfo stores information indicating the type of AV stream constituting the Clip, information indicating the recording rate of the AV stream, and the like.
- the SequenceInfo () includes information indicating the position on the time axis of the source packet constituting the AV stream, information indicating the display time, and the like.
- ProgramInfo includes information such as the PID of the AV stream that constitutes the Clip and the encoding of the AV stream.
- FIG. 25 is a diagram showing the syntax of ProgramInfo () in FIG.
- “Number_of_program_sequences” indicates the number of program sequences described in ProgramInfo ().
- the program sequence is composed of a sequence of source packets constituting the program.
- SPN_program_sequence_start [i] indicates the number of the source packet at the beginning of the program sequence (source packet number).
- StreamCodingInfo includes information related to encoding of the AV stream constituting the Clip.
- FIG. 26 is a diagram showing the syntax of StreamCodingInfo in FIG.
- Stream_coding_type indicates the encoding method of elementary stream included in the AV stream. For example, in StreamCodingInfo of Clip
- Video_format indicates a video scanning method.
- a value indicating a 4K scanning method such as 2160p (2160 line progressive) is set as the stream_coding_type.
- “Frame_rate” indicates the frame rate of the video stream.
- Aspect_ratio indicates the aspect ratio of the video.
- Cc_flag is a 1-bit flag and indicates whether or not closed caption data is included in the video stream.
- Mode_flag is a 1-bit flag indicating the recording mode of the HEVC stream.
- the flag indicating whether or not the HEVC stream included in the AV stream to be played back using the Clip Information is a stream in which the master is an HDR video, and the recording mode of the HEVC stream are set.
- a flag to indicate is included.
- the playback device 2 can identify whether the master video is an HDR video or the like without actually analyzing the HEVC stream by referring to the flag included in Clip Information.
- FIG. 27 is a block diagram illustrating a configuration example of the recording apparatus 1.
- the recording apparatus 1 includes a controller 21, a video encoding processing unit 22, a graphics encoder 23, a multiplexing unit 24, and a disk drive 25.
- the master HDR video is input to the video encoding processing unit 22, and BD graphics data is input to the graphics encoder 23.
- the controller 21 includes a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), and the like.
- the controller 21 executes a predetermined program and controls the overall operation of the recording apparatus 1.
- a Data Base information generation unit 21A is realized by executing a predetermined program.
- the Data Base information generation unit 21 ⁇ / b> A generates a PlayList and Clip Information that are Data Base information, and outputs them to the disk drive 25.
- the video encoding processing unit 22 encodes the master HDR video.
- the video encoding processing unit 22 outputs the HEVC stream obtained by encoding the master HDR video to the multiplexing unit 24.
- the graphics encoder 23 encodes the input BD graphics data and outputs the graphics stream to the multiplexing unit 24.
- FIG. 28 is a diagram illustrating a configuration example of a PG stream and an IG stream.
- the PG stream and the IG stream are configured by collecting display sets that are data related to graphics for one screen.
- One display set is composed of a plurality of segments.
- FIG. 28A shows a PG stream display set.
- the display set of the PG stream includes PCS (Presentation Composition Segment), WDS (Window Definition Segment), PDS (Palette Definition Segment), ODS (Object Definition Definition), and END (End Of Display Display Set Segment).
- PCS is a subtitle segment for one screen.
- an ID assigned to a caption corresponding to each ODS is described.
- the WDS information indicating the structure such as the position and size of the window indicating the display range of subtitles is described.
- PDS describes palette information including information on graphics colors, such as information for specifying colors that can be used as subtitle colors.
- the ODS information indicating the shape of the caption is described.
- END is a segment indicating the end of the display set.
- FIG. 28B shows an IG stream display set.
- the display set of the IG stream is composed of ICS (Interactive Composition Segment), PDS, ODS, and END.
- ICS Interactive Composition Segment
- ICS is a menu button segment for one screen.
- ICS a command executed by operating the menu button, an ID unique to the menu button corresponding to each ODS, and the like are described.
- PDS describes palette information including information about graphics colors, such as information for specifying colors that can be used as menu button colors.
- ODS information indicating the shape of the menu button is described.
- END is a segment indicating the end of the display set.
- the graphics stream having such a data structure is supplied from the graphics encoder 23 to the multiplexing unit 24.
- the TextST stream is also composed of a plurality of segments in the same manner as the PG and IG streams.
- the multiplexing unit 24 multiplexes the HEVC stream supplied from the video encoding processing unit 22 and the graphics stream supplied from the graphics encoder 23, and outputs the multiplexed stream to the disk drive 25.
- the disk drive 25 records the file storing the PlayList, Clip Information supplied from the controller 21 and the multiplexed stream supplied from the multiplexing unit 24 on the optical disk 11 according to the directory structure of FIG.
- FIG. 29 is a block diagram illustrating a configuration example of the video encoding processing unit 22 of FIG.
- the video encoding processing unit 22 includes an HDR information generation unit 31, an HEVC encoder 32, an HDR-STD conversion unit 33, a definition information generation unit 34, and an HEVC stream generation unit 35.
- the HDR information generation unit 31 detects the luminance of the input master HDR video, and generates HDR information including each piece of information described with reference to FIG.
- the HDR information generation unit 31 outputs the generated HDR information to the HEVC stream generation unit 35.
- the HEVC encoder 32 When the recording mode is mode-i, the HEVC encoder 32 encodes the input master HDR video with HEVC. In addition, when the recording mode is mode-ii, the HEVC encoder 32 encodes the STD video supplied from the HDR-STD conversion unit 33 with HEVC. The HEVC encoder 32 outputs the encoded data of the HDR video or the encoded data of the STD video to the HEVC stream generation unit 35.
- the HDR-STD conversion unit 33 converts the input master HDR video into STD video.
- the conversion by the HDR-STD conversion unit 33 is appropriately performed according to the conversion parameter input by the author.
- the HDR-STD conversion unit 33 outputs to the definition information generation unit 34 information indicating a correspondence relationship between input data and output data, where the HDR video RGB signal is input data and the STD video RGB signal is output data.
- FIG. 30 is a diagram illustrating an example of signal processing by the HDR-STD conversion unit 33.
- the HDR-STD conversion unit 33 converts the input master HDR video YCrCb signal into an RGB signal, and converts each RGB signal into an RGB signal for each RGB signal. Convert to (tone mapping).
- the HDR-STD conversion unit 33 outputs to the definition information generation unit 34 information indicating the correspondence between the RGB values of the HDR video as input data and the RGB values of the STD video as output data.
- the information output to the definition information generation unit 34 is used to generate tone mapping definition information as indicated by the tip of arrow # 302.
- the HDR-STD conversion unit 33 converts the RGB signal of the STD video into a YCrCb signal and outputs it as indicated by the tip of arrow # 303.
- FIG. 31 shows an example of tone mapping.
- the HDR video RGB signal is converted into an STD video RGB signal by compressing a high luminance component and expanding a middle / low frequency luminance component.
- the definition information generation unit 34 generates information indicating a function F that associates the RGB signal of the HDR video and the RGB signal of the STD video as illustrated in FIG.
- the HDR-STD conversion unit 33 outputs the STD video obtained by converting the HDR video to the HEVC encoder 32 when the recording mode is mode-ii.
- the definition information generation unit 34 generates tone-mapping definition information for HDR-STD conversion based on the information supplied from the HDR-STD conversion unit 33.
- tone_map_model_id 0
- tone_map_model_id 2
- the definition information generation unit 34 generates Tone mapping information including start_of_coded_interval [i] in FIG. 10 as tone mapping definition information for HDR-STD conversion.
- tone_map_model_id 3
- the definition information generation unit 34 converts Tone mapping information including the number of coded_pivot_value [i] and target_pivot_value [i] specified by num_pivots in FIG. 11 to tone mapping for HDR-STD conversion. Generate as definition information.
- the HEVC stream generation unit 35 sets the tone_map_id of Tone mapping information including the HDR information supplied from the HDR information generation unit 31 and tone_map_id of the tone mapping information including the tone mapping definition information supplied from the definition information generation unit 34 to the recording mode. Set the same value accordingly. Also, the HEVC stream generation unit 35 inserts Tone mapping information including HDR information and Tone mapping information including tone mapping definition information into the encoded data as SEI, and generates an HEVC stream. The HEVC stream generation unit 35 outputs the generated HEVC stream to the disk drive 25.
- FIG. 32 is a block diagram illustrating a configuration example of the playback device 2.
- the playback device 2 includes a controller 51, a disk drive 52, a memory 53, a local storage 54, a network interface 55, an operation input unit 56, a separation unit 57, a video decoding processing unit 58, a graphics processing unit 59, a combining unit 60, and HDMI.
- the communication unit 61 is configured.
- the controller 51 includes a CPU, a ROM, a RAM, and the like.
- the controller 51 executes a predetermined program and controls the overall operation of the playback device 2.
- the disk drive 52 reads data from the optical disk 11 and outputs the read data to the controller 51, the memory 53, or the separation unit 57.
- the disk drive 52 outputs Data Base information read from the optical disk 11 to the controller 51 and outputs the multiplexed stream to the separation unit 57.
- the memory 53 stores data necessary for the controller 51 to execute various processes.
- a register 53A which is a PSR (Player Status Register) is formed.
- the register 53A stores various types of information that the playback device 2 that is a BD player refers to when the optical disc 11 is played back.
- the local storage 54 is composed of, for example, an HDD (Hard Disk Drive). In the local storage 54, a stream downloaded from the server is recorded.
- HDD Hard Disk Drive
- the network interface 55 communicates with a server via a network such as the Internet, and supplies data downloaded from the server to the local storage 54.
- the separation unit 57 separates the HEVC stream data and the graphics stream data from the multiplexed stream supplied from the disk drive 52.
- the separation unit 57 outputs the separated HEVC stream data to the video decoding processing unit 58, and outputs the graphics stream data to the graphics processing unit 59.
- the video decoding processing unit 58 decodes the HEVC stream composed of the data supplied from the separation unit 57 and outputs the HDR video or STD video data to the synthesis unit 60. Also, the video decoding processing unit 58 outputs the HDR information to the HDMI communication unit 61 when outputting the HDR video to the synthesis unit 60. The video decoding processing unit 58 also outputs the HDR information to the graphics processing unit 59.
- the graphics processing unit 59 decodes the graphics stream supplied from the separation unit 57 and outputs BD graphics data having a standard dynamic range to the synthesis unit 60.
- the synthesizing unit 60 synthesizes the HDR video or STD video supplied from the video decoding processing unit 58 and the BD graphics supplied from the graphics processing unit 59, and performs HDMI communication on the synthesized HDR video or STD video data. To the unit 61.
- FIG. 33 is a diagram illustrating an example of plane synthesis by the synthesis unit 60.
- the composition of video and graphics is performed by overlapping the planes as shown in FIG.
- the video plane is data for one screen of video
- the graphics plane (PG / IG plane) is data for one screen of graphics.
- the synthesizing unit 60 synthesizes a PG graphics plane that displays subtitles and the like obtained by decoding the PG stream on the video plane.
- the synthesizing unit 60 synthesizes an IG graphics plane that displays menu buttons and the like obtained by decoding the IG stream on the PG graphics plane.
- the HDMI communication unit 61 in FIG. acquires information regarding the performance of the monitor included in the display device 3 and outputs the information to the controller 51. Also, the HDMI communication unit 61 outputs the HDR video or STD video data supplied from the synthesis unit 60 to the display device 3. When outputting the HDR video data, the HDMI communication unit 61 outputs the HDR information supplied from the video decoding processing unit 58 together with the HDR video data.
- FIG. 34 is a block diagram illustrating a configuration example of the video decoding processing unit 58 of FIG.
- the video decoding processing unit 58 includes a parameter extraction unit 71, a HEVC decoder 72, an HDR-STD conversion unit 73, an STD-HDR conversion unit 74, and an output unit 75.
- the output unit 75 includes an HDR video output unit 75A and an STD video output unit 75B.
- the HEVC stream output from the separation unit 57 is input to the parameter extraction unit 71.
- the monitor performance of the display device 3 specified by information indicating the recording mode specified by mode_flag included in Clip ⁇ Information and information acquired from the display device 3 The information regarding is supplied from the controller 51.
- the parameter extraction unit 71 extracts the HDR information and tone mapping definition information from the SEI of the HEVC stream. For example, when the recording mode is mode-i and the HDR video is output to the display device 3, the parameter extraction unit 71 outputs the HDR information to the HDMI communication unit 61. Further, when the recording mode is mode-i and the STD video is output to the display device 3, the parameter extraction unit 71 outputs tone-mapping definition information for HDR-STD conversion to the HDR-STD conversion unit 73.
- the parameter extraction unit 71 outputs HDR information to the HDMI communication unit 61 and tone mapping definition information for STD-HDR conversion Is output to the STD-HDR converter 74.
- the recording mode is mode-ii and STD video is output to the display device 3
- the extracted HDR information and tone mapping definition information are not used.
- the HDR information extracted by the parameter extraction unit 71 when outputting the HDR video is also output to the graphics processing unit 59.
- the parameter extraction unit 71 outputs the encoded data included in the HEVC stream to the HEVC decoder 72.
- the HEVC decoder 72 decodes the HEVC encoded data supplied from the parameter extraction unit 71.
- the HEVC decoder 72 outputs the HDR video obtained by decoding to the HDR-STD conversion unit 73 and the HDR video output unit 75A.
- the HEVC decoder 72 outputs the STD video obtained by decoding to the STD-HDR conversion unit 74 and the STD video output unit 75B.
- the HDR-STD conversion unit 73 converts the HDR video supplied from the HEVC decoder 72 into STD video based on tone-mapping definition information for HDR-STD conversion supplied from the parameter extraction unit 71.
- the HDR-STD conversion unit 73 outputs the STD video obtained by the conversion to the STD video output unit 75B.
- the STD-HDR conversion unit 74 converts the STD video supplied from the HEVC decoder 72 into an HDR video based on the tone map mapping definition information for STD-HDR conversion supplied from the parameter extraction unit 71.
- the STD-HDR conversion unit 74 outputs the HDR video obtained by the conversion to the HDR video output unit 75A.
- the HDR video output unit 75A of the output unit 75 outputs the HDR video supplied from the HEVC decoder 72 or the HDR video supplied from the STD-HDR conversion unit 74 when outputting the HDR video to the display device 3. Output to.
- the STD video output unit 75B When outputting the STD video to the display device 3, the STD video output unit 75B outputs the STD video supplied from the HEVC decoder 72 or the STD video supplied from the HDR-STD conversion unit 73 to the HDMI communication unit 61.
- FIG. 35 is a block diagram illustrating a configuration example of the graphics processing unit 59 of FIG.
- the graphics processing unit 59 includes a TS buffer 91, a graphics decoder 92, a graphics plane generation unit 93, a CLUT management unit 94, an RGB conversion unit 95, an inverse gamma conversion unit 96, an HDR information acquisition unit 97, a calculation unit 98, and an allocation. Part 99 and the YCrCb conversion part 100.
- the graphics decoder 92 includes an ES buffer 111, a processor 112, a decoder buffer 113, a composition buffer 114, and a graphics controller 115.
- a TS packet that is graphics stream data supplied from the separation unit 57 is input to the TS buffer 91.
- the HDR information supplied from the video decoding processing unit 58 is input to the HDR information acquisition unit 97.
- the TS buffer (Transport Stream) 91 stores the TS packet of the graphics stream supplied from the separation unit 57.
- the TS buffer 91 outputs an ES (Elementary Stream) composed of stored TS packets to the graphics decoder 92.
- the ES buffer 111 of the graphics decoder 92 stores an ES composed of TS packets supplied from the TS buffer 91.
- the processor 112 reads the ES from the ES buffer 111 and supplies graphics control data included in the ES to the composition buffer 114. For example, when ES is a PG stream, the processor 112 supplies the PCS, WDS, and PDS included in the PG stream to the composition buffer 114. On the other hand, when ES is an IG stream, the processor 112 supplies the ICS and PDS included in the IG stream to the composition buffer 114.
- the processor 112 decodes the actual data included in the ES, and supplies the decoded data to the decoder buffer 113 for holding. For example, when the ES is a PG stream or an IG stream, the processor 112 decodes ODS and supplies graphics data obtained by decoding to the decoder buffer 113.
- the decoder buffer 113 stores graphics data supplied from the processor 112.
- the composition buffer 114 stores the control data supplied from the processor 112.
- the graphics controller 115 reads control data from the composition buffer 114.
- the graphics controller 115 controls the read timing in the decoder buffer 113 and the graphics plane generation unit 93 based on PCS and WDS in the read control data.
- the graphics controller 115 supplies palette information included in the PDS to the CLUT management unit 94.
- the graphics plane generation unit 93 generates a graphics plane based on the data read from the decoder buffer 113 according to the control timing by the graphics controller 115.
- the graphics plane generator 93 outputs the generated graphics plane data to the CLUT manager 94 according to the control timing of the graphics controller 115.
- the CLUT management unit 94 stores a CLUT defined based on palette information supplied from the graphics controller 115.
- CLUT is a table in which input values are associated with YCrCb pixel values.
- the CLUT management unit 94 converts the graphics plane supplied from the graphics plane generation unit 93 into data composed of 8-bit YCrCb values.
- the CLUT management unit 94 outputs YCrCb BD graphics data to the RGB conversion unit 95 when synthesizing BD graphics into HDR video.
- the CLUT management unit 94 outputs the YCrCb BD graphics to the combining unit 60.
- a transparency value is also added to the YCrCb pixel value output by the CLUT management unit 94.
- the RGB conversion unit 95 converts the YCrCb BD graphics supplied from the CLUT management unit 94 into 8-bit RGB BD graphics and outputs them to the inverse gamma conversion unit 96.
- the inverse gamma conversion unit 96 performs reverse gamma conversion on the BD graphics and outputs the result to the allocation unit 99.
- the RGB value and luminance after inverse gamma conversion have a linear relationship.
- the HDR information acquisition unit 97 acquires the HDR information supplied from the video decoding processing unit 58 and outputs it to the calculation unit 98.
- the calculation unit 98 receives, as an HDR function, an allocation function that receives each pixel value of the BD graphics and outputs a 10-bit pixel value in an HDR video gamma function system that shows the same luminance as the luminance indicated by the pixel value. Calculation is performed based on the HDR information acquired by the acquisition unit 97. The calculation unit 98 outputs the allocation function obtained by calculation to the allocation unit 99.
- the allocation unit 99 functions as a pixel value conversion unit, and based on the allocation function obtained by the calculation unit 98, RGB pixel values of BD graphics after inverse gamma conversion are converted into HDR video gamma function systems. Assign to the pixel value at.
- the allocation unit 99 outputs the BD graphics represented by each 10-bit RGB value after allocation to the YCrCb conversion unit 100.
- the YCrCb conversion unit 100 converts the RGB BD graphics supplied from the allocation unit 99 into 10-bit YCrCb BD graphics, and outputs them to the synthesis unit 60 as HDR synthesis graphics.
- FIG. 36 is a block diagram illustrating a configuration example of the display device 3.
- the display device 3 includes a controller 131, an HDMI communication unit 132, a signal processing unit 133, and a monitor 134.
- the controller 131 has a memory 131A.
- the controller 131 includes a CPU, ROM, RAM, and the like.
- the controller 131 executes a predetermined program and controls the overall operation of the display device 3.
- the controller 131 stores and manages EDID (Extended display identification data) representing the performance of the monitor 134 in the memory 131A.
- EDID Extended display identification data
- the controller 131 outputs the EDID stored in the memory 131 ⁇ / b> A to the HDMI communication unit 132 so that the playback device 2 transmits the EDID.
- the playback device 2 Based on the EDID, the playback device 2 identifies the performance of the monitor 134 of the display device 3.
- the HDMI communication unit 132 communicates with the playback device 2 via the HDMI cable 4.
- the HDMI communication unit 132 receives the video data transmitted from the playback device 2 and outputs it to the signal processing unit 133. Further, the HDMI communication unit 132 transmits the EDID supplied from the controller 131 to the playback device 2.
- the signal processing unit 133 processes the video data supplied from the HDMI communication unit 132 and displays the video on the monitor 134.
- step S1 the controller 21 of the recording apparatus 1 determines whether or not the recording mode is mode-i.
- the recording mode is set by the author, for example.
- step S2 When it is determined in step S1 that the recording mode is mode-i, in step S2, the video encoding processing unit 22 performs an encoding process in mode-i.
- the HEVC stream generated by the encoding process in mode-i is supplied to the multiplexing unit 24.
- step S1 when it is determined in step S1 that the recording mode is mode-ii, the video encoding processing unit 22 performs the encoding process in mode-ii in step S3.
- the HEVC stream generated by the encoding process in mode-ii is supplied to the multiplexing unit 24.
- step S4 the Data Base information generation unit 21A performs Data Base information generation processing.
- the PlayList file and the Clip Information file generated by the Data Base information generation process are supplied to the disk drive 25.
- step S5 the graphics encoder 23 encodes the BD graphics data and outputs the graphics stream to the multiplexing unit 24.
- step S6 the multiplexing unit 24 multiplexes the HEVC stream supplied from the video encoding processing unit 22 and the graphics stream supplied from the graphics encoder 23, and outputs the multiplexed stream to the disk drive 25.
- step S7 the disc drive 25 records the PlayList file, ClipCInformation file, and multiplexed stream file on the optical disc 11. Thereafter, the process is terminated.
- step S11 the HDR information generation unit 31 of the video encoding processing unit 22 detects the luminance of the master HDR video and generates HDR information.
- step S12 the HEVC encoder 32 performs encoding by HEVC on the master HDR video, and generates encoded data of the HDR video.
- step S13 the HDR-STD conversion unit 33 converts the input master HDR video into STD video.
- Information indicating the correspondence between input data and output data in which the RGB signal of HDR video is input data and the RGB signal of STD video is output data is supplied to the definition information generation unit 34.
- step S14 the definition information generation unit 34 generates tone-mapping definition information for HDR-STD conversion based on the information supplied from the HDR-STD conversion unit 33.
- step S15 the HEVC stream generation unit 35 sets tone_map_id of Tone mapping information including the HDR information generated by the HDR information generation unit 31 and tone mapping information including the tone mapping definition information generated by the definition information generation unit 34. Set the ID for mode-i. Moreover, the HEVC stream generation unit 35 inserts Tone mapping information including HDR information and Tone mapping information including tone mapping definition information into the encoded data, and generates an HEVC stream. Thereafter, the process returns to step S2 in FIG. 37, and the subsequent processing is performed.
- step S21 the HDR information generating unit 31 of the video encoding processing unit 22 detects the luminance of the master HDR video and generates HDR information.
- step S22 the HDR-STD conversion unit 33 converts the input master HDR video into STD video.
- Information indicating the correspondence between input data and output data in which the RGB signal of HDR video is input data and the RGB signal of STD video is output data is supplied to the definition information generation unit 34.
- step S23 the definition information generation unit 34 generates tone mapping definition information for STD-HDR conversion based on the information supplied from the HDR-STD conversion unit 33.
- step S24 the HEVC encoder 32 performs encoding by HEVC on the STD video obtained by converting the master HDR video, and generates encoded data of the STD video.
- step S25 the HEVC stream generating unit 35 sets tone_map_id of Tone mapping information including the HDR information generated by the HDR information generating unit 31 and tone mapping information including the tone mapping definition information generated by the definition information generating unit 34. Set the ID for mode-ii. Moreover, the HEVC stream generation unit 35 inserts Tone mapping information including HDR information and Tone mapping information including tone mapping definition information into the encoded data, and generates an HEVC stream. Thereafter, the process returns to step S3 in FIG. 37, and the subsequent processing is performed.
- step S31 the Data Base information generation unit 21A of the controller 21 generates a PlayList including each piece of information described with reference to FIG.
- the PlayList generated by the Data Base information generation unit 21A includes information related to PlayItem that specifies the HEVC stream as a playback section.
- step S32 the Data Base information generation unit 21A generates Clip Information including HDR_flag and mode_flag in StreamCodingInfo of ProgramInfo ().
- the Data Base information generation unit 21 ⁇ / b> A sets 1 as a value indicating the HDR_flag.
- Data Base information generation unit 21A is a value indicating that the recording mode is mode-i as the value of mode_flag. 1 is set.
- the Data Base information generation unit 21A is a value indicating that the recording mode is mode-ii as the value of mode_flag when the encoding process in mode-ii is performed in step S3 of FIG. Set to 0. Thereafter, the process returns to step S4 in FIG. 37, and the subsequent processing is performed.
- the HEVC stream and Data Base information generated by the above processing are recorded on the optical disc 11.
- the controller 51 of the reproduction device 2 controls the HDMI communication unit 61 to communicate with the display device 3 and reads the EDID from the memory 131A of the display device 3.
- the controller 51 stores and manages information indicating the performance of the monitor included in the display device 3 in the register 53A.
- step S41 the controller 51 controls the disc drive 52 to read out the PlayList and ClipCInformation that are Data Base information from the optical disc 11.
- the controller 51 specifies the HEVC stream and graphics stream to be reproduced based on information included in the PlayList.
- the controller 51 reads the multiplexed stream including the specified HEVC stream and graphics stream from the optical disc 11 by controlling the disc drive 52.
- step S42 the separation unit 57 separates the multiplexed stream read from the optical disc 11 into HEVC stream data and graphics stream data.
- step S43 the controller 51 refers to HDR_flag and mode_flag included in Clip ⁇ Information.
- the HDR_flag is set to a value indicating that recording using the HDR as the master is being performed. Thereby, the state of the playback device 2 becomes a state of playing back the HDR video or the STD video obtained by converting the HDR video.
- step S44 the controller 51 determines whether or not the recording mode is mode-i based on the value of mode_flag.
- step S44 When it is determined in step S44 that the recording mode is mode-i, the video decoding processing unit 58 performs a decoding process in mode-i in step S45.
- step S46 the video decoding processing unit 58 performs a decoding process in mode-ii.
- step S45 or step S46 After the decoding process is performed in step S45 or step S46, the process ends.
- the determination whether or not the recording mode is mode-i is made based on the value of mode_flag, but it seems to be made based on tone_map_id of Tone mapping information inserted in the HEVC stream It may be.
- step S61 the parameter extraction unit 71 of the video decoding processing unit 58 extracts the HDR information and tone mapping definition information from the SEI of the HEVC stream.
- the parameter extraction unit 71 outputs the HEVC encoded data included in the HEVC stream to the HEVC decoder 72.
- step S62 the HEVC decoder 72 decodes the HEVC encoded data, and outputs the HDR video obtained by the decoding to the HDR-STD conversion unit 73 and the HDR video output unit 75A.
- step S63 the controller 51 determines whether the monitor of the display device 3 is an HDR monitor based on the information stored in the register 53A.
- the register 53A stores information related to the performance of the monitor included in the display device 3 based on the HDMI EDID read from the display device 3.
- the HDR video output unit 75A When it is determined in step S63 that the monitor included in the display device 3 is an HDR monitor, the HDR video output unit 75A outputs the HDR video supplied from the HEVC decoder 72 to the synthesis unit 60 in step S64.
- the HDR information extracted by the parameter extraction unit 71 is output to the HDMI communication unit 61.
- step S65 the graphics processing unit 59 performs graphics generation processing for HDR synthesis.
- the HDR composition graphics generated by the HDR composition graphics generation processing is supplied to the composition unit 60.
- step S66 the synthesizing unit 60 synthesizes the HDR video supplied from the video decoding processing unit 58 and the HDR synthesizing graphics supplied from the graphics processing unit 59, and the HDR video after synthesizing the BD graphics. Data is output to the HDMI communication unit 61.
- step S67 the HDMI communication unit 61 outputs the HDR video data after the synthesis of the BD graphics and the HDR information supplied from the video decoding processing unit 58 to the display device 3.
- step S68 the HDR-STD conversion unit 73 converts the HDR video supplied from the HEVC decoder 72, Based on tone-mapping definition information for HDR-STD conversion supplied from the parameter extraction unit 71, the video is converted into STD video.
- step S69 the STD video output unit 75B outputs the STD video obtained by the conversion by the HDR-STD conversion unit 73 to the synthesis unit 60.
- step S70 the graphics processing unit 59 decodes the graphics stream and outputs BD graphics data to the synthesizing unit 60. That is, in the graphics decoder 92 of the graphics processing unit 59, the processor 112 decodes the graphics stream stored in the ES buffer 111 and stores the BD graphics data obtained by decoding in the decoder buffer 113. .
- the graphics plane generation unit 93 generates a BD graphics plane based on the data stored in the decoder buffer 113.
- the CLUT management unit 94 performs CLUT conversion of the BD graphics plane, and outputs the BD graphics data after the CLUT conversion to the combining unit 60 as STD combining data.
- step S71 the synthesizing unit 60 synthesizes the STD video supplied from the video decoding processing unit 58 and the BD graphics supplied from the graphics processing unit 59.
- step S72 the HDMI communication unit 61 outputs the STD video data after the synthesis of the BD graphics to the display device 3.
- step S73 After the HDR video after the synthesis of BD graphics is output in step S67 or after the STD video after the synthesis of BD graphics is output in step S72, the controller 51 determines in step S73 whether or not the reproduction has ended. Determine whether.
- step S73 If it is determined in step S73 that the reproduction has not ended, the controller 51 returns to step S61 and repeats the above processing. If it is determined in step S73 that the reproduction has ended, the process returns to step S45 in FIG. 41, and the subsequent processing is performed.
- step S81 the parameter extraction unit 71 of the video decoding processing unit 58 extracts the HDR information and tone mapping definition information from the SEI of the HEVC stream.
- the parameter extraction unit 71 outputs HEVC encoded data included in the HEVC stream to the HEVC decoder 72.
- step S82 the HEVC decoder 72 decodes the HEVC encoded data, and outputs the STD video obtained by the decoding to the STD-HDR conversion unit 74 and the STD video output unit 75B.
- step S83 the controller 51 determines whether or not the monitor included in the display device 3 is an HDR monitor based on the information stored in the register 53A.
- the STD-HDR conversion unit 74 is supplied with the STD video supplied from the HEVC decoder 72 from the parameter extraction unit 71 in step S84. Based on tone mapping definition information for STD-HDR conversion, it is converted to HDR video.
- step S85 the HDR video output unit 75A outputs the HDR video obtained by the conversion by the STD-HDR conversion unit 74 to the synthesis unit 60.
- the HDR information extracted by the parameter extraction unit 71 is output to the HDMI communication unit 61.
- step S86 the graphics processing unit 59 performs graphics generation processing for HDR synthesis.
- the HDR composition graphics generated by the HDR composition graphics generation processing is supplied to the composition unit 60.
- step S87 the synthesizing unit 60 synthesizes the HDR video supplied from the video decoding processing unit 58 and the HDR synthesizing graphics supplied from the graphics processing unit 59, and the HDR video after synthesizing the BD graphics. Data is output to the HDMI communication unit 61.
- step S88 the HDMI communication unit 61 outputs the HDR video data after the synthesis of the BD graphics and the HDR information supplied from the video decoding processing unit 58 to the display device 3.
- the STD video output unit 75B outputs the STD video supplied from the HEVC decoder 72 to the synthesis unit 60 in step S89.
- step S90 the graphics processing unit 59 decodes the graphics stream and outputs the BD graphics data for STD synthesis to the synthesizing unit 60.
- step S91 the synthesizing unit 60 synthesizes the STD video supplied from the video decoding processing unit 58 and the BD graphics supplied from the graphics processing unit 59.
- step S92 the HDMI communication unit 61 outputs the STD video data after the synthesis of the BD graphics to the display device 3.
- step S93 the controller 51 determines whether or not the reproduction ends. Determine whether.
- step S93 If it is determined in step S93 that the reproduction has not ended, the controller 51 returns to step S81 and repeats the above processing. If it is determined in step S93 that the reproduction has ended, the process returns to step S46 in FIG. 41, and the subsequent processing is performed.
- step S111 the HDR information acquisition unit 97 of the graphics processing unit 59 acquires the HDR information extracted by the parameter extraction unit 71 of the video decoding processing unit 58.
- step S112 the calculation unit 98 receives the original pixel values of the BD graphics, and assigns the 10-bit pixel values in the HDR video gamma function system that output the same luminance as the luminance indicated by the pixel values. Function is calculated based on the HDR information.
- step S113 the graphics decoder 92 decodes the graphics stream. Based on the data obtained by decoding the graphics stream, the graphics plane generating unit 93 generates a BD graphics plane.
- step S114 the CLUT management unit 94 converts BD graphics based on the CLUT.
- step S115 the RGB conversion unit 95 converts the YCrCb BD graphics obtained by the conversion by the CLUT management unit 94 into 8-bit RGB BD graphics.
- step S116 the inverse gamma conversion unit 96 performs inverse gamma conversion on the BD graphics.
- step S117 the allocation unit 99 allocates the RGB pixel values of the BD graphics after the inverse gamma conversion to the pixel values in the gamma function system of the HDR video based on the allocation function obtained by the calculation unit 98. .
- step S118 the YCrCb conversion unit 100 converts the RGB BD graphics after the allocation by the allocation unit 99 into BD graphics composed of 10-bit YCrCb values, and outputs the BD graphics as HDR synthesis graphics to the synthesis unit 60. . Thereafter, the process returns to step S65 in FIG. 42 or step S86 in FIG. 43, and the subsequent processing is performed.
- the monitor 134 included in the display device 3 is an HDR monitor
- the HDR video to which the HDR information is added is transmitted from the playback device 2.
- the HDR video transmitted from the playback device 2 is a video in which BD graphics is synthesized.
- step S131 the HDMI communication unit 132 of the display device 3 receives the HDR video and the HDR information transmitted from the playback device 2.
- step S132 the controller 131 refers to the HDR information and determines whether the HDR video transmitted from the playback device 2 can be displayed as it is.
- the HDR information includes information indicating the luminance characteristics of the master HDR video, that is, the HDR video transmitted from the playback device 2.
- the determination in step S132 is performed by comparing the brightness characteristics of the HDR video specified by the HDR information with the display performance of the monitor 134.
- the dynamic range of HDR video specified by HDR information is 0-400%
- the dynamic range is 0-500% of the monitor 134 (for example, the brightness of 100% and 100cd / m 2 500cd / m 2 ) If it is, it is determined that the HDR video can be displayed as it is.
- the dynamic range of the HDR video specified by the HDR information is 0-400% and the dynamic range of the monitor 134 is 0-300%, it is determined that the HDR video cannot be displayed as it is.
- step S133 the signal processing unit 133 causes the monitor 134 to display the video of the HDR video according to the luminance specified by the HDR information. For example, when the luminance characteristic indicated by the curve L12 in FIG. 12 is specified by the HDR information, each pixel value represents the brightness in the range of 0 to 400% indicated by the curve L12.
- step S134 the signal processing unit 133 adjusts the luminance according to the display performance of the monitor 134, and adjusts the luminance of the adjusted HDR video. Display video. For example, when the luminance characteristic indicated by the curve L12 in FIG. 12 is specified by the HDR information and the dynamic range of the monitor 134 is 0-300%, each pixel value represents the brightness in the range of 0-300%. So that it is compressed.
- step S135 the controller 131 determines whether or not to end the display. If it is determined that the display is not ended, the process from step S131 is repeated. . If it is determined in step S135 that the display is to be ended, the controller 131 ends the process.
- the recording apparatus 1 can record the master HDR video on the optical disc 11 as the HDR video, and cause the playback apparatus 2 to play back the HDR video image on the display apparatus 3.
- the recording device 1 can convert the master HDR video into the STD video, record it on the optical disc 11, restore the HDR video to the playback device 2, and display the HDR video on the display device 3.
- the content author can display the HDR video image at the intended brightness. It becomes possible.
- BD graphics are displayed with standard dynamic range brightness, it is possible to prevent graphics such as subtitles from becoming difficult to see.
- the HDMI communication unit 132 of the display device 3 receives the STD video synthesized from the playback device 2 and combined with the BD graphics.
- the signal processing unit 133 displays the STD video received by the HDMI communication unit 132 on the monitor 134 as it is.
- FIG. 46 is a diagram illustrating an example of a screen displayed based on the BD-J object.
- BD-J object BD-J application described in a BD-J object
- BD-J graphics plane BD-J graphics plane and a background plane are generated.
- the BD-J graphics plane is synthesized before the video plane
- the background plane is synthesized behind the video plane.
- FIG. 47 is a diagram illustrating an example of processing for generating graphics for HDR synthesis based on BD-J graphics.
- BD-J graphics obtained by executing BD-J objects are represented by RGB values of 8 bits each. Since the BD graphics after the CLUT conversion described with reference to FIG. 16 are represented by YCrCb values, it is necessary to perform RGB conversion before assigning the pixel values, but the BD-J graphics are converted to HDR video. When combining, RGB conversion is not necessary.
- the process of synthesizing BD-J graphics into HDR video is basically the same as the process of synthesizing BD graphics into HDR video, except that RGB conversion is not required.
- the overlapping description will be omitted as appropriate.
- the calculation unit 98 constituting the graphics processing unit 59 of the playback device 2 calculates an allocation function based on the HDR information acquired by the HDR information acquisition unit 97, as indicated by the tip of arrow # 301. To do.
- the reverse gamma conversion unit 96 performs reverse gamma conversion on the RGB BD-J graphics as indicated by the tip of arrow # 302. Similar to BD graphics, gamma conversion is applied to BD-J graphics.
- the BD-J graphics after the inverse gamma conversion are represented by 8-bit R′G′B ′ values.
- the R′G′B ′ value and the luminance have a linear relationship.
- the allocation unit 99 uses the R′G′B ′ value, which is the pixel value of the BD-J graphics after the inverse gamma conversion, as an input to the allocation function, and outputs each as an output.
- R′G′B ′ value which is the pixel value of the BD-J graphics after the inverse gamma conversion
- the YCrCb conversion unit 100 converts R ′′ G ′′ B ′′ BD graphics into 10-bit Y′Cr′Cb ′ BD graphics as indicated by the tip of arrow # 304.
- the Y′Cr′Cb ′ BD-J graphics obtained by the conversion are graphics for HDR synthesis.
- FIG. 48 is a diagram illustrating an example of the synthesis process.
- the synthesizing unit 60 of the playback device 2 performs the HDR synthesis graphics generated based on the BD-J graphics and the HDR obtained by decoding the HEVC stream, as indicated by the arrows # 321 and # 322. Compose the video. As indicated by the tip of arrow # 323, the HDMI communication unit 61 outputs the combined HDR video to the display device 3 together with the HDR information.
- FIG. 49 is a diagram illustrating an example of the synthesis process of STD video and BD-J graphics.
- the YCrCb conversion unit 100 that constitutes the graphics processing unit 59 of the playback apparatus 2 applies the RGB BD-J graphics obtained by executing the BD-J object, as indicated by the tip of arrow # 331. Perform YCrCb conversion.
- BD-J graphics after YCrCb conversion are represented by 8-bit YCrCb values. Each 8-bit YCrCb is shifted to 10 bits.
- the synthesizing unit 60 synthesizes 10-bit YCrCb BD-J graphics and STD video as indicated by the tip of arrows # 332 and # 333.
- the HDMI communication unit 61 outputs the combined STD video to the display device 3 as indicated by the tip of arrow # 334.
- FIG. 50 is a block diagram illustrating a configuration example of the recording apparatus 1.
- a Data Base information generation unit 21A and a BD-J object generation unit 21B are realized by executing a predetermined program.
- the Data Base information generation unit 21 ⁇ / b> A generates a PlayList and Clip Information that are Data Base information, and outputs them to the disk drive 25.
- the BD-J object generation unit 21B generates a BD-J object that describes a BD-J graphics playback command based on the input graphics data.
- the BD-J object generation unit 21B outputs the generated BD-J object to the disc drive 25.
- the video encoding processing unit 22 encodes the master HDR video.
- the video encoding processing unit 22 outputs the HEVC stream obtained by encoding the master HDR video to the multiplexing unit 24.
- the multiplexing unit 24 multiplexes the HEVC stream supplied from the video encoding processing unit 22 and various data, and outputs the multiplexed stream to the disk drive 25.
- the disc drive 25 records the file that stores the PlayList, Clip Information, and BD-J objects supplied from the controller 21 and the multiplexed stream supplied from the multiplexing unit 24 on the optical disc 11 according to the directory structure of FIG. To do.
- FIG. 51 is a block diagram illustrating a configuration example of the playback device 2.
- the BD-J object execution unit 51A is realized by executing the BD-J object supplied from the disk drive 52.
- the BD-J object execution unit 51A functions as a BD-J graphics decoding unit, and generates BD-J graphics data according to a playback command.
- the BD-J object execution unit 51A outputs the generated BD-J graphics data to the graphics processing unit 59.
- the disk drive 52 outputs the Data Base information and the BD-J object read from the optical disk 11 to the controller 51, and outputs the multiplexed stream to the separation unit 57.
- the separation unit 57 separates the HEVC stream data from the multiplexed stream supplied from the disk drive 52.
- the separation unit 57 outputs the separated HEVC stream data to the video decoding processing unit 58.
- the graphics processing unit 59 processes the BD-J graphics data supplied from the BD-J object execution unit 51A, and outputs the BD-J graphics data to the synthesizing unit 60.
- the synthesizing unit 60 synthesizes the HDR video or STD video supplied from the video decoding processing unit 58 and the BD-J graphics supplied from the graphics processing unit 59, and the HDR video after the synthesis of the BD-J graphics Alternatively, the STD video data is output to the HDMI communication unit 61.
- FIG. 52 is a block diagram illustrating a configuration example of the graphics processing unit 59.
- BD-J graphics data supplied from the BD-J object execution unit 51A is input to the inverse gamma conversion unit 96 and the YCrCb conversion unit 100.
- the HDR information supplied from the video decoding processing unit 58 is input to the HDR information acquisition unit 97.
- the inverse gamma conversion unit 96 performs reverse gamma conversion on the BD-J graphics and outputs the result to the allocation unit 99.
- the HDR information acquisition unit 97 acquires the HDR information supplied from the video decoding processing unit 58 and outputs it to the calculation unit 98.
- the calculation unit 98 receives the pixel values of the BD-J graphics as input, and assigns an allocation function that outputs a 10-bit pixel value in the gamma function system of the HDR video, showing the same luminance as the luminance indicated by the pixel value, Calculation is performed based on the HDR information acquired by the HDR information acquisition unit 97.
- the calculation unit 98 outputs the allocation function obtained by calculation to the allocation unit 99.
- the allocation unit 99 allocates the RGB pixel values of the BD-J graphics after the inverse gamma conversion to the pixel values in the HDR video gamma function system, based on the allocation function obtained by the calculation unit 98.
- the allocation unit 99 outputs the BD-J graphics represented by each 10-bit RGB value after allocation to the YCrCb conversion unit 100.
- the YCrCb conversion unit 100 converts the RGB BD graphics supplied from the allocation unit 99 into 10-bit YCrCb BD graphics, and outputs them to the synthesis unit 60 as HDR synthesis graphics.
- the YCrCb conversion unit 100 converts the RGB BD-J graphics supplied from the BD-J object execution unit 51A into YCrCb BD-J graphics. .
- the YCrCb conversion unit 100 outputs the 10-bit YCrCb BD-J graphics after the bit shift to the synthesis unit 60 as STD synthesis graphics.
- each configuration of FIG. 50 that implements processing related to BD-J graphics can be provided in the recording apparatus 1 of FIG.
- each pixel value of BD graphics is assigned to a pixel value in the gamma function system of HDR video to generate data for HDR synthesis, but CLUT is based on HDR information Then, data for HDR synthesis may be generated by performing conversion using the CLUT after processing.
- the CLUT defined based on the palette information included in the graphics stream is processed based on the HDR information so that each 10-bit pixel value in the HDR video gamma function system is output.
- FIG. 53 is a diagram illustrating an example of processing for generating HDR composition graphics by performing CLUT processing.
- the CLUT management unit 94 constituting the graphics processing unit 59 of the playback apparatus 2 converts the CLUT defined based on the palette information into the gamma function of the HDR video based on the HDR information, as indicated by the tip of arrow # 351. Process into CLUT that outputs each 10-bit pixel value in the system.
- the CLUT before processing defined based on the palette information is a table that outputs each 8-bit YCrCb in the BD graphic gamma function system with respect to the input value.
- the CLUT management unit 94 performs conversion using the processed CLUT on the BD graphics obtained by decoding the PG stream, for example, as indicated by the tip of the arrow 352.
- the BD graphics after the CLUT conversion are represented by 10-bit Y′Cr′Cb ′ pixel values.
- Y'Cr'Cb 'BD graphics after CLUT conversion is used as graphics for HDR synthesis.
- the synthesizing unit 60 synthesizes the HDR synthesis graphics and the HDR video as indicated by arrows # 353 and # 354, and displays the synthesized HDR video together with the HDR information as indicated by the arrow # 355. Output to device 3.
- FIG. 54 is a block diagram showing the configuration of the graphics processing unit 59 that processes the CLUT.
- the configuration of the playback device 2 including the graphics processing unit 59 of FIG. 54 is the same as the configuration shown in FIG.
- the CLUT management unit 94 stores a CLUT defined based on palette information supplied from the graphics controller 115.
- the CLUT before processing is a table in which input values are associated with respective 8-bit YCrCb pixel values.
- the CLUT management unit 94 When synthesizing BD graphics into HDR video, the CLUT management unit 94 stores the stored CLUT based on the HDR information supplied from the HDR information acquisition unit 97 for each 10-bit YCrCb in the gamma function system of the HDR video. It is processed into a CLUT that outputs a pixel value (Y′Cr′Cb ′ in FIG. 53). Based on the processed CLUT, the CLUT management unit 94 converts the BD graphics plane data supplied from the graphics plane generation unit 93 into data consisting of 10-bit YCrCb values, and outputs the data as HDR synthesis graphics. To do.
- the CLUT management unit 94 converts each BD graphics plane data supplied from the graphics plane generation unit 93 based on the CLUT defined based on the palette information. Convert to data consisting of 8-bit YCrCb values.
- the CLUT management unit 94 outputs BD graphics plane data composed of 8-bit YCrCb values as STD composition graphics.
- the HDR information acquisition unit 97 acquires the HDR information supplied from the video decoding processing unit 58 and outputs it to the CLUT management unit 94.
- the processing of the playback apparatus 2 including the graphics processing unit 59 having such a configuration is the same as the processing of FIGS. 41 to 43 except for the processing of generating graphics for HDR synthesis.
- step S65 of FIG. 42 or step S86 of FIG. 43 will be described.
- step S201 the HDR information acquisition unit 97 of the graphics processing unit 59 acquires the HDR information extracted by the parameter extraction unit 71 of the video decoding processing unit 58.
- step S202 the CLUT management unit 94 processes the CLUT based on the HDR information acquired by the HDR information acquisition unit 97.
- step S203 the graphics decoder 92 decodes the graphics stream. Based on the data obtained by decoding the graphics stream, the graphics plane generating unit 93 generates a BD graphics plane.
- step S204 the CLUT management unit 94 converts the BD graphics plane into data composed of 10-bit YCrCb values based on the processed CLUT, and outputs the data to the synthesis unit 60 as HDR synthesis graphics. Thereafter, the process returns to step S65 in FIG. 42 or step S86 in FIG. 43, and the subsequent processing is performed.
- a new navigation command may be added, and the graphics dynamic range may be designated for the playback device 2 by the navigation command described in the movie object.
- a new API may be added, and the graphics dynamic range may be specified for the playback device 2 by a command described in the BD-J object.
- the graphics dynamic range may be designated for the playback apparatus 2 by the user's operation.
- Designation of the dynamic range of graphics for the playback device 2 is performed using one argument. For example, if the argument is 100, it indicates that the maximum luminance of the dynamic range is 100%. The case where the argument is less than 100 is handled in the same way.
- the argument is less than the maximum luminance of the dynamic range of the HDR video specified by extended_range_white_level.
- the maximum luminance of the graphics dynamic range is treated as the luminance specified by extended_range_white_level.
- a range of 0-101% or more may be designated to the playback apparatus 2 as a graphics dynamic range.
- FIG. 56 is a diagram showing a concept of pixel value allocation when a dynamic range of 0-101% or more is designated.
- the value V21 which is the pixel value of the original BD graphics, represents the luminance Y1 in the BD graphics function system indicated by the gamma function F11.
- the maximum luminance is specified as 200%, which is twice the standard luminance of 100%, as shown by an arrow # 401, HDR indicating a luminance Y2 that is twice the luminance Y1.
- V31 which is a pixel value in the video gamma function system.
- Such allocation of pixel values is performed by the allocation unit 99.
- HDR video data is transmitted from the playback device 2 to the display device 3, the HDR information is added and transmitted.
- the HDR video data may be transmitted without adding the HDR information.
- the playback device 2 is a BD player
- the above-described functions of the playback device 2 may be mounted on a mobile terminal.
- the portable terminal has a role as the playback device 2.
- the playback device 2 receives content transmitted from a server connected via a network such as the Internet, plays it, and outputs the HDR video to the display device 3.
- FIG. 57 is a block diagram showing an example of the hardware configuration of a computer that executes the above-described series of processing by a program.
- the CPU 501, the ROM 502, and the RAM 503 are connected to each other by a bus 504.
- An input / output interface 505 is further connected to the bus 504.
- the input / output interface 505 is connected to an input unit 506 including a keyboard and a mouse, and an output unit 507 including a display and a speaker.
- the input / output interface 505 is connected to a storage unit 508 including a hard disk and a non-volatile memory, a communication unit 509 including a network interface, and a drive 510 that drives a removable medium 511.
- the CPU 501 loads the program stored in the storage unit 508 to the RAM 503 via the input / output interface 505 and the bus 504 and executes the program, for example. Is done.
- the program executed by the CPU 501 is recorded on the removable medium 511 or provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting, and is installed in the storage unit 508.
- the program executed by the computer may be a program that is processed in time series in the order described in this specification, or in parallel or at a necessary timing such as when a call is made. It may be a program for processing.
- Embodiments of the present technology are not limited to the above-described embodiments, and various modifications can be made without departing from the gist of the present technology.
- the system means a set of a plurality of components (devices, modules (parts), etc.), and it does not matter whether all the components are in the same housing. Accordingly, a plurality of devices housed in separate housings and connected via a network and a single device housing a plurality of modules in one housing are all systems. .
- Encoded data of extended video which is a video having a second luminance range wider than the first luminance range, luminance characteristic information indicating luminance characteristics of the extended video, and the first video to be superimposed on the extended video
- a read unit that reads out the encoded data, the luminance characteristic information, and the graphics data from a recording medium that records graphics data of a luminance range;
- a first decoding unit for decoding the encoded data;
- the first pixel value of the graphics obtained by decoding is represented by the luminance characteristic information indicating the same luminance as the luminance indicated by the first pixel value on the luminance characteristic of the graphics.
- a first conversion unit for converting to a second pixel value on the luminance characteristics of the extended video;
- a playback device comprising: the extended video obtained by decoding the encoded data; and a synthesis unit that synthesizes graphics of the second pixel value.
- the playback device further including an output unit that outputs the data of the extended video obtained by synthesizing the graphics and the luminance characteristic information to a display device capable of displaying the extended video.
- the readout unit further reads out luminance conversion definition information recorded in the recording medium and used when performing luminance conversion from the extended video to the standard video,
- the playback device according to (1) or (2), wherein the second conversion unit converts the extended video into the standard video based on the luminance conversion definition information read from the recording medium.
- the playback device further including an output unit that outputs data of the standard video obtained by combining the graphics to a display device that cannot display the extended video.
- Encoded data of extended video which is a video having a second luminance range wider than the first luminance range, luminance characteristic information indicating luminance characteristics of the extended video, and the first video to be superimposed on the extended video
- a reproduction method including a step of combining the extended video obtained by decoding the encoded data and graphics of the second pixel value.
- Encoded data of extended video which is a video in a second luminance range wider than the first luminance range; Luminance characteristic information indicating luminance characteristics of the extended video; A recording medium for recording graphics data of the first luminance range to be superimposed on the extended video, In a playback device for playing back the recording medium, Read the encoded data, the luminance characteristic information, and the graphics data from the recording medium, Decoding the encoded data; Decoding the graphics data; The first pixel value of the graphics obtained by decoding is represented by the luminance characteristic information indicating the same luminance as the luminance indicated by the first pixel value on the luminance characteristic of the graphics. Converted to the second pixel value on the luminance characteristics of the extended video, A recording medium on which processing for synthesizing the extended video obtained by decoding the encoded data and graphics of the second pixel value is performed.
- the encoded data of the standard video which is the video in the first luminance range, obtained by performing the luminance conversion of the extended video, which is the video in the second luminance range wider than the first luminance range, the luminance of the extended video Luminance characteristic information indicating the characteristics of the video, luminance conversion definition information used when performing luminance conversion from the standard video to the extended video, and graphics of the first luminance range to be superimposed on the extended video
- a read unit that reads out the encoded data, the luminance characteristic information, the luminance conversion definition information, and the graphics data from a recording medium on which data is recorded;
- a first decoding unit for decoding the encoded data A first converter that converts the standard video obtained by decoding the encoded data into the extended video based on the luminance conversion definition information;
- the luminance characteristic wherein the first pixel value of the graphics obtained by decoding the graphics data shows the same luminance as the luminance indicated by the first pixel value on the luminance characteristic of the graphics
- the playback device further including an output unit that outputs the data of the extended video obtained by combining the graphics and the luminance characteristic information to a display device capable of displaying the extended video.
- the playback device further including an output unit that outputs the data of the standard video obtained by synthesizing the graphics to a display device that cannot display the extended video.
- the luminance characteristic information and the luminance conversion definition information are inserted into the stream including the encoded data as auxiliary information of the encoded data and recorded on the recording medium.
- the reproducing apparatus as described.
- the encoded data of the standard video which is the video in the first luminance range, obtained by performing the luminance conversion of the extended video, which is the video in the second luminance range wider than the first luminance range, the luminance of the extended video Luminance characteristic information indicating the characteristics of the video, luminance conversion definition information used when performing luminance conversion from the standard video to the extended video, and graphics of the first luminance range to be superimposed on the extended video
- Luminance characteristic information indicating the characteristics of the video
- luminance conversion definition information used when performing luminance conversion from the standard video to the extended video and graphics of the first luminance range to be superimposed on the extended video
- Encoded data of a standard video which is a video of the first luminance range, obtained by performing luminance conversion of an extended video that is a video of a second luminance range wider than the first luminance range; Luminance characteristic information indicating luminance characteristics of the extended video; Luminance conversion definition information used when performing luminance conversion from the standard video to the extended video; A recording medium for recording graphics data of the first luminance range to be superimposed on the extended video, In a playback device for playing back the recording medium, Read the encoded data, the luminance characteristic information, the luminance conversion definition information, and the graphics data from the recording medium, Decoding the encoded data; Converting the standard video obtained by decoding the encoded data into the extended video based on the luminance conversion definition information; Decoding the graphics data; The luminance characteristic, wherein the first pixel value of the graphics obtained by decoding the graphics data shows the same luminance as the luminance indicated by the first pixel value on the luminance characteristic of the graphics Converting to a second pixel value on the luminance characteristic
Abstract
Description
1.記録・再生システムについて
2.HEVCについて
3.BDグラフィックスの合成について
4.BDフォーマットについて
5.各装置の構成について
6.各装置の動作について
7.BD-Jグラフィックスの合成について
8.変形例
図1は、本技術の一実施形態に係る記録・再生システムの構成例を示す図である。
はじめに、ビデオの処理について説明する。
図4は、mode-iiにおけるビデオの信号処理の例を示す図である。
ここで、HEVCについて説明する。
上述したように、光ディスク11には、標準のダイナミックレンジのグラフィックスのデータが記録されている。再生装置2は、HEVCストリームをデコードして得られたHDRビデオまたはSTDビデオにPG,IGなどのグラフィックスを合成し、表示装置3に出力する。
はじめに、HDRビデオとBDグラフィックスの合成について説明する。
図19は、STDビデオとBDグラフィックスの合成処理の例を示す図である。
ここで、BD-ROMフォーマットについて説明する。
図20は、BD-ROMフォーマットにおけるAVストリームの管理構造の例を示す図である。
図22は、光ディスク11に記録されるファイルの管理構造の例を示す図である。
ここで、各ファイルのシンタクスの主な記述について説明する。
ここで、各装置の構成について説明する。
図27は、記録装置1の構成例を示すブロック図である。
図32は、再生装置2の構成例を示すブロック図である。
図36は、表示装置3の構成例を示すブロック図である。
ここで、以上のような構成を有する各装置の動作について説明する。
はじめに、図37のフローチャートを参照して、記録装置1の記録処理について説明する。図37の処理は、マスターのHDRビデオとBDグラフィックスのデータが記録装置1に入力されたときに開始される。
次に、図41のフローチャートを参照して、再生装置2の再生処理について説明する。
次に、図45のフローチャートを参照して、表示装置3の表示処理について説明する。
図46は、BD-Jオブジェクトに基づいて表示される画面の例を示す図である。
図47は、BD-Jグラフィックスに基づくHDR合成用グラフィックスの生成処理の例を示す図である。
図49は、STDビデオとBD-Jグラフィックスの合成処理の例を示す図である。
ここで、以上のようなBD-Jグラフィックスの合成を実現する各装置の構成について説明する。上述した構成と同じ構成には同じ符号を付してある。重複する説明については適宜省略する。
[CLUTを加工する例]
BDグラフィックスをHDRビデオに合成する場合、BDグラフィックスの各画素値をHDRビデオのガンマ関数系における画素値に割り付けてHDR合成用のデータを生成するものとしたが、CLUTをHDR情報に基づいて加工し、加工後のCLUTを用いて変換を行うことによってHDR合成用のデータを生成するようにしてもよい。
以上においては、0-100%の固定の範囲のダイナミックレンジを有するグラフィックスを再生装置2の内部で生成し、HDRビデオに合成するものとしたが、グラフィックスのダイナミックレンジが可変であってもよい。この場合、どの範囲のダイナミックレンジを有するグラフィックスを生成するのかが、光ディスク11に記録された情報によって、またはユーザによる操作によって再生装置2に対して指定される。
HDRビデオのデータを再生装置2から表示装置3に送信する場合、HDR情報を付加して送信するものとしたが、HDR情報を付加しないで送信するようにしてもよい。
上述した一連の処理は、ハードウェアにより実行することもできるし、ソフトウェアにより実行することもできる。一連の処理をソフトウェアにより実行する場合には、そのソフトウェアを構成するプログラムが、専用のハードウェアに組み込まれているコンピュータ、または汎用のパーソナルコンピュータなどに、プログラム記録媒体からインストールされる。
本技術は、以下のような構成をとることもできる。
第1の輝度範囲より広い第2の輝度範囲のビデオである拡張ビデオの符号化データ、前記拡張ビデオの輝度の特性を示す輝度特性情報、および、前記拡張ビデオに重畳される、前記第1の輝度範囲のグラフィックスのデータを記録した記録媒体から、前記符号化データ、前記輝度特性情報、および前記グラフィックスのデータを読み出す読み出し部と、
前記符号化データを復号する第1の復号部と、
前記グラフィックスのデータを復号する第2の復号部と、
復号して得られた前記グラフィックスの第1の画素値を、前記グラフィックスの輝度の特性上で前記第1の画素値が示す輝度と同じ輝度を示す、前記輝度特性情報により表される前記拡張ビデオの輝度の特性上における第2の画素値に変換する第1の変換部と、
前記符号化データを復号して得られた前記拡張ビデオと、前記第2の画素値のグラフィックスを合成する合成部と
を備える再生装置。
前記拡張ビデオを表示可能な表示装置に対して、前記グラフィックスを合成した前記拡張ビデオのデータと前記輝度特性情報を出力する出力部をさらに備える
前記(1)に記載の再生装置。
前記拡張ビデオを、前記第1の輝度範囲のビデオである標準ビデオに変換する第2の変換部をさらに備え、
前記読み出し部は、前記記録媒体に記録されている、前記拡張ビデオから前記標準ビデオへの輝度変換を行うときに用いられる輝度変換定義情報をさらに読み出し、
前記第2の変換部は、前記記録媒体から読み出された前記輝度変換定義情報に基づいて、前記拡張ビデオを前記標準ビデオに変換する
前記(1)または(2)に記載の再生装置。
前記合成部は、前記標準ビデオと、前記第1の画素値の前記グラフィックスを合成する
前記(3)に記載の再生装置。
前記拡張ビデオを表示することができない表示装置に対して、前記グラフィックスを合成した前記標準ビデオのデータを出力する出力部をさらに備える
前記(4)に記載の再生装置。
前記輝度特性情報と前記輝度変換定義情報は、前記符号化データを含むストリームに前記符号化データの補助情報として挿入され、前記記録媒体に記録される
前記(3)乃至(5)のいずれかに記載の再生装置。
前記符号化データはHEVCの符号化データであり、前記輝度特性情報と前記輝度変換定義情報はHEVCストリームのSEIである
前記(3)乃至(6)のいずれかに記載の再生装置。
第1の輝度範囲より広い第2の輝度範囲のビデオである拡張ビデオの符号化データ、前記拡張ビデオの輝度の特性を示す輝度特性情報、および、前記拡張ビデオに重畳される、前記第1の輝度範囲のグラフィックスのデータを記録した記録媒体から、前記符号化データ、前記輝度特性情報、および前記グラフィックスのデータを読み出し、
前記符号化データを復号し、
前記グラフィックスのデータを復号し、
復号して得られた前記グラフィックスの第1の画素値を、前記グラフィックスの輝度の特性上で前記第1の画素値が示す輝度と同じ輝度を示す、前記輝度特性情報により表される前記拡張ビデオの輝度の特性上における第2の画素値に変換し、
前記符号化データを復号して得られた前記拡張ビデオと、前記第2の画素値のグラフィックスを合成する
ステップを含む再生方法。
第1の輝度範囲より広い第2の輝度範囲のビデオである拡張ビデオの符号化データと、
前記拡張ビデオの輝度の特性を示す輝度特性情報と、
前記拡張ビデオに重畳される、前記第1の輝度範囲のグラフィックスのデータと
を記録した記録媒体であって、
前記記録媒体を再生する再生装置においては、
前記記録媒体から、前記符号化データ、前記輝度特性情報、および前記グラフィックスのデータを読み出し、
前記符号化データを復号し、
前記グラフィックスのデータを復号し、
復号して得られた前記グラフィックスの第1の画素値を、前記グラフィックスの輝度の特性上で前記第1の画素値が示す輝度と同じ輝度を示す、前記輝度特性情報により表される前記拡張ビデオの輝度の特性上における第2の画素値に変換し、
前記符号化データを復号して得られた前記拡張ビデオと、前記第2の画素値のグラフィックスを合成する
処理が行われる記録媒体。
第1の輝度範囲より広い第2の輝度範囲のビデオである拡張ビデオの輝度変換を行って得られた、前記第1の輝度範囲のビデオである標準ビデオの符号化データ、前記拡張ビデオの輝度の特性を示す輝度特性情報、前記標準ビデオから前記拡張ビデオへの輝度変換を行うときに用いられる輝度変換定義情報、および、前記拡張ビデオに重畳される、前記第1の輝度範囲のグラフィックスのデータを記録した記録媒体から、前記符号化データ、前記輝度特性情報、前記輝度変換定義情報、および前記グラフィックスのデータを読み出す読み出し部と、
前記符号化データを復号する第1の復号部と、
前記符号化データを復号して得られた前記標準ビデオを、前記輝度変換定義情報に基づいて前記拡張ビデオに変換する第1の変換部と、
前記グラフィックスのデータを復号する第2の復号部と、
前記グラフィックスのデータを復号して得られた前記グラフィックスの第1の画素値を、前記グラフィックスの輝度の特性上で前記第1の画素値が示す輝度と同じ輝度を示す、前記輝度特性情報により表される前記拡張ビデオの輝度の特性上における第2の画素値に変換する第2の変換部と、
前記標準ビデオを変換して得られた前記拡張ビデオと、前記第2の画素値のグラフィックスを合成する合成部と
を備える再生装置。
前記拡張ビデオを表示可能な表示装置に対して、前記グラフィックスを合成した前記拡張ビデオのデータと前記輝度特性情報を出力する出力部をさらに備える
前記(10)に記載の再生装置。
前記合成部は、前記符号化データを復号して得られた前記標準ビデオと、前記第1の画素値の前記グラフィックスを合成する
前記(10)に記載の再生装置。
前記拡張ビデオを表示することができない表示装置に対して、前記グラフィックスを合成した前記標準ビデオのデータを出力する出力部をさらに備える
前記(12)に記載の再生装置。
前記輝度特性情報と前記輝度変換定義情報は、前記符号化データを含むストリームに前記符号化データの補助情報として挿入され、前記記録媒体に記録される
前記(10)乃至(13)のいずれかに記載の再生装置。
前記符号化データはHEVCの符号化データであり、前記輝度特性情報と前記輝度変換定義情報はHEVCストリームのSEIである
前記(14)に記載の再生装置。
第1の輝度範囲より広い第2の輝度範囲のビデオである拡張ビデオの輝度変換を行って得られた、前記第1の輝度範囲のビデオである標準ビデオの符号化データ、前記拡張ビデオの輝度の特性を示す輝度特性情報、前記標準ビデオから前記拡張ビデオへの輝度変換を行うときに用いられる輝度変換定義情報、および、前記拡張ビデオに重畳される、前記第1の輝度範囲のグラフィックスのデータを記録した記録媒体から、前記符号化データ、前記輝度特性情報、前記輝度変換定義情報、および前記グラフィックスのデータを読み出し、
前記符号化データを復号し、
前記符号化データを復号して得られた前記標準ビデオを、前記輝度変換定義情報に基づいて前記拡張ビデオに変換し、
前記グラフィックスのデータを復号し、
前記グラフィックスのデータを復号して得られた前記グラフィックスの第1の画素値を、前記グラフィックスの輝度の特性上で前記第1の画素値が示す輝度と同じ輝度を示す、前記輝度特性情報により表される前記拡張ビデオの輝度の特性上における第2の画素値に変換し、
前記標準ビデオを変換して得られた前記拡張ビデオと、前記第2の画素値のグラフィックスを合成する
ステップを含む再生方法。
第1の輝度範囲より広い第2の輝度範囲のビデオである拡張ビデオの輝度変換を行って得られた、前記第1の輝度範囲のビデオである標準ビデオの符号化データと、
前記拡張ビデオの輝度の特性を示す輝度特性情報と、
前記標準ビデオから前記拡張ビデオへの輝度変換を行うときに用いられる輝度変換定義情報と、
前記拡張ビデオに重畳される、前記第1の輝度範囲のグラフィックスのデータと
を記録した記録媒体であって、
前記記録媒体を再生する再生装置においては、
前記記録媒体から、前記符号化データ、前記輝度特性情報、前記輝度変換定義情報、および前記グラフィックスのデータを読み出し、
前記符号化データを復号し、
前記符号化データを復号して得られた前記標準ビデオを、前記輝度変換定義情報に基づいて前記拡張ビデオに変換し、
前記グラフィックスのデータを復号し、
前記グラフィックスのデータを復号して得られた前記グラフィックスの第1の画素値を、前記グラフィックスの輝度の特性上で前記第1の画素値が示す輝度と同じ輝度を示す、前記輝度特性情報により表される前記拡張ビデオの輝度の特性上における第2の画素値に変換し、
前記標準ビデオを変換して得られた前記拡張ビデオと、前記第2の画素値のグラフィックスを合成する
処理が行われる記録媒体。
Claims (17)
- 第1の輝度範囲より広い第2の輝度範囲のビデオである拡張ビデオの符号化データ、前記拡張ビデオの輝度の特性を示す輝度特性情報、および、前記拡張ビデオに重畳される、前記第1の輝度範囲のグラフィックスのデータを記録した記録媒体から、前記符号化データ、前記輝度特性情報、および前記グラフィックスのデータを読み出す読み出し部と、
前記符号化データを復号する第1の復号部と、
前記グラフィックスのデータを復号する第2の復号部と、
復号して得られた前記グラフィックスの第1の画素値を、前記グラフィックスの輝度の特性上で前記第1の画素値が示す輝度と同じ輝度を示す、前記輝度特性情報により表される前記拡張ビデオの輝度の特性上における第2の画素値に変換する第1の変換部と、
前記符号化データを復号して得られた前記拡張ビデオと、前記第2の画素値のグラフィックスを合成する合成部と
を備える再生装置。 - 前記拡張ビデオを表示可能な表示装置に対して、前記グラフィックスを合成した前記拡張ビデオのデータと前記輝度特性情報を出力する出力部をさらに備える
請求項1に記載の再生装置。 - 前記拡張ビデオを、前記第1の輝度範囲のビデオである標準ビデオに変換する第2の変換部をさらに備え、
前記読み出し部は、前記記録媒体に記録されている、前記拡張ビデオから前記標準ビデオへの輝度変換を行うときに用いられる輝度変換定義情報をさらに読み出し、
前記第2の変換部は、前記記録媒体から読み出された前記輝度変換定義情報に基づいて、前記拡張ビデオを前記標準ビデオに変換する
請求項1に記載の再生装置。 - 前記合成部は、前記標準ビデオと、前記第1の画素値の前記グラフィックスを合成する
請求項3に記載の再生装置。 - 前記拡張ビデオを表示することができない表示装置に対して、前記グラフィックスを合成した前記標準ビデオのデータを出力する出力部をさらに備える
請求項4に記載の再生装置。 - 前記輝度特性情報と前記輝度変換定義情報は、前記符号化データを含むストリームに前記符号化データの補助情報として挿入され、前記記録媒体に記録される
請求項3に記載の再生装置。 - 前記符号化データはHEVCの符号化データであり、前記輝度特性情報と前記輝度変換定義情報はHEVCストリームのSEIである
請求項6に記載の再生装置。 - 第1の輝度範囲より広い第2の輝度範囲のビデオである拡張ビデオの符号化データ、前記拡張ビデオの輝度の特性を示す輝度特性情報、および、前記拡張ビデオに重畳される、前記第1の輝度範囲のグラフィックスのデータを記録した記録媒体から、前記符号化データ、前記輝度特性情報、および前記グラフィックスのデータを読み出し、
前記符号化データを復号し、
前記グラフィックスのデータを復号し、
復号して得られた前記グラフィックスの第1の画素値を、前記グラフィックスの輝度の特性上で前記第1の画素値が示す輝度と同じ輝度を示す、前記輝度特性情報により表される前記拡張ビデオの輝度の特性上における第2の画素値に変換し、
前記符号化データを復号して得られた前記拡張ビデオと、前記第2の画素値のグラフィックスを合成する
ステップを含む再生方法。 - 第1の輝度範囲より広い第2の輝度範囲のビデオである拡張ビデオの符号化データと、
前記拡張ビデオの輝度の特性を示す輝度特性情報と、
前記拡張ビデオに重畳される、前記第1の輝度範囲のグラフィックスのデータと
を記録した記録媒体であって、
前記記録媒体を再生する再生装置においては、
前記記録媒体から、前記符号化データ、前記輝度特性情報、および前記グラフィックスのデータを読み出し、
前記符号化データを復号し、
前記グラフィックスのデータを復号し、
復号して得られた前記グラフィックスの第1の画素値を、前記グラフィックスの輝度の特性上で前記第1の画素値が示す輝度と同じ輝度を示す、前記輝度特性情報により表される前記拡張ビデオの輝度の特性上における第2の画素値に変換し、
前記符号化データを復号して得られた前記拡張ビデオと、前記第2の画素値のグラフィックスを合成する
処理が行われる記録媒体。 - 第1の輝度範囲より広い第2の輝度範囲のビデオである拡張ビデオの輝度変換を行って得られた、前記第1の輝度範囲のビデオである標準ビデオの符号化データ、前記拡張ビデオの輝度の特性を示す輝度特性情報、前記標準ビデオから前記拡張ビデオへの輝度変換を行うときに用いられる輝度変換定義情報、および、前記拡張ビデオに重畳される、前記第1の輝度範囲のグラフィックスのデータを記録した記録媒体から、前記符号化データ、前記輝度特性情報、前記輝度変換定義情報、および前記グラフィックスのデータを読み出す読み出し部と、
前記符号化データを復号する第1の復号部と、
前記符号化データを復号して得られた前記標準ビデオを、前記輝度変換定義情報に基づいて前記拡張ビデオに変換する第1の変換部と、
前記グラフィックスのデータを復号する第2の復号部と、
前記グラフィックスのデータを復号して得られた前記グラフィックスの第1の画素値を、前記グラフィックスの輝度の特性上で前記第1の画素値が示す輝度と同じ輝度を示す、前記輝度特性情報により表される前記拡張ビデオの輝度の特性上における第2の画素値に変換する第2の変換部と、
前記標準ビデオを変換して得られた前記拡張ビデオと、前記第2の画素値のグラフィックスを合成する合成部と
を備える再生装置。 - 前記拡張ビデオを表示可能な表示装置に対して、前記グラフィックスを合成した前記拡張ビデオのデータと前記輝度特性情報を出力する出力部をさらに備える
請求項10に記載の再生装置。 - 前記合成部は、前記符号化データを復号して得られた前記標準ビデオと、前記第1の画素値の前記グラフィックスを合成する
請求項10に記載の再生装置。 - 前記拡張ビデオを表示することができない表示装置に対して、前記グラフィックスを合成した前記標準ビデオのデータを出力する出力部をさらに備える
請求項12に記載の再生装置。 - 前記輝度特性情報と前記輝度変換定義情報は、前記符号化データを含むストリームに前記符号化データの補助情報として挿入され、前記記録媒体に記録される
請求項10に記載の再生装置。 - 前記符号化データはHEVCの符号化データであり、前記輝度特性情報と前記輝度変換定義情報はHEVCストリームのSEIである
請求項14に記載の再生装置。 - 第1の輝度範囲より広い第2の輝度範囲のビデオである拡張ビデオの輝度変換を行って得られた、前記第1の輝度範囲のビデオである標準ビデオの符号化データ、前記拡張ビデオの輝度の特性を示す輝度特性情報、前記標準ビデオから前記拡張ビデオへの輝度変換を行うときに用いられる輝度変換定義情報、および、前記拡張ビデオに重畳される、前記第1の輝度範囲のグラフィックスのデータを記録した記録媒体から、前記符号化データ、前記輝度特性情報、前記輝度変換定義情報、および前記グラフィックスのデータを読み出し、
前記符号化データを復号し、
前記符号化データを復号して得られた前記標準ビデオを、前記輝度変換定義情報に基づいて前記拡張ビデオに変換し、
前記グラフィックスのデータを復号し、
前記グラフィックスのデータを復号して得られた前記グラフィックスの第1の画素値を、前記グラフィックスの輝度の特性上で前記第1の画素値が示す輝度と同じ輝度を示す、前記輝度特性情報により表される前記拡張ビデオの輝度の特性上における第2の画素値に変換し、
前記標準ビデオを変換して得られた前記拡張ビデオと、前記第2の画素値のグラフィックスを合成する
ステップを含む再生方法。 - 第1の輝度範囲より広い第2の輝度範囲のビデオである拡張ビデオの輝度変換を行って得られた、前記第1の輝度範囲のビデオである標準ビデオの符号化データと、
前記拡張ビデオの輝度の特性を示す輝度特性情報と、
前記標準ビデオから前記拡張ビデオへの輝度変換を行うときに用いられる輝度変換定義情報と、
前記拡張ビデオに重畳される、前記第1の輝度範囲のグラフィックスのデータと
を記録した記録媒体であって、
前記記録媒体を再生する再生装置においては、
前記記録媒体から、前記符号化データ、前記輝度特性情報、前記輝度変換定義情報、および前記グラフィックスのデータを読み出し、
前記符号化データを復号し、
前記符号化データを復号して得られた前記標準ビデオを、前記輝度変換定義情報に基づいて前記拡張ビデオに変換し、
前記グラフィックスのデータを復号し、
前記グラフィックスのデータを復号して得られた前記グラフィックスの第1の画素値を、前記グラフィックスの輝度の特性上で前記第1の画素値が示す輝度と同じ輝度を示す、前記輝度特性情報により表される前記拡張ビデオの輝度の特性上における第2の画素値に変換し、
前記標準ビデオを変換して得られた前記拡張ビデオと、前記第2の画素値のグラフィックスを合成する
処理が行われる記録媒体。
Priority Applications (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CA2917212A CA2917212C (en) | 2013-07-12 | 2014-07-02 | Reproduction device, reproduction method, and recording medium |
MX2015017583A MX352400B (es) | 2013-07-12 | 2014-07-02 | Dispositivo de reproducción, método de reproducción y medio de grabación. |
EP14823715.9A EP3021573B1 (en) | 2013-07-12 | 2014-07-02 | Player device, play method, and recording medium |
US14/901,870 US10171787B2 (en) | 2013-07-12 | 2014-07-02 | Reproduction device, reproduction method, and recording medium for displaying graphics having appropriate brightness |
JP2015526280A JP6528683B2 (ja) | 2013-07-12 | 2014-07-02 | 再生装置、再生方法 |
CN201480037524.6A CN105359507B (zh) | 2013-07-12 | 2014-07-02 | 再现装置、再现方法和记录介质 |
KR1020157034849A KR102223751B1 (ko) | 2013-07-12 | 2014-07-02 | 재생 장치, 재생 방법, 및 기록 매체 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2013146740 | 2013-07-12 | ||
JP2013-146740 | 2013-07-12 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2015005189A1 true WO2015005189A1 (ja) | 2015-01-15 |
Family
ID=52279874
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2014/067645 WO2015005189A1 (ja) | 2013-07-12 | 2014-07-02 | 再生装置、再生方法、および記録媒体 |
Country Status (10)
Country | Link |
---|---|
US (1) | US10171787B2 (ja) |
EP (1) | EP3021573B1 (ja) |
JP (2) | JP6528683B2 (ja) |
KR (1) | KR102223751B1 (ja) |
CN (1) | CN105359507B (ja) |
CA (1) | CA2917212C (ja) |
MX (1) | MX352400B (ja) |
MY (1) | MY173495A (ja) |
TW (1) | TWI627627B (ja) |
WO (1) | WO2015005189A1 (ja) |
Cited By (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2015141333A (ja) * | 2014-01-29 | 2015-08-03 | キヤノン株式会社 | 画像処理装置、画像処理方法、表示装置、表示装置の制御方法、及び、プログラム |
WO2016038950A1 (ja) * | 2014-09-11 | 2016-03-17 | ソニー株式会社 | 画像処理装置及び画像処理方法 |
WO2016092759A1 (ja) * | 2014-12-09 | 2016-06-16 | パナソニックIpマネジメント株式会社 | 送信方法、受信方法、送信装置および受信装置 |
WO2016117383A1 (ja) * | 2015-01-23 | 2016-07-28 | ソニー株式会社 | 再生装置、情報処理方法、およびプログラム |
WO2017026230A1 (ja) * | 2015-08-11 | 2017-02-16 | ソニー株式会社 | 情報処理装置、および情報処理方法、並びにプログラム |
EP3145167A1 (en) * | 2014-05-16 | 2017-03-22 | Panasonic Intellectual Property Management Co., Ltd. | Conversion method and conversion device |
JP2017097941A (ja) * | 2015-11-12 | 2017-06-01 | ソニー株式会社 | 情報処理装置、情報記録媒体、および情報処理方法、並びにプログラム |
JP2017134421A (ja) * | 2014-06-10 | 2017-08-03 | パナソニックIpマネジメント株式会社 | 再生装置、再生方法、および、コンピュータプログラム |
WO2018012244A1 (ja) * | 2016-07-11 | 2018-01-18 | シャープ株式会社 | 映像信号変換装置、映像信号変換方法、映像信号変換システム、制御プログラム、および記録媒体 |
US20190075296A1 (en) * | 2014-06-27 | 2019-03-07 | Panasonic Intellectual Property Management Co., Ltd. | Data output apparatus, data output method, and data generation method |
JP2019506817A (ja) * | 2015-11-24 | 2019-03-07 | コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. | 複数のhdr画像ソースの処理 |
JP2019118058A (ja) * | 2017-12-27 | 2019-07-18 | キヤノン株式会社 | 電子機器 |
JP2019213215A (ja) * | 2014-09-22 | 2019-12-12 | パナソニックIpマネジメント株式会社 | ネットワークサーバ装置および配信方法 |
US10708560B2 (en) | 2014-09-22 | 2020-07-07 | Panasonic Intellectual Property Management Co., Ltd. | Reproduction method and reproduction apparatus |
JP2020198612A (ja) * | 2014-12-09 | 2020-12-10 | パナソニックIpマネジメント株式会社 | 受信方法および受信装置 |
Families Citing this family (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
MX356133B (es) * | 2013-09-27 | 2018-05-14 | Sony Corp | Dispositivo de reproducción, método de reproducción y medio de grabación. |
KR101978222B1 (ko) | 2014-07-11 | 2019-05-14 | 엘지전자 주식회사 | 방송 신호 송수신 방법 및 장치 |
KR20170007333A (ko) * | 2014-07-11 | 2017-01-18 | 엘지전자 주식회사 | 방송 신호 송수신 방법 및 장치 |
US10368144B2 (en) | 2014-07-29 | 2019-07-30 | Lg Electronics Inc. | Method and device for transmitting and receiving broadcast signal |
WO2016038811A1 (ja) * | 2014-09-12 | 2016-03-17 | パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ | 記録媒体、再生装置、および再生方法 |
US10924184B2 (en) | 2014-11-07 | 2021-02-16 | Sony Corporation | Transmission apparatus, transmission method, reception apparatus, and reception method |
HUE056171T2 (hu) * | 2014-12-29 | 2022-01-28 | Sony Group Corp | Adókészülék, adási eljárás, vevõkészülék és vételi eljárás |
US10200690B2 (en) * | 2015-09-22 | 2019-02-05 | Qualcomm Incorporated | Video decoder conformance for high dynamic range (HDR) video coding using a core video standard |
CN109792504B (zh) * | 2016-09-29 | 2021-08-03 | 松下知识产权经营株式会社 | 再生方法、生成方法、再生装置、生成装置以及记录介质 |
KR102534495B1 (ko) * | 2017-01-16 | 2023-05-22 | 소니그룹주식회사 | 비디오 처리 장치, 비디오 처리 방법 및 프로그램 |
US9986200B1 (en) * | 2017-05-11 | 2018-05-29 | Novatek Microelectronics Corp. | Method and video conversion system of updating video setting |
JP7117558B2 (ja) | 2017-07-07 | 2022-08-15 | パナソニックIpマネジメント株式会社 | 映像表示装置及び映像表示方法 |
EP3687162B1 (en) * | 2017-09-21 | 2022-11-16 | Sony Group Corporation | Reproduction device, reproduction method and recording medium |
CN111462268B (zh) * | 2020-03-31 | 2022-11-11 | 北京市商汤科技开发有限公司 | 图像重建方法及装置、电子设备和存储介质 |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006013750A (ja) * | 2004-06-24 | 2006-01-12 | Canon Inc | 映像処理方法及び装置 |
JP2007257641A (ja) * | 2006-03-24 | 2007-10-04 | Sharp Corp | トーンマッピングのメッセージングのための方法、システム、画像受信装置、画像送信装置、およびプログラム |
JP2007534238A (ja) * | 2004-04-23 | 2007-11-22 | ブライトサイド テクノロジーズ インコーポレイテッド | 高ダイナミックレンジ画像の符号化、復号化、及び表現 |
JP2009058692A (ja) | 2007-08-30 | 2009-03-19 | Sony Corp | 表示装置およびその駆動方法、電子機器 |
JP2009089209A (ja) | 2007-10-02 | 2009-04-23 | Sony Computer Entertainment Inc | 送信装置、画像データ送信方法、受信装置および受信装置における画像表示方法 |
JP2010213360A (ja) * | 2006-02-24 | 2010-09-24 | Sharp Corp | 画像データの符号化方法 |
WO2012147010A1 (en) * | 2011-04-28 | 2012-11-01 | Koninklijke Philips Electronics N.V. | Method and apparatus for generating an image coding signal |
Family Cites Families (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2006025359A1 (ja) * | 2004-09-03 | 2006-03-09 | Sharp Kabushiki Kaisha | 表示装置の駆動方法、表示装置の駆動装置、そのプログラムおよび記録媒体、並びに、表示装置 |
JP4372747B2 (ja) * | 2005-01-25 | 2009-11-25 | シャープ株式会社 | 輝度レベル変換装置、輝度レベル変換方法、固体撮像装置、輝度レベル変換プログラム、および記録媒体 |
US20070076971A1 (en) * | 2005-09-30 | 2007-04-05 | Nokia Corporation | Compression of images for computer graphics |
TWI466093B (zh) * | 2007-06-26 | 2014-12-21 | Apple Inc | 用於視訊播放的管理技術 |
US8135230B2 (en) * | 2007-07-30 | 2012-03-13 | Dolby Laboratories Licensing Corporation | Enhancing dynamic ranges of images |
EP2045774B1 (en) * | 2007-10-05 | 2016-05-04 | Sony Computer Entertainment Europe Ltd. | Homography estimation from multithreshold edges of a feature |
WO2012122423A1 (en) * | 2011-03-10 | 2012-09-13 | Dolby Laboratories Licensing Corporation | Pre-processing for bitdepth and color format scalable video coding |
EP2684365A1 (en) * | 2011-03-10 | 2014-01-15 | Dolby Laboratories Licensing Corporation | Bitdepth and color scalable video coding |
US20130131985A1 (en) * | 2011-04-11 | 2013-05-23 | James D. Weiland | Wearable electronic image acquisition and enhancement system and method for image acquisition and visual enhancement |
WO2012172460A1 (en) * | 2011-06-14 | 2012-12-20 | Koninklijke Philips Electronics N.V. | Graphics processing for high dynamic range video |
UA116082C2 (uk) * | 2011-09-27 | 2018-02-12 | Конінклійке Філіпс Н.В. | Пристрій та спосіб для перетворення динамічного діапазону зображень |
JP2013110540A (ja) * | 2011-11-18 | 2013-06-06 | Sony Corp | 画像データ送信装置、画像データ送信方法、画像データ受信装置および画像データ受信方法 |
EP2919471A4 (en) * | 2012-11-12 | 2016-07-13 | Lg Electronics Inc | SIGNAL TRANSMITTING APPARATUS AND SIGNAL TRANSMITTING-RECEIVING METHOD |
JP2014155005A (ja) * | 2013-02-07 | 2014-08-25 | Canon Inc | 表示装置及びその制御方法 |
MY178948A (en) * | 2013-06-20 | 2020-10-23 | Sony Corp | Reproduction device, reproduction method, and recording medium |
JP2015005878A (ja) * | 2013-06-20 | 2015-01-08 | ソニー株式会社 | 再生装置、再生方法、および記録媒体 |
TWI630820B (zh) * | 2013-07-19 | 2018-07-21 | 新力股份有限公司 | File generation device, file generation method, file reproduction device, and file reproduction method |
JP6241683B2 (ja) * | 2013-08-20 | 2017-12-06 | ソニー株式会社 | 再生装置、再生方法、および記録媒体 |
US9036908B2 (en) * | 2013-09-30 | 2015-05-19 | Apple Inc. | Backwards compatible extended image format |
US9854270B2 (en) * | 2013-12-19 | 2017-12-26 | Qualcomm Incorporated | Device and method for scalable coding of video information |
JP6381215B2 (ja) * | 2014-01-29 | 2018-08-29 | キヤノン株式会社 | 画像処理装置、画像処理方法、表示装置、表示装置の制御方法、及び、プログラム |
US10880565B2 (en) * | 2014-03-24 | 2020-12-29 | Qualcomm Incorporated | Use of specific HEVC SEI messages for multi-layer video codecs |
WO2015175549A1 (en) * | 2014-05-12 | 2015-11-19 | Apple Inc. | Techniques for hdr/wcr video coding |
US9984446B2 (en) * | 2015-12-26 | 2018-05-29 | Intel Corporation | Video tone mapping for converting high dynamic range (HDR) content to standard dynamic range (SDR) content |
-
2014
- 2014-07-02 MY MYPI2015704806A patent/MY173495A/en unknown
- 2014-07-02 CN CN201480037524.6A patent/CN105359507B/zh active Active
- 2014-07-02 JP JP2015526280A patent/JP6528683B2/ja active Active
- 2014-07-02 CA CA2917212A patent/CA2917212C/en active Active
- 2014-07-02 WO PCT/JP2014/067645 patent/WO2015005189A1/ja active Application Filing
- 2014-07-02 MX MX2015017583A patent/MX352400B/es active IP Right Grant
- 2014-07-02 US US14/901,870 patent/US10171787B2/en active Active
- 2014-07-02 TW TW103122845A patent/TWI627627B/zh not_active IP Right Cessation
- 2014-07-02 KR KR1020157034849A patent/KR102223751B1/ko active IP Right Grant
- 2014-07-02 EP EP14823715.9A patent/EP3021573B1/en active Active
-
2019
- 2019-03-06 JP JP2019040875A patent/JP6684456B2/ja active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2007534238A (ja) * | 2004-04-23 | 2007-11-22 | ブライトサイド テクノロジーズ インコーポレイテッド | 高ダイナミックレンジ画像の符号化、復号化、及び表現 |
JP2006013750A (ja) * | 2004-06-24 | 2006-01-12 | Canon Inc | 映像処理方法及び装置 |
JP2010213360A (ja) * | 2006-02-24 | 2010-09-24 | Sharp Corp | 画像データの符号化方法 |
JP2007257641A (ja) * | 2006-03-24 | 2007-10-04 | Sharp Corp | トーンマッピングのメッセージングのための方法、システム、画像受信装置、画像送信装置、およびプログラム |
JP2009058692A (ja) | 2007-08-30 | 2009-03-19 | Sony Corp | 表示装置およびその駆動方法、電子機器 |
JP2009089209A (ja) | 2007-10-02 | 2009-04-23 | Sony Computer Entertainment Inc | 送信装置、画像データ送信方法、受信装置および受信装置における画像表示方法 |
WO2012147010A1 (en) * | 2011-04-28 | 2012-11-01 | Koninklijke Philips Electronics N.V. | Method and apparatus for generating an image coding signal |
Non-Patent Citations (3)
Title |
---|
GARY SULLIVAN ET AL.: "New profiles for professional applications", AMENDMENT TO ITU-T REC. H.264 & ISO/IEC 14496-10(AMENDMENT 2 TO 2005 EDITION), JOINT VIDEO TEAM (JVT) OF ISO/IEC MPEG & ITU-T VCEG (ISO/IEC JTC 1/SC 29/WG 11 AND ITU-T SG 16 Q.6), JVT-V204, 22ND MEETING, January 2007 (2007-01-01), pages 1 - 4, XP030006948 * |
SALLY HATTORI ET AL.: "Signalling of Luminance Dynamic Range in Tone mapping information SEI", JOINT COLLABORATIVE TEAM ON VIDEO CODING (JCT- VC) OF ITU-T SG 16 WP 3 AND ISO/IEC JTC 1/SC 29/WG 11, JCTVC-J0149, 10TH MEETING, July 2012 (2012-07-01), STOCKHOLM, SE, pages 1 - 7, XP030053806 * |
See also references of EP3021573A4 |
Cited By (39)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2015141333A (ja) * | 2014-01-29 | 2015-08-03 | キヤノン株式会社 | 画像処理装置、画像処理方法、表示装置、表示装置の制御方法、及び、プログラム |
US11375168B2 (en) | 2014-05-16 | 2022-06-28 | Panasonic Intellectual Property Management Co., Ltd. | Method for converting luminance range of picture signal |
US9967533B2 (en) | 2014-05-16 | 2018-05-08 | Panasonic Intellectual Property Management Co., Ltd. | Method for converting luminance range of picture signal |
US11057600B2 (en) | 2014-05-16 | 2021-07-06 | Panasonic Intellectual Property Management Co., Ltd. | Method for converting luminance range of picture signal |
EP3678359A1 (en) * | 2014-05-16 | 2020-07-08 | Panasonic Intellectual Property Management Co., Ltd. | Converting method and converting apparatus |
EP3145167A1 (en) * | 2014-05-16 | 2017-03-22 | Panasonic Intellectual Property Management Co., Ltd. | Conversion method and conversion device |
EP3145167A4 (en) * | 2014-05-16 | 2017-04-05 | Panasonic Intellectual Property Management Co., Ltd. | Conversion method and conversion device |
US10708565B2 (en) | 2014-05-16 | 2020-07-07 | Panasonic Intellectual Property Management Co., Ltd. | Method for converting luminance range of picture signal |
US10362286B2 (en) | 2014-05-16 | 2019-07-23 | Panasonic Intellectual Property Management Co., Ltd. | Method for converting luminance range of picture signal |
JP2017134421A (ja) * | 2014-06-10 | 2017-08-03 | パナソニックIpマネジメント株式会社 | 再生装置、再生方法、および、コンピュータプログラム |
JP2017134420A (ja) * | 2014-06-10 | 2017-08-03 | パナソニックIpマネジメント株式会社 | 再生装置、再生方法、及び、コンピュータプログラム |
US11310507B2 (en) | 2014-06-27 | 2022-04-19 | Panasonic Intellectual Property Management Co., Ltd. | Data output apparatus, data output method, and data generation method |
US10645390B2 (en) * | 2014-06-27 | 2020-05-05 | Panasonic Intellectual Property Management Co., Ltd. | Data output apparatus, data output method, and data generation method |
US20190075296A1 (en) * | 2014-06-27 | 2019-03-07 | Panasonic Intellectual Property Management Co., Ltd. | Data output apparatus, data output method, and data generation method |
US11856200B2 (en) | 2014-06-27 | 2023-12-26 | Panasonic Intellectual Property Management Co., Ltd. | Data output apparatus, data output method, and data generation method |
US10032300B2 (en) | 2014-09-11 | 2018-07-24 | Sony Corporation | Image processing apparatus and image processing method |
JPWO2016038950A1 (ja) * | 2014-09-11 | 2017-06-22 | ソニー株式会社 | 画像処理装置及び画像処理方法 |
US9501855B2 (en) | 2014-09-11 | 2016-11-22 | Sony Corporation | Image processing apparatus and image processing method |
US9665964B2 (en) | 2014-09-11 | 2017-05-30 | Sony Corporation | Image processing apparatus and image processing method |
US10402681B2 (en) | 2014-09-11 | 2019-09-03 | Sony Corporation | Image processing apparatus and image processing method |
WO2016038950A1 (ja) * | 2014-09-11 | 2016-03-17 | ソニー株式会社 | 画像処理装置及び画像処理方法 |
JP2019213215A (ja) * | 2014-09-22 | 2019-12-12 | パナソニックIpマネジメント株式会社 | ネットワークサーバ装置および配信方法 |
US10708560B2 (en) | 2014-09-22 | 2020-07-07 | Panasonic Intellectual Property Management Co., Ltd. | Reproduction method and reproduction apparatus |
JP2020198612A (ja) * | 2014-12-09 | 2020-12-10 | パナソニックIpマネジメント株式会社 | 受信方法および受信装置 |
WO2016092759A1 (ja) * | 2014-12-09 | 2016-06-16 | パナソニックIpマネジメント株式会社 | 送信方法、受信方法、送信装置および受信装置 |
JP7174924B2 (ja) | 2014-12-09 | 2022-11-18 | パナソニックIpマネジメント株式会社 | 受信方法および受信装置 |
JP7361289B2 (ja) | 2014-12-09 | 2023-10-16 | パナソニックIpマネジメント株式会社 | 受信方法および受信装置 |
JP2022095692A (ja) * | 2014-12-09 | 2022-06-28 | パナソニックIpマネジメント株式会社 | 受信方法および受信装置 |
US10547821B2 (en) | 2015-01-23 | 2020-01-28 | Sony Corporation | Reproduction apparatus and information processing method |
JPWO2016117383A1 (ja) * | 2015-01-23 | 2017-11-02 | ソニー株式会社 | 再生装置、情報処理方法、およびプログラム |
CN107211108A (zh) * | 2015-01-23 | 2017-09-26 | 索尼公司 | 再现设备、信息处理方法以及程序 |
CN107211108B (zh) * | 2015-01-23 | 2020-10-13 | 索尼公司 | 再现设备、信息处理方法以及程序 |
WO2016117383A1 (ja) * | 2015-01-23 | 2016-07-28 | ソニー株式会社 | 再生装置、情報処理方法、およびプログラム |
WO2017026230A1 (ja) * | 2015-08-11 | 2017-02-16 | ソニー株式会社 | 情報処理装置、および情報処理方法、並びにプログラム |
JPWO2017026230A1 (ja) * | 2015-08-11 | 2018-06-07 | ソニー株式会社 | 情報処理装置、および情報処理方法、並びにプログラム |
JP2017097941A (ja) * | 2015-11-12 | 2017-06-01 | ソニー株式会社 | 情報処理装置、情報記録媒体、および情報処理方法、並びにプログラム |
JP2019506817A (ja) * | 2015-11-24 | 2019-03-07 | コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. | 複数のhdr画像ソースの処理 |
WO2018012244A1 (ja) * | 2016-07-11 | 2018-01-18 | シャープ株式会社 | 映像信号変換装置、映像信号変換方法、映像信号変換システム、制御プログラム、および記録媒体 |
JP2019118058A (ja) * | 2017-12-27 | 2019-07-18 | キヤノン株式会社 | 電子機器 |
Also Published As
Publication number | Publication date |
---|---|
CA2917212A1 (en) | 2015-01-15 |
MX2015017583A (es) | 2016-04-21 |
JP6528683B2 (ja) | 2019-06-12 |
TW201517027A (zh) | 2015-05-01 |
CN105359507A (zh) | 2016-02-24 |
KR20160031455A (ko) | 2016-03-22 |
CN105359507B (zh) | 2019-08-09 |
US10171787B2 (en) | 2019-01-01 |
JP2019097212A (ja) | 2019-06-20 |
JP6684456B2 (ja) | 2020-04-22 |
JPWO2015005189A1 (ja) | 2017-03-02 |
EP3021573A4 (en) | 2017-02-15 |
MX352400B (es) | 2017-11-23 |
US20160373712A1 (en) | 2016-12-22 |
TWI627627B (zh) | 2018-06-21 |
MY173495A (en) | 2020-01-29 |
EP3021573A1 (en) | 2016-05-18 |
KR102223751B1 (ko) | 2021-03-05 |
EP3021573B1 (en) | 2019-09-04 |
CA2917212C (en) | 2023-03-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6684456B2 (ja) | 再生装置、再生方法 | |
US20240089482A1 (en) | Reproduction device, reproduction method, and recording medium | |
US10880532B2 (en) | Reproduction device, reproduction method, and recording medium | |
JP2024042071A (ja) | 表示装置および表示制御方法 | |
US9832440B2 (en) | Reproduction device, reproduction method, and recording medium that display graphics based on tone mapping | |
US9706184B2 (en) | Reproduction device, reproduction method, and recording medium | |
JP6241683B2 (ja) | 再生装置、再生方法、および記録媒体 | |
US20160232937A1 (en) | Reproduction device, reproduction method, and recording medium | |
US10694196B2 (en) | Reproduction device, reproduction method, and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201480037524.6 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14823715 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2015526280 Country of ref document: JP Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 20157034849 Country of ref document: KR Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2014823715 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: MX/A/2015/017583 Country of ref document: MX |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14901870 Country of ref document: US |
|
ENP | Entry into the national phase |
Ref document number: 2917212 Country of ref document: CA |
|
NENP | Non-entry into the national phase |
Ref country code: DE |