JP6904470B2 - Playback device, display device, information processing method - Google Patents

Description

The present technology relates to a playback device, a display device, and an information processing method, and in particular, a playback device and a display device capable of transmitting information on the brightness of the master monitor used for producing a video of contents to the display device side. , Regarding information processing method.

There is a Blu-ray (registered trademark) Disc (hereinafter, appropriately referred to as BD) as a recording medium for contents such as movies.

In recent years, it has been studied to make it possible to record so-called UHD (Ultra High Definition) contents such as 4K (3840 x 2160 pixels) and 8K (7680 x 4320 pixels) that exceed HD (High Definition) on BD. ..

Japanese Unexamined Patent Publication No. 2009-58692 Japanese Unexamined Patent Publication No. 2009-89209

There is a possibility that a wide color gamut standard such as BT.2020 will be adopted as the color gamut standard for UHD content recorded on BD. BT.2020 is a wide color gamut standard that exceeds BT.709, which is the color gamut standard used in current HD content.

In addition, there is a possibility that HDR (High Dynamic Range) content, which is a content in which the dynamic range of brightness is extended from the standard dynamic range, can be recorded on a BD.

In order to output the content recorded on the BD with the color and brightness intended by the author (Author), the information on the color gamut and dynamic range of the content is transmitted from the BD player side to the display side. There is a need to.

This technology was made in view of such a situation, and enables information on the brightness of the master monitor used in the production of video content to be transmitted to the display device side.

The playback device of one aspect of the present technology includes a video stream of content including HDR video, an acquisition unit that acquires monitor information representing a plurality of brightness of the master monitor used for producing the video of the content, and a display device. It is provided with an output unit for outputting the monitor information.

The display device on the other aspect of the present technology transmits display performance information indicating its own display performance to a playback device that reproduces the content including the video stream of the HDR video before the playback of the content. The communication unit includes a communication unit that receives monitor information representing a plurality of brightness of the master monitor used for producing the video of the content transmitted from the playback device.

According to this technology, it is possible to transmit the information on the brightness of the master monitor used in the production of the video of the content to the display device side.

The effects described here are not necessarily limited, and may be any of the effects described in the present disclosure.

It is a figure which shows the structural example of the reproduction system which concerns on one Embodiment of this technique. It is a figure which shows the example of the management structure of the AV stream in BD-ROM format. It is a figure which shows the structure of Main Path and Sub Path. It is a figure which shows the example of the file management structure. It is a figure which shows the syntax of the index table. It is a figure which shows the syntax of AppInfoBDMV () of FIG. It is a figure which shows the example of mastering_monitor_info. It is a figure which shows the syntax of Indexes () of FIG. It is a figure which shows the other syntax of Indexes (). It is a figure which shows the example of mastering_monitor_color_primaries. It is a figure which shows the example of mastering_monitor_luminance. It is a figure which shows the syntax of ExtensionData (). It is a figure which shows the meaning of the combination of the value of ID1 and ID2. It is a figure which shows the 1st example of UHD_Ext (). It is a figure which shows the 2nd example of UHD_Ext (). It is a figure which shows the 3rd example of UHD_Ext (). It is a figure which shows the syntax of a PlayList. It is a figure which shows the syntax of AppInfoPlayList () of FIG. It is a figure which shows the syntax of Clip Information. It is a figure which shows the syntax of ClipInfo () of FIG. It is a figure which shows the example of application_type. It is a figure which shows the example of ClipInfo () including application_type = 10. It is a figure which shows the syntax of ProgramInfo () of FIG. It is a figure which shows the syntax of StreamCodingInfo of FIG. It is a figure which shows the example of stream_coding_type. It is a figure which shows the example of video_format. It is a block diagram which shows the structural example of the reproduction apparatus. It is a block diagram which shows the configuration example of the controller of FIG. 27. It is a block diagram which shows the structural example of the decoding processing part of FIG. It is a block diagram which shows the configuration example of a display device. It is a block diagram which shows the configuration example of the controller of FIG. It is a block diagram which shows the structural example of the signal processing part of FIG. It is a flowchart explaining the reproduction pre-processing of a reproduction apparatus. It is a flowchart explaining the reproduction preprocessing of a display device. It is a flowchart explaining the reproduction process of a reproduction apparatus. It is a flowchart following FIG. 35 which explains the reproduction process of the reproduction apparatus. It is a flowchart explaining the display process of a display device. It is a figure which shows the structure of the access unit of HEVC. HEVC Mastering monitor information It is a figure which shows the syntax of SEI. It is a figure which shows a part of ClipInfo () of Clip Information. It is a flowchart explaining the reproduction process of a reproduction apparatus. It is a flowchart following FIG. 41 explaining the reproduction process of the reproduction apparatus. It is a block diagram which shows the structural example of a recording apparatus. It is a flowchart explaining the recording process of a recording apparatus. It is a block diagram which shows the configuration example of a computer.

Hereinafter, modes for implementing the present technology will be described. The explanation will be given in the following order.
-First embodiment 1. About the playback system 2. About BD format 2-1. First description example of master monitor information 2-2. Second description example of master monitor information 2-3. Third description example of master monitor information 2-4. Fourth description example of master monitor information 2-5. Fifth description example of master monitor information 2-6. 6th description example of master monitor information 2-7. Seventh description example of master monitor information 2-8. Eighth description example of master monitor information 3. About the configuration of each device 4. Operation of each device-Second embodiment-Recording device

<< First Embodiment >>
<1. About the playback system>
FIG. 1 is a diagram showing a configuration example of a reproduction system according to an embodiment of the present technology.

The reproduction system of FIG. 1 is composed of a reproduction device 1 and a display device 2. The playback device 1 and the display device 2 are connected via a cable 3 which is an HDMI (registered trademark) (High Definition Multimedia Interface) standard cable. The playback device 1 and the display device 2 may be connected via a cable of another standard, or may be connected via wireless communication.

The playback device 1 reproduces the content recorded on the optical disc 11. The optical disc 11 is, for example, a disc on which contents are recorded in a BD-ROM (Blu-ray (registered trademark) Disc Read-Only) format.

The content recorded on the optical disk 11 is content including so-called UHD video data such as 4K and 8K. In 4K, the vertical × horizontal resolution is, for example, 3840 × 2160 pixels, and in 8K, the vertical × horizontal resolution is, for example, 7680 × 4320 pixels. For example, HEVC (High Efficiency Video Coding) is used for coding UHD video data.

The UHD video data recorded on the optical disk 11 is, for example, wide color gamut such as BT.2020 and HDR video data. HDR here means that the dynamic range of luminance is wider than the standard dynamic range of 0 to 100 cd / m ² (= 100 nit).

Information representing the color gamut and dynamic range of the master monitor used for producing the video data recorded on the optical disc 11 is recorded on the optical disc 11. In other words, the information representing the color gamut and dynamic range of the master monitor also represents the color gamut and dynamic range of the video data itself recorded on the optical disc 11.

Hereinafter, information representing the color gamut and dynamic range of the master monitor will be referred to as master monitor information as appropriate. The master monitor information may be one type of information representing both the color gamut and the dynamic range, or may be composed of a plurality of pieces of information representing the color gamut and the dynamic range, respectively.

The reproduction device 1 communicates with the display device 2 via the cable 3 to acquire information on the performance of the display device 2. The information on the performance of the display device 2 includes information indicating the color gamut and dynamic range of the display included in the display device 2, and whether or not the display device 2 is a device capable of understanding the master monitor information output by the playback device 1. Contains information that represents. The reproduction process in the reproduction device 1 is switched according to the performance of the display device 2.

The playback device 1 drives the drive, reads the master monitor information from the optical disc 11, and reads the video stream from the optical disc 11 for decoding.

When the display device 2 is a device capable of understanding the master monitor information, the playback device 1 outputs the master monitor information to the display device 2 together with the video data obtained by decoding.

Further, when the display device 2 is a device that cannot understand the master monitor information, the playback device 1 outputs the video data obtained by decoding to the display device 2. The video data output to the display device 2 is appropriately converted in the playback device 1 to narrow the color gamut and dynamic range.

For example, when the color gamut of the content recorded on the optical disk 11 is BT.2020, while the color gamut of the display of the display device 2 is BT.709, the conversion process for narrowing the color gamut is reproduced. This is done in device 1.

The display device 2 receives the video data transmitted from the playback device 1 and displays the video of the content on the display. Audio data of the content is also transmitted from the playback device 1. The display device 2 outputs the sound of the content from the speaker based on the audio data transmitted from the playback device 1.

For example, when the master monitor information is transmitted together with the video data, the display device 2 identifies the color gamut and dynamic range of the content recorded on the optical disk 11 based on the master monitor information. When the display device 2 itself does not support the display of the contents recorded on the optical disk 11, the display device 2 refers to the master monitor information and reproduces the conversion process for narrowing the color gamut and the dynamic range. It is applied to the video data transmitted from the device 1. The display device 2 displays a video of the content on the display based on the video data after the conversion of the color gamut and the dynamic range.

As described above, the optical disc 11 on which the UHD video data is recorded includes master monitor information which is information representing the actual color gamut and dynamic range. When the playback device 1 outputs the master monitor information together with the video data, the actual color gamut and dynamic range of the video data can be transmitted to the display device 2.

After specifying the actual color gamut and dynamic range, the display device 2 performs video data conversion processing according to the performance of the display that it has, so that an image with color and brightness according to the author's intention can be obtained. It becomes possible to display.

If the video data transmitted via the cable 3 is UHD video data, it is assumed that the display device 2 recognizes that the color gamut is BT.2020. In this case, when the color gamut of the display and the actual color gamut of the video data are narrower than BT.2020, the display device 2 performs a process of converting the video data into video data having a color gamut narrower than the actual color gamut. However, it is possible to prevent such a situation.

<2. About BD format>
Here, the BD-ROM format will be described.

[Data management structure]
FIG. 2 is a diagram showing an example of an AV stream management structure in the BD-ROM format.

Management of AV streams including HEVC video streams is performed using two layers, Playlist and Clip. The AV stream may be recorded not only in the optical disk 11 but also in the local storage of the playback device 1.

One AV stream and a pair of Clip Information, which is information accompanying the AV stream, are managed as one object. A pair of AV stream and Clip Information is called Clip.

The AV stream is expanded on the time axis, and the access point of each Clip is mainly specified in the PlayList by the time stamp. Clip Information is used, for example, to find the address in the AV stream where decoding should start.

A PlayList is a collection of playback sections of an AV stream. One playback section in the AV stream is called a PlayItem. PlayItem is represented by a pair of IN point and OUT point of the playback section on the time axis. As shown in FIG. 2, a PlayList is composed of one or a plurality of PlayItems.

The first playlist from the left in FIG. 2 is composed of two PlayItems, and the two PlayItems refer to the first half part and the second half part of the AV stream included in the clip on the left side, respectively.

The second PlayList from the left consists of one PlayItem, which references the entire AV stream contained in the Clip on the right.

The third PlayList from the left is composed of two PlayItems, and the two PlayItems refer to a part of the AV stream contained in the clip on the left side and a part of the AV stream contained in the Clip on the right side, respectively.

For example, when the left PlayItem included in the first PlayList from the left is specified by the disc navigation program as the playback target, the first half of the AV stream included in the left Clip referenced by the PlayItem is played.

In the PlayList, the playback path created by arranging one or more PlayItems is called the main path. Also, in the PlayList, the playback path created by arranging one or more SubPlayItems in parallel with the Main Path is called a subpath (Sub Path).

FIG. 3 is a diagram showing the structures of Main Path and Sub Path.

A PlayList has one Main Path and one or more Sub Paths. The PlayList of FIG. 3 has one Main Path and three Sub Paths made up of a sequence of three PlayItems.

IDs are set for each PlayItem that constitutes the Main Path in order from the beginning. IDs of Subpath_id = 0, Subpath_id = 1, and Subpath_id = 2 are also set in Sub Path in order from the beginning.

In the example of FIG. 3, the Sub Path with Subpath_id = 0 contains one SubPlayItem, and the SubPath with Subpath_id = 1 contains two SubPlayItems. Further, one SubPlayItem is included in the SubPath of Subpath_id = 2.

The AV stream referenced by one PlayItem includes at least a video stream (main image data). The AV stream may or may not include one or more audio streams that are played back (synchronously) at the same timing as the video stream included in the AV stream.

The AV stream may or may not include one or more streams of bitmap subtitle data (PG (Presentation Graphic)) that are played back in synchronization with the video stream included in the AV stream. ..

The AV stream may or may not include one or more IG (Interactive Graphic) streams that are played back in synchronization with the video stream contained in the AV stream file. IG streams are used to display graphics such as buttons operated by the user.

The AV stream referenced by one PlayItem is multiplexed with a video stream and an audio stream, a PG stream, and an IG stream that are played back in synchronization with the video stream.

Further, one SubPlayItem refers to a video stream, an audio stream, a PG stream, or the like, which is a stream different from the AV stream referred to by the PlayItem.

In this way, the playback of the AV stream including the HEVC video stream is performed using the Play List and Clip Information. Information on files such as PlayList and Clip Information that are different from AV stream files, and information for managing the playback of AV streams is appropriately referred to as Data Base information.

[Directory structure]
FIG. 4 is a diagram showing an example of a file management structure recorded on the optical disk 11.

Each file recorded on the optical disk 11 is hierarchically managed by a directory structure. One root directory is created on the optical disk 11.

The BDMV directory is placed under the root directory.

Under the BDMV directory, one Index table file, which is a file with the name "Index.bdmv", is stored. The Data Base information mentioned above also includes an Index table. Under the BDMV directory, the MovieObject file, which is a file with the name "MovieObject.bdmv", is also stored.

Under the BDMV directory, a PLAYLIST directory, CLIPINF directory, STREAM directory, etc. are provided.

A Playlist file that describes a Playlist is stored in the PLAYLIST directory. Each Playlist file is given a name that is a combination of a 5-digit number and the extension ".mpls".
A file name of "00000.mpls" is set in one Playlist file shown in FIG.
Multiple Playlist files may be included in the PLAYLIST directory.

The CLIPINF directory contains Clip Information files. Each Clip Information file is given a name that is a combination of a 5-digit number and the extension ".clpi". File names of "00001.clpi", "00002.clpi", and "00003.clpi" are set in the three Clip Information files of FIG. 4, respectively.

Stream files are stored in the STREAM directory. Each stream file is given a name that is a combination of a 5-digit number and the extension ".m2ts". File names of "00001.m2ts", "00002.m2ts", and "00003.m2ts" are set in the three stream files of FIG. 4, respectively.

The Clip Information file and the stream file in which the same 5-digit number is set in the file name are the files that make up one Clip. The Clip Information file of "00001.clpi" is used when playing the stream file of "00001.m2ts", and the Clip Information file of "00002.clpi" is used when playing the stream file of "00002.m2ts".

[Syntax of each file]
Here, the main description of the syntax of each file will be described. Master monitor information can be described at various locations in the Data Base information.

・ 2-1. First Description Example of Master Monitor Information An example of describing master monitor information in the Index table will be described.

FIG. 5 is a diagram showing the syntax of the Index table.

AppInfoBDMV (), Indexes (), ExtensionData () are described in Index table (index.bdmv). AppInfoBDMV () is information including important parameters related to the reproduction of the optical disk 11. Indexes () is information including information that defines the content of the operation according to the user's operation and information that defines the content of the first operation when the optical disk 11 is loaded. ExtensionData () is information including various information for extending the Index table.

FIG. 6 is a diagram showing the syntax of AppInfoBDMV () of FIG.

AppInfoBDMV () contains a 1-bit initial_output_mode_preference and a 1-bit SS_content_exist_flag.

initial_output_mode_preference indicates whether the output mode is 2D Output Mode or Stereoscopic Output Mode (3D mode). SS_content_exist_flag represents a function that can be realized by using the optical disk 11.

In addition, AppInfoBDMV () includes 4-bit mastering_monitor_info, 4-bit video_format, and 4-bit frame_rate with a 1-bit reserve area in between.

It differs from the syntax of AppInfoBDMV () in "Blu-ray Disc Read-Only Format Part3 version 2.4" in that it reduces the number of bits in the reserve area and adds mastering_monitor_info. mastering_monitor_info is the above-mentioned master monitor information.

FIG. 7 is a diagram showing an example of mastering_monitor_info.

mastering_monitor_info = 1 indicates that the color gamut, maximum luminance, and minimum luminance are all unknown.

mastering_monitor_info = 2 indicates that the color gamut is BT.709 (ITU-R BT.709), and indicates that the maximum and minimum luminances are unknown.

mastering_monitor_info = 3 indicates that the color gamut is DCI (Digital Cinema Initiatives) P3, and indicates that the maximum brightness and the minimum brightness are unknown.

mastering_monitor_info = 4 indicates that the color gamut is BT.2020 (ITU-R BT.2020), and indicates that the maximum brightness and the minimum brightness are unknown.

mastering_monitor_info = 5 indicates that the color gamut BT.709, the maximum luminance is 1000 cd / m ^2, a minimum luminance is 0 cd / m ^2.

mastering_monitor_info = 6 indicates that the color gamut DCI P3, the maximum luminance is 1000 cd / m ^2, a minimum luminance is 0 cd / m ^2.

In this way, the master monitor information can be described in AppInfoBDMV () of the Index table. By describing the master monitor information in AppInfoBDMV (), one type of color gamut and dynamic range can be operated throughout the optical disc 11.

Note that video_format in FIG. 6 represents the format (scanning method) of the video recorded on the optical disc 11, and frame_rate represents the frame rate of the video recorded on the optical disc 11.

・ 2-2. Second description example of master monitor information An example of describing master monitor information in Indexes () of the Index table will be described.

FIG. 8 is a diagram showing the syntax of Indexes () in FIG.

Indexes () contains 16-bit number_of_Titles, and each Title identified by title_id contains a 2-bit Title_object_type and a 2-bit Title_access_type.

number_of_Titles represents the number of Titles contained in Indexes (). Title is a section of content that is played using one or more Playlists.

Title_object_type represents the type of title, and Title_access_type represents the type of title playback start.

In addition, Indexes () includes 4-bit mastering_monitor_info for each Title identified by title_id.

It differs from the syntax of Indexes () in "Blu-ray Disc Read-Only Format Part3 version 2.4" in that it reduces the number of bits in the reserve area and adds mastering_monitor_info. mastering_monitor_info is the above-mentioned master monitor information. The meaning of the value of mastering_monitor_info is the same as the meaning explained with reference to FIG.

In this way, the master monitor information can be described in Indexes () of the Index table.
By describing the master monitor information in Indexes (), it is possible to operate one type of color gamut and dynamic range in Title units.

Since the switching of values within the Title (switching of color gamut and dynamic range) can be restricted, the influence of switching of display brightness in consideration of Graphics (PG, IG) etc. can be reduced. If there is a section where only the image is displayed and a section where the graphics are superimposed on the image in one Title, and the color gamut and dynamic range are switched at the timing when the graphics display starts, the color of the image The brightness will change, but it will be possible to prevent such a situation.

FIG. 9 is a diagram showing other syntaxes of Indexes ().

In FIG. 9, the description overlapping with the description of FIG. 8 will be omitted as appropriate. In the above, the color gamut and the dynamic range are represented by one kind of information, mastering_monitor_info, but the information representing the color gamut and the information representing the dynamic range may be described respectively.

The example of FIG. 9 differs from the syntax of FIG. 8 in that 4-bit mastering_monitor_color_primaries and 4-bit mastering_monitor_luminance are described instead of mastering_monitor_info. mastering_monitor_color_primaries and mastering_monitor_luminance are master monitor information.

mastering_monitor_color_primaries represents the color gamut of the master monitor, and mastering_monitor_luminance represents the dynamic range of the master monitor.

FIG. 10 is a diagram showing an example of mastering_monitor_color_primaries.

mastering_monitor_color_primaries = 1 indicates that the color gamut is unknown.

mastering_monitor_color_primaries = 2 indicates that the color gamut is BT.709.

mastering_monitor_color_primaries = 3 indicates that the color gamut is DCI P3.

mastering_monitor_color_primaries = 4 indicates that the color gamut is BT.2020.

FIG. 11 is a diagram showing an example of mastering_monitor_luminance.

mastering_monitor_luminance = 1 indicates that the maximum and minimum brightness are unknown.

mastering_monitor_luminance = 2, the maximum brightness is 400 cd / m ^2, indicating that the minimum luminance is 0 cd / m ^2.

mastering_monitor_luminance = 3 means that the maximum brightness is ^{any brightness in the range of 400 to 800 cd / m 2} and the minimum brightness is 0 cd / m ² .

mastering_monitor_luminance = 4 means that the maximum brightness is 800 cd / m ² and the minimum brightness is 0 cd / m ² .

mastering_monitor_luminance = 5 means that the maximum brightness is ^{any brightness in the range of 800 to 1000 cd / m 2} and the minimum brightness is 0 cd / m ² .

mastering_monitor_luminance = 6, the maximum luminance is 1000 cd / m ^2, indicating that the minimum luminance is 0 cd / m ^2.

A reserve area with a large number of bits is secured in the area of each Title of Indexes () (Title [title_id] ()). In the area where the reserve area having a large number of bits is secured in this way, it is possible to describe the information representing the color gamut and the information representing the dynamic range, respectively.

・ 2-3. Third Description Example of Master Monitor Information An example of describing the master monitor information in ExtensionData () (FIG. 5) of the Index table will be described.

FIG. 12 is a diagram showing the syntax of ExtensionData ().

ExtensionData () contains 16-bit ID1 and ID2 for each ext_data_entry (), respectively. The combination of ID1 and ID2 values represents the content of the information described in data_block () in ext_data_entry ().

FIG. 13 is a diagram showing the meaning of the combination of the values of ID1 and ID2.

For example, if the value of ID1 is 0x0001 and the value of ID2 is 0x0001, it means that the information described in data_block () is pip_metadata. pip_metadata is information about the Picture in Picture function.

As will be described later, ExtensionData () is also included in Playlist and Clip Information. The content of the information described in ExtensionData () of PlayList and Clip Information is also represented by the combination of the values of ID1 and ID2 shown in FIG.

Further, the fact that the value of ID1 is 0xaaaa, which is a predetermined value, and the value of ID2 is 0xbbbb, which is another predetermined value, indicates that the information described in data_block () is UHD_Ext. UHD_Ext is the master monitor information. The point that UHD_Ext is added is different from the meaning of the combination of ID1 and ID2 values in "Blu-ray Disc Read-Only Format Part3 version 2.4".

FIG. 14 is a diagram showing a first example of UHD_Ext () described as data_block ().

UHD_Ext () in FIG. 14 includes mastering_monitor_info. The mastering_monitor_info of UHD_Ext () also has the same meaning as shown in FIG.

FIG. 15 is a diagram showing a second example of UHD_Ext ().

UHD_Ext () in FIG. 15 includes mastering_monitor_color_primaries and mastering_monitor_luminance. The mastering_monitor_color_primaries and mastering_monitor_luminance of UHD_Ext () also have the same meanings as those shown in FIGS. 10 and 11, respectively.

FIG. 16 is a diagram showing a third example of UHD_Ext ().

UHD_Ext () in FIG. 16 includes display_primaries_x, display_primaries_y, white_point_x, white_point_y, max_display_mastering_luminance, and min_display_mastering_luminance.

This information is the same information that is inserted into the coded data of HEVC as SEI (Supplemental Enhancement Information). This example uses the same information that is inserted as SEI into the HEVC coded data to represent the color gamut and dynamic range of the master monitor.

display_primaries_x and display_primaries_y represent the color gamut (color space) of the master monitor, and white_point_x and white_point_y represent the position of white in the color gamut. max_display_mastering_luminance and min_display_mastering_luminance represent the maximum and minimum brightness of the master monitor, that is, the dynamic range of brightness.

In this way, master monitor information can be described in ExtensionData () of Index table. By using ExtensionData (), it is possible to define master monitor information in a free form without being affected by the number of bits in the reserve area. For example, you can define master monitor information along with other extended parameters for 4K support, or you can define master monitor information that can be operated on an entire disk or on a title-by-title basis.

・ 2-4. Fourth description example of master monitor information Next, an example of describing master monitor information in a playlist will be described.

FIG. 17 is a diagram showing the syntax of the Playlist.

The PlayList is a file stored in the PLAYLIST directory of FIG. 4 and having the extension ".mpls" set. AppInfoPlayList (), PlayList (), PlayListMark (), and ExtensionData () are described in PlayList.

AppInfoPlayList () stores parameters related to PlayList playback controls such as playback restrictions.

Parameters related to Main Path and Sub Path are stored in PlayList ().

PlayListMark () stores PlayList mark information, that is, information about a mark that is a jump destination (jump point) in a user operation or command that commands a chapter jump or the like.

ExtensionData () is information that includes various information for extending the PlayList.

FIG. 18 is a diagram showing the syntax of AppInfoPlayList () of FIG.

In AppInfoPlayList (), 8-bit PlayList_playback_type, 1-bit PlayList_random_access_flag, 1-bit audio_mix_app_flag, 1-bit lossless_may_bypass_mixer_flag, and 1-bit MVC_Base_view_R_flag are described.

PlayList_playback_type represents the playback type of the PlayItem included in the PlayList, such as sequential playback and random playback. In addition, PlayList_random_access_flag indicates whether or not to allow random access to the playback start position indicated by the PlayList. audio_mix_app_flag indicates whether or not audio data is combined in the playback section indicated by the PlayList.

In addition, 4-bit mastering_monitor_color_primaries and mastering_monitor_luminance are described in AppInfoPlayList (), respectively. It differs from the syntax of AppInfoPlayList () in "Blu-ray Disc Read-Only Format Part3 version 2.4" in that it reduces the number of bits in the reserve area and adds mastering_monitor_color_primaries and mastering_monitor_luminance.

In this example, mastering_monitor_color_primaries and mastering_monitor_luminance are described as master monitor information, but 4-bit mastering_monitor_info may be described in AppInfoPlayList ().

In this way, master monitor information can be described in AppInfoPlayList () of Playlist. By describing the master monitor information in the PlayList, it is possible to operate one type of color gamut and dynamic range in each PlayList. When a plurality of Playlists are used to reproduce one Title, it is possible to operate different color gamuts and dynamic ranges within one Title.

・ 2-5. Fifth Description Example of Master Monitor Information An example of describing the master monitor information in ExtensionData () (FIG. 17) of the Playlist will be described.

ExtensionData () of PlayList also has the same syntax as the syntax shown in FIG. The content of the information included in ExtensionData () is represented by a combination of ID1 and ID2, and UHD_Ext in FIG. 14, FIG. 15, or FIG. 16 is described in ExtensionData () in the PlayList.

By describing the master monitor information in ExtensionData () of PlayList, it is possible to freely define the color gamut and dynamic range to be operated in each PlayList file.

・ 2-6. Sixth Description Example of Master Monitor Information An example of describing master monitor information in Clip Information will be described.

FIG. 19 is a diagram showing the syntax of Clip Information.

Clip Information is a file stored in the CLIPINF directory shown in FIG. 4 and having the extension ".clpi" set.

ClipInfo () stores information indicating the type of AV stream that constitutes Clip, information indicating the recording rate of the AV stream, and the like.

SequenceInfo () includes information indicating the position of the source packet constituting the AV stream on the time axis, information indicating the display time, and the like.

ProgramInfo () contains the PID of the AV stream that composes the clip, information about the coding of the AV stream, and so on.

CPI () contains information indicating the position of the source packet that is the entry point.

ExtensionData () is information that contains various information for extending the Clip Information file.

FIG. 20 is a diagram showing the syntax of ClipInfo () of FIG.

8-bit Clip_stream_type and 8-bit application_type are described in ClipInfo ().

Clip_stream_type represents the type of Clip AV stream that corresponds to the Clip Information file. application_type represents an application (function) realized by using the Clip Information file and the corresponding Clip AV stream. The description content in the latter part is switched according to the value of application_type.

In ClipInfo (), 4-bit mastering_monitor_color_primaries and mastering_monitor_luminance are described, respectively. It differs from the ClipInfo () syntax of "Blu-ray Disc Read-Only Format Part3 version 2.4" in that it reduces the number of bits in the reserve area and adds mastering_monitor_color_primaries and mastering_monitor_luminance.

In this example as well, mastering_monitor_color_primaries and mastering_monitor_luminance are described as master monitor information, but 4-bit mastering_monitor_info may be described in ClipInfo ().

In this way, it is also possible to describe the master monitor information in the Clip Information file. This makes it possible to define the color gamut and dynamic range in Clip units, which are finer authoring units. When multiple Clips are referenced in one Playlist, it is possible to change the color gamut and dynamic range for each Clip.

Instead of writing the master monitor information after Clip_stream_type and application_type, it is also possible to write mastering_monitor_color_primaries and mastering_monitor_luminance elsewhere in ClipInfo (). In this case, as the value of application_type, a value representing an application that outputs wide color gamut and HDR contents is defined.

FIG. 21 is a diagram showing an example of application_type.

As shown in FIG. 21, applications are assigned to the values 1 to 9 of application_type. For example, application_type = 1 means that the Clip AV stream corresponding to Clip Information including application_type = 1 is the Main TS of the movie referenced by the main-path, and the Clip Information and Clip AV stream are used to play the Clip AV stream. Represents.

application_type = 10 is the Main TS of a wide color gamut and HDR movie that the Clip AV stream corresponding to Clip Information including application_type = 10 refers to by the main-path. Using Clip Information and Clip AV stream, Indicates that the reproduction is performed.

The point that application_type = 10 is added is different from application_type of "Blu-ray Disc Read-Only Format Part3 version 2.4".

FIG. 22 is a diagram showing an example of ClipInfo () including application_type = 10.

When application_type = 10, mastering_monitor_color_primaries and mastering_monitor_luminance are described in ClipInfo () as shown in FIG.

In this way, define a value that represents the wide color gamut and HDR video data playback function in application_type, and if that value is set in application_type, describe the master monitor information in ClipInfo (). It is also possible.

・ 2-7. Seventh Description Example of Master Monitor Information An example of describing the master monitor information in ProgramInfo () (FIG. 19) of Clip Information will be described.

FIG. 23 is a diagram showing the syntax of ProgramInfo () of FIG.

number_of_program_sequences indicates the number of program sequences described in ProgramInfo (). A program sequence is composed of a sequence of source packets that make up a program.

SPN_program_sequence_start [i] indicates the source packet number at the beginning of the program sequence.

StreamCodingInfo () contains information about the coding of the AV streams that make up the Clip.

FIG. 24 is a diagram showing the syntax of StreamCodingInfo () of FIG. 23.

stream_coding_type indicates the coding method of the elementary stream included in the AV stream. If the value of stream_coding_type is one of 0x02, 0x1B, 0xEA, StreamCodingInfo contains 4-bit video_format, 4-bit frame_rate, 4-bit aspect_ratio, and 1-bit cc_flag.

video_format indicates the video scanning method. frame_rate indicates the frame rate of the video stream. aspect_ratio indicates the aspect ratio of the video. cc_flag is a 1-bit flag that indicates whether closed captioning data is included in the video stream.

If the value of stream_coding_type is 0xNN, which is a predetermined value, or 0xMM, which is another predetermined value, StreamCodingInfo () contains master monitor information in addition to video_format, frame_rate, aspect_ratio, and cc_flag. Mastering_monitor_color_primaries and mastering_monitor_luminance are described.

It differs from the Stream Coding Info syntax of "Blu-ray Disc Read-Only Format Part3 version 2.4" in that stream_coding_type = 0xNN and 0xMM are defined and mastering_monitor_color_primaries and mastering_monitor_luminance are described in Stream Coding Info.

FIG. 25 is a diagram showing an example of stream_coding_type.

For example, stream_coding_type = 0x02 indicates that the Clip AV stream corresponding to Clip Information including stream_coding_type = 0x02 is an MPEG-2 video stream. stream_coding_type = 0x1B indicates that the Clip AV stream corresponding to Clip Information containing stream_coding_type = 0x1B is an MPEG-4 AVC video stream.

Further, stream_coding_type = 0xNN indicates that the Clip AV stream corresponding to Clip Information including stream_coding_type = 0xNN is a HEVC video stream. The fact that stream_coding_type = 0xMM means that the Clip AV stream corresponding to Clip Information including stream_coding_type = 0xMM is an HDR HEVC video stream.

In response to the addition of values representing the HEVC video stream and HDR HEVC video stream to stream_coding_type, a value representing the UHD scanning method is also added to video_format, as shown in FIG.

video_format = 8 indicates that the scanning method is 2160p and the color gamut is BT.2020. It differs from the video_format of "Blu-ray Disc Read-Only Format Part3 version 2.4" in that video_format = 8 is defined.

In this way, the master monitor information can be described in StreamCodingInfo ().
StreamCodingInfo () contains basic information about the video to be played back, such as the video scanning method and frame rate, and this information is used, for example, for communication with the display device 2 via HDMI. Used at the time of setting. By describing the master monitor information in StreamCodingInfo () as such basic information, not only the video scanning method and frame rate, but also the color gamut and dynamic range are the same when setting communication via HDMI. It becomes possible to transmit to the display device 2 by the scheme.

・ 2-8. Eighth Description Example of Master Monitor Information An example of describing the master monitor information in Extension Data () (FIG. 19) of Clip Information will be described.

ExtensionData () of Clip Information also has the same syntax as the syntax shown in FIG. The content of the information included in ExtensionData () is represented by a combination of ID1 and ID2, and UHD_Ext in FIG. 14, FIG. 15, or FIG. 16 is described in ExtensionData () of Clip Information.

By describing the master monitor information in ExtensionData () of Clip Information, it is possible to freely define the color gamut and dynamic range to be operated for each Clip Information file.

-Modification example In the above, the master monitor information is described in one of the Data Base information, but it may be described in a plurality of positions. For example, it is possible to describe only the information representing the dynamic range in the Index table and describe the information representing the color gamut in Clip Information.

In this way, it is possible to describe the information representing the dynamic range and the information representing the color gamut separately at different positions.

Further, the position where the master monitor information is described is not limited to the above-mentioned example, and can be described at another position where the reserve area is secured. For example, it is possible to describe the master monitor information in the information about each PlayItem included in the PlayList () of FIG. 17, or to describe the master monitor information in the information about each SubPlayItem.

<3. About the configuration of each device>
Here, the configuration of each device will be described.

[Configuration of playback device 1]
FIG. 27 is a block diagram showing a configuration example of the reproduction device 1.

The playback device 1 is composed of a controller 51, a disk drive 52, a memory 53, a local storage 54, a network interface 55, a decoding processing unit 56, an operation input unit 57, and a communication unit 58.

The controller 51 is composed of a CPU, ROM, RAM, and the like. The controller 51 executes a predetermined program and controls the overall operation of the playback device 1.

The disk drive 52 reads data from the optical disk 11 and outputs the read data to the controller 51, the memory 53, or the decoding processing unit 56. For example, the disk drive 52 outputs the Data Base information read from the optical disk 11 to the controller 51, and outputs the HEVC video stream to the decoding processing unit 56.

The memory 53 stores data and the like necessary for the controller 51 to execute various processes.

The local storage 54 is composed of, for example, an HDD (Hard Disk Drive). A stream downloaded from the server or the like is recorded in the local storage 54.

The network interface 55 communicates with the server via a network such as the Internet, and supplies the data downloaded from the server to the local storage 54.

The decoding processing unit 56 decodes the video stream supplied from the disk drive 52, and outputs the video data obtained by decoding to the communication unit 58.

The operation input unit 57 includes input devices such as buttons, keys, and a touch panel, and a receiving unit that receives signals such as infrared rays transmitted from a predetermined remote commander. The operation input unit 57 detects the user's operation and supplies a signal representing the content of the detected operation to the controller 51.

The communication unit 58 communicates with the display device 2 via the cable 3. For example, the communication unit 58 acquires information on the performance of the display included in the display device 2 and outputs the information to the controller 51. Further, the communication unit 58 outputs the video data supplied from the decoding processing unit 56 to the display device 2.

FIG. 28 is a block diagram showing a configuration example of the controller 51 of FIG. 27.

The controller 51 includes a read control unit 71, a master monitor information acquisition unit 72, a decoding control unit 73, and a display information acquisition unit 74.

The read control unit 71 controls the disk drive 52 and reads various data from the optical disk 11 to acquire the data. For example, the read control unit 71 reads the video stream file and supplies it to the decoding processing unit 56, and also reads the Data Base information file and outputs it to the master monitor information acquisition unit 72.

The master monitor information acquisition unit 72 acquires master monitor information from the file supplied from the read control unit 71. As described above, the master monitor information is described at each position of the Index table, PlayList, and Clip Information.

For example, when the master monitor information is described in AppInfoBDMV () of the index table as described with reference to the first description example, the master monitor information acquisition unit 72 is the index table supplied from the read control unit 71. Get master monitor information from.

Further, when the master monitor information is described in AppInfoPlayList () of the playlist as described with reference to the fourth description example, the master monitor information acquisition unit 72 masters from the PlayList supplied from the read control unit 71. Get monitor information.

When the master monitor information is described in ClipInfo () of Clip Information as described with reference to the sixth description example, the master monitor information acquisition unit 72 masters from the Clip Information supplied from the read control unit 71. Get monitor information.

The decoding control unit 73 specifies the color gamut and dynamic range of the content recorded on the master monitor, that is, the optical disk 11, based on the master monitor information supplied from the master monitor information acquisition unit 72. Further, the decoding control unit 73 specifies the performance of the display device 2 based on the information supplied from the display information acquisition unit 74.

The decoding control unit 73 controls the processing of the decoding processing unit 56 based on the color gamut and dynamic range of the content and the performance of the display device 2.

For example, the decoding control unit 73 controls the decoding processing unit 56 to decode the video stream. Further, when the color gamut and dynamic range of the content exceed the color gamut and dynamic range of the display of the display device 2, the video data obtained by decoding is converted into data having a narrowed color gamut and dynamic range. Let me.

When the display device 2 can understand the master monitor information output by the reproduction device 1, the decoding control unit 73 outputs the master monitor information supplied from the master monitor information acquisition unit 72 to the communication unit 58. The master monitor information supplied to the communication unit 58 is output to the display device 2 together with the video data obtained by decoding by the decoding processing unit 56.

The display information acquisition unit 74 acquires information representing the performance of the display device 2 acquired by the communication unit 58, and outputs the information to the decoding control unit 73. The information indicating the performance of the display device 2 includes information indicating whether or not the display device 2 can understand the master monitor information output by the playback device 1, the color gamut and dynamic range of the display of the display device 2. Contains information to represent.

For example, the master monitor information is described in the optional area of the essential area and the optional area of the data format used for HDMI communication. If the display device 2 does not support the processing of the information described in the optional area, it is determined that the display device 2 cannot understand the master monitor information output by the playback device 1.

FIG. 29 is a block diagram showing a configuration example of the decoding processing unit 56 of FIG. 27.

The decoding processing unit 56 includes a decoding unit 81, a dynamic range conversion unit 82, a color gamut conversion unit 83, and an output unit 84. The video stream read by the disk drive 52 is input to the decoding unit 81.

The decoding unit 81 decodes the video stream and outputs the video data obtained by decoding the video stream. The video data output from the decoding unit 81 is supplied to the dynamic range conversion unit 82, the color gamut conversion unit 83, and the output unit 84.

When the dynamic range of the video data exceeds the dynamic range of the display included in the display device 2, the dynamic range conversion unit 82 converts the video data supplied from the decoding unit 81 into data having a narrow dynamic range. The dynamic range conversion unit 82 outputs the converted video data to the color gamut conversion unit 83 when it is necessary to narrow not only the dynamic range but also the color gamut, and when it is not necessary to narrow the color gamut, the converted video. The data is output to the output unit 84.

The color gamut conversion unit 83 converts the video data supplied from the decoding unit 81 or the video data supplied from the dynamic range conversion unit 82 into data having a narrowed color gamut. The color gamut conversion unit 83 outputs the video data after the color gamut conversion to the output unit 84.

The output unit 84 outputs the video data supplied from the decoding unit 81, the video data supplied from the dynamic range conversion unit 82, or the video data supplied from the color gamut conversion unit 83 to the communication unit 58.

[Configuration of display device 2]
FIG. 30 is a block diagram showing a configuration example of the display device 2.

The display device 2 includes a controller 101, a communication unit 102, a signal processing unit 103, and a display 104. The controller 101 has a memory 101A.

The controller 101 is composed of a CPU, ROM, RAM, and the like. The controller 101 executes a predetermined program and controls the overall operation of the display device 2.

For example, the controller 101 stores EDID (Extended display identification data) representing the performance of the display 104 in the memory 101A and manages it. At the time of authentication with the reproduction device 1, the controller 101 outputs the EDID stored in the memory 101A to the communication unit 102 and causes the reproduction device 1 to transmit the EDID. Based on EDID, the performance of the display 104 is specified by the playback device 1.

Further, the controller 101 controls the communication unit 102 and causes the reproduction device 1 to transmit information indicating whether or not it corresponds to the master monitor information output by the reproduction device 1.

The communication unit 102 communicates with the playback device 1 via the cable 3. The communication unit 102 receives the video data transmitted from the playback device 1 and outputs the video data to the signal processing unit 103.
When the master monitor information is transmitted from the playback device 1 together with the video data, the communication unit 102 outputs the received master monitor information to the controller 101. Further, the communication unit 102 transmits the information supplied from the controller 101 to the reproduction device 1.

The signal processing unit 103 causes the display 104 to display the video of the content based on the video data supplied from the communication unit 102. The signal processing unit 103 appropriately converts the color gamut of the video data and the dynamic range under the control of the controller 101.

FIG. 31 is a block diagram showing a configuration example of the controller 101 of FIG.

The controller 101 includes a master monitor information acquisition unit 111 and a signal processing control unit 112.

When the master monitor information output from the playback device 1 together with the video data is received by the communication unit 102, the master monitor information acquisition unit 111 acquires the master monitor information and outputs the master monitor information to the signal processing control unit 112.

The signal processing control unit 112 specifies the color gamut and dynamic range of the video data transmitted from the playback device 1 based on the master monitor information. When the color gamut and dynamic range of the video data exceed the performance of the display 104, the signal processing control unit 112 causes the signal processing unit 103 to perform conversion processing for compressing the color gamut and the dynamic range.

FIG. 32 is a block diagram showing a configuration example of the signal processing unit 103 of FIG.

The signal processing unit 103 includes a video data acquisition unit 121, a dynamic range conversion unit 122, a color gamut conversion unit 123, and an output unit 124. The video data output from the communication unit 102 is input to the video data acquisition unit 121.

The video data acquisition unit 121 acquires and outputs the video data output from the communication unit 102. The video data output from the video data acquisition unit 121 is supplied to the dynamic range conversion unit 122, the color gamut conversion unit 123, and the output unit 124.

When the dynamic range of the video data exceeds the dynamic range of the display 104, the dynamic range conversion unit 122 converts the video data supplied from the video data acquisition unit 121 into data having a narrow dynamic range. The dynamic range conversion unit 122 outputs the converted video data to the color gamut conversion unit 123 when it is necessary to narrow not only the dynamic range but also the color gamut, and when it is not necessary to narrow the color gamut, the converted video. The data is output to the output unit 124.

The color gamut conversion unit 123 converts the video data supplied from the video data acquisition unit 121 or the video data supplied from the dynamic range conversion unit 122 into data having a narrowed color gamut. The color gamut conversion unit 123 outputs the video data after the color gamut conversion to the output unit 124.

The output unit 124 outputs the video data supplied from the video data acquisition unit 121, the video data supplied from the dynamic range conversion unit 122, or the video data supplied from the color gamut conversion unit 123 to the display 104.

<4. About the operation of each device>
Here, the operation of each device having the above configuration will be described.

Pre-Reproduction Processing First, the processing of the reproduction device 1 before starting the reproduction of the optical disk 11 will be described with reference to the flowchart of FIG. 33.

The process of FIG. 33 is started, for example, when the power of the playback device 1 and the display device 2 connected via the cable 3 is turned on.

In step S1, the communication unit 58 of the playback device 1 receives, for example, EDID format information representing the performance of the display 104, that is, the color gamut and dynamic range of the display 104, transmitted from the display device 2.

In step S2, the communication unit 58 receives the information transmitted from the display device 2 indicating whether or not the display device 2 corresponds to the master monitor information, and ends the process. The information received by the communication unit 58 is supplied to the controller 51 and acquired by the display information acquisition unit 74.

Next, the processing of the display device 2 before the reproduction of the optical disk 11 is started will be described with reference to the flowchart of FIG. 34.

In step S11, the communication unit 102 of the display device 2 transmits, for example, EDID format information representing the color gamut and dynamic range of the display 104 read from the memory 101A to the playback device 1.

In step S12, the communication unit 102 transmits information indicating whether or not the display device 2 itself corresponds to the master monitor information (information indicating whether or not the master monitor information can be understood), and ends the process.

[Reproduction processing of reproduction device 1]
Next, the reproduction process of the reproduction device 1 will be described with reference to the flowcharts of FIGS. 35 and 36.

In step S21, the read control unit 71 of the controller 51 controls the disk drive 52 and reads the Data Base information from the optical disk 11. The read control unit 71 outputs the read Data Base information, Index table, Playlist, and Clip Information, to the master monitor information acquisition unit 72.

In step S22, the master monitor information acquisition unit 72 acquires the master monitor information from the Data Base information. Acquiring the master monitor information from the Data Base information is performed every time the master monitor information is switched.

For example, when the master monitor information is described in the PlayList, the master monitor information is acquired every time the PlayList used for playback is switched. When the master monitor information is described in Clip Information, the master monitor information is acquired every time the Clip Information used for playback is switched. Information other than the master monitor information included in the Data Base information is used for playing a video stream or the like.

In step S23, the decoding control unit 73 determines whether or not the display device 2 corresponds to the master monitor information based on the information acquired by the display information acquisition unit 74 by performing the process of FIG. 33. ..

When it is determined in step S23 that the display device 2 corresponds to the master monitor information, the read control unit 71 controls the disk drive 52 and reads the video stream from the optical disk 11 in step S24. The video stream read from the optical disk 11 is supplied to the decoding processing unit 56.

In step S25, the decoding unit 81 of the decoding processing unit 56 decodes the video stream supplied from the disk drive 52. The video data obtained by decoding is supplied to the communication unit 58 via the output unit 84.

In step S26, the communication unit 58 outputs the master monitor information acquired and supplied by the master monitor information acquisition unit 72 of the controller 51 and the video data obtained by decoding by the decoding processing unit 56 to the display device 2. After that, reading and decoding of the video stream are continued, and the process ends, for example, when the playback is completed to the end of the video stream.

On the other hand, if it is determined in step S23 that the display device 2 does not correspond to the master monitor information, in step S27, the decoding control unit 73 determines whether or not the display 104 corresponds to the color gamut of the content (video stream). Is determined. The determination here is made based on the master monitor information acquired by the master monitor information acquisition unit 72 and the information representing the performance of the display 104 acquired by the display information acquisition unit 74.

For example, if the color gamut of the content does not exceed the color gamut of the display, such as when both the color gamut of the content and the color gamut of the display are BT.2020, the display 104 corresponds to the color gamut of the content. It is judged. Further, when the color gamut of the content is wider than the color gamut of the display, such as when the color gamut of the content is BT.2020 and the color gamut of the display is BT.709, the display 104 is the color gamut of the content. It is determined that it does not correspond to.

When it is determined in step S27 that the display 104 corresponds to the color gamut of the content, in step S28, the decoding control unit 73 determines whether or not the display 104 corresponds to the dynamic range of the content. The determination here is also made based on the master monitor information acquired by the master monitor information acquisition unit 72 and the information representing the performance of the display 104 acquired by the display information acquisition unit 74.

If it is determined in step S28 that the display 104 also corresponds to the dynamic range of the content, in step S29, the read control unit 71 controls the disk drive 52 and reads the video stream from the optical disk 11.

In step S30, the decoding unit 81 of the decoding processing unit 56 decodes the video stream supplied from the disk drive 52. The video data obtained by decoding is supplied to the communication unit 58 via the output unit 84.

In step S31, the communication unit 58 outputs the video data obtained by decoding by the decoding processing unit 56 to the display device 2. After that, reading and decoding of the video stream are continued, and the process ends, for example, when the playback is completed to the end of the video stream.

As described above, when the display device 2 cannot understand the master monitor information, the master monitor information read from the optical disk 11 is not output, and only the video data obtained by decoding the video stream is output.

Further, when the display 104 supports both the color gamut and the dynamic range of the content, the video data obtained by decoding is obtained without performing conversion processing such as narrowing the color gamut or narrowing the dynamic range. It is output to the display device 2 as it is.

On the other hand, when it is determined in step S28 that the display 104 does not correspond to the dynamic range of the content, the read control unit 71 controls the disk drive 52 and reads the video stream from the optical disk 11 in step S32.

In step S33, the decoding unit 81 of the decoding processing unit 56 decodes the video stream supplied from the disk drive 52. The video data obtained by decoding is supplied to the dynamic range conversion unit 82.

In step S34, the dynamic range conversion unit 82 refers to the master monitor information and converts the video data obtained by decoding by the decoding unit 81 into data having a narrow dynamic range.

For example, if the dynamic range of the content is 0 to 400 cd / m ² , and the dynamic range of the display 104 is 0 to 300 cd / m ² , the dynamic range of the content is compressed to the range of 0 ^{to 300 cd / m 2.} Processing is done.

In step S35, the communication unit 58 outputs the video data after the dynamic range conversion to the display device 2. After that, reading and decoding of the video stream and conversion of the dynamic range are continued. For example, when the playback is completed to the end of the video stream, the processing ends.

On the other hand, if it is determined in step S27 that the display 104 does not correspond to the color gamut of the content, in step S36 (FIG. 36), the decoding control unit 73 determines whether the display 104 corresponds to the dynamic range of the content. Is determined.

When it is determined in step S36 that the display 104 corresponds to the dynamic range of the content, in step S37, the read control unit 71 controls the disk drive 52 and reads the video stream from the optical disk 11.

In step S38, the decoding unit 81 of the decoding processing unit 56 decodes the video stream supplied from the disk drive 52.

In step S39, the color gamut conversion unit 83 refers to the master monitor information and converts the video data obtained by decoding by the decoding unit 81 into data having a narrowed color gamut.

For example, when the color gamut of the content is BT.2020 and the color gamut of the display 104 is BT.709, a process of compressing the color gamut of the content to the color gamut of BT.709 is performed.

In step S40, the communication unit 58 outputs the video data after the color gamut conversion to the display device 2. After that, reading and decoding of the video stream and conversion of the color gamut are continued. For example, when the playback is completed to the end of the video stream, the processing ends.

On the other hand, when it is determined in step S36 that the display 104 does not correspond to the dynamic range of the content, the read control unit 71 controls the disk drive 52 and reads the video stream from the optical disk 11 in step S41.

In step S42, the decoding unit 81 of the decoding processing unit 56 decodes the video stream supplied from the disk drive 52. The video data obtained by decoding is supplied to the dynamic range conversion unit 82.

In step S43, the dynamic range conversion unit 82 refers to the master monitor information and converts the video data obtained by decoding by the decoding unit 81 into data having a narrow dynamic range. Further, the color gamut conversion unit 83 refers to the master monitor information and converts the video data after the dynamic range conversion by the dynamic range conversion unit 82 into data having a narrower color gamut. The video data after conversion of the dynamic range and the color gamut is output from the color gamut conversion unit 83 to the output unit 84 and supplied to the communication unit 58.

In step S44, the communication unit 58 outputs the video data after the conversion of the dynamic range and the color gamut to the display device 2. After that, the reading of the video stream, the decoding of the read video stream, the conversion of the dynamic range and the color gamut are continued, and the processing ends, for example, when the playback is completed to the end of the video stream.

As described above, when the display device 2 corresponds to the master monitor information, the video data obtained by decoding is output as it is together with the master monitor information regardless of the performance of the display 104.

If the display device 2 does not support the master monitor information, the video data obtained by decoding is output as it is, or the converted video after converting at least one of the dynamic range and the color gamut. Data is output.

[Display processing of display device 2]
Next, the display process of the display device 2 will be described with reference to the flowchart of FIG. 37.

The process of FIG. 37 is started when the process of FIGS. 35 and 36 is performed by the playback device 1 and the video data is transmitted. The transmitted video data is received by the communication unit 102.

In step S51, the video data acquisition unit 121 of the signal processing unit 103 acquires the video data received by the communication unit 102.

In step S52, the communication unit 102 determines whether or not the master monitor information has been transmitted from the playback device 1 together with the video data. The fact that the master monitor information is transmitted together with the video data indicates that the display device 2 is a device corresponding to the master monitor information. As described above, when the display device 2 corresponds to the master monitor information, the video data obtained by decoding the video stream is transmitted to the display device 2 as it is.

When it is determined in step S52 that the master monitor information has been transmitted, in step S53, the master monitor information acquisition unit 111 of the controller 101 acquires the master monitor information transmitted together with the video data. The acquired master monitor information is supplied to the signal processing control unit 112.

In step S54, the signal processing control unit 112 determines whether or not the color gamut of the video data transmitted from the playback device 1 represented by the master monitor information exceeds the color gamut of the display 104.

When it is determined in step S54 that the color gamut of the video data exceeds the color gamut of the display 104, in step S55, the signal processing control unit 112 determines that the dynamic range of the video data represented by the master monitor information is the display 104. Judge whether or not the dynamic range of is exceeded.

When it is determined in step S55 that the dynamic range of the video data exceeds the dynamic range of the display 104, in step S56, the signal processing control unit 112 transmits the conversion of the dynamic range and color gamut of the video data to the signal processing unit 103. Let me do it.

That is, the dynamic range conversion unit 122 of the signal processing unit 103 converts the video data acquired by the video data acquisition unit 121 into video data having a dynamic range that can be displayed by the display 104. Further, the color gamut conversion unit 123 converts the video data after the conversion of the dynamic range into the video data of the color gamut that can be displayed by the display 104. The converted video data with a narrow dynamic range and color gamut is output to the output unit 124.

In step S57, the output unit 124 displays the video of the content on the display 104 based on the video data after the conversion of the dynamic range and the color gamut. When the above processing is continued and the playback of the content is completed, the processing is terminated.

On the other hand, when it is determined in step S55 that the dynamic range of the video data does not exceed the dynamic range of the display 104, the signal processing control unit 112 causes the signal processing unit 103 to convert the video data in step S58.

That is, the color gamut conversion unit 123 of the signal processing unit 103 converts the video data acquired by the video data acquisition unit 121 into video data having a color gamut that can be displayed by the display 104. Since the dynamic range does not exceed the dynamic range of the display, only conversion to data that narrows the color gamut is performed. The converted video data converted so as to narrow the color gamut is output to the output unit 124.

In step S59, the output unit 124 displays the video of the content on the display 104 based on the video data after the color gamut conversion. When the above processing is continued and the playback of the content is completed, the processing is terminated.

On the other hand, when it is determined in step S54 that the color gamut of the video data does not exceed the color gamut of the display 104, the signal processing control unit 112 determines in step S60 that the dynamic range of the video data exceeds the dynamic range of the display 104. Determine if it is.

When it is determined in step S60 that the dynamic range of the video data exceeds the dynamic range of the display 104, in step S61, the signal processing control unit 112 refers to the master monitor information and the video transmitted from the playback device 1. The data is converted into the signal processing unit 103.

That is, the dynamic range conversion unit 122 of the signal processing unit 103 converts the video data acquired by the video data acquisition unit 121 into video data having a dynamic range that can be displayed by the display 104. The converted video data converted so as to narrow the dynamic range is output to the output unit 124.

In step S62, the output unit 124 displays the video of the content on the display 104 based on the video data after the conversion of the dynamic range. When the above processing is continued and the playback of the content is completed, the processing is terminated.

On the other hand, since the display device 2 does not correspond to the master monitor information, if it is determined in step S52 that the master monitor information has not been transmitted, in step S63, the output unit 124 of the signal processing unit 103 will move. The video of the content is displayed on the display 104 based on the video data acquired by the video data acquisition unit 121.

Similarly, when it is determined in step S60 that the dynamic range of the video data does not exceed the dynamic range of the display 104, the video of the content is displayed based on the video data acquired by the video data acquisition unit 121 in step S63. Will be done. When the display device 2 is a device corresponding to the master monitor information, but the transmitted video data is the video data that can be displayed by the display 104, the video data transmitted from the playback device 1 displays the video. It is used as it is.

A video image using the video data transmitted from the playback device 1 as it is is displayed, and when the playback of the content is completed, the processing is terminated.

By the above processing, the actual color gamut and dynamic range of the content recorded on the optical disk 11 are transmitted from the playback device 1 to the display device 2.

Further, when the color gamut and dynamic range of the contents recorded on the optical disk 11 exceed the performance of the display 104, a process of narrowing them is performed based on the actual color gamut and dynamic range.

In the above, when the display device 2 corresponds to the master monitor information, the conversion process for narrowing the color gamut and the dynamic range is performed by the display device 2, but it may be performed by the playback device 1. .. In this case, the conversion process by the playback device 1 when the color gamut and dynamic range of the content recorded on the optical disk 11 exceeds the performance of the display 104 is performed in the same manner as the process in step S43 of FIG.

<< Second Embodiment >>
In the above, it is assumed that the data base information recorded on the optical disk 11 includes the master monitor information, but it may be included in the video stream. When the video stream is a HEVC video stream, the master monitor information is inserted into the HEVC encoded data as SEI (Supplemental Enhancement Information). A HEVC video stream in which SEI is inserted into the coded data of HEVC is recorded on the optical disk 11 in BD format.

FIG. 38 is a diagram showing a configuration of an access unit of HEVC.

The HEVC video stream consists of access units, which are a collection of NAL (Network Abstraction Layer) units. One access unit contains one picture of video data.

As shown in FIG. 38, one access unit is an AU delimiter (Access Unit delimiter), VPS (Video Parameter Set), SPS (Sequence Parameter Set), PPS (Picture Parameter Set), SEI, VCL (Video Coding Layer). , EOS (End of Sequence), and EOS (End of Stream).

The AU delimiter indicates the beginning of the access unit. The VPS contains metadata that represents the contents of the bitstream. The SPS contains information that the HEVC decoder needs to refer to through the sequence decoding process, such as picture size and CTB (Coding Tree Block) size. The PPS contains information that the HEVC decoder needs to refer to in order to perform the picture decoding process. VPS, SPS, PPS are used as header information.

SEI is auxiliary information including timing information of each picture and information on random access. The master monitor information is included in the access unit as HEVC Mastering monitor information SEI. VCL is the data of one picture. EOS (End of Sequence) indicates the end position of the sequence, and EOS (End of Stream) indicates the end position of the stream.

FIG. 39 is a diagram showing the syntax of HEVC Mastering monitor information SEI.

HEVC Mastering monitor information SEI includes display_primaries_x, display_primaries_y, white_point_x, white_point_y, max_display_mastering_luminance, min_display_mastering_luminance.

These pieces of information are the same as the information described with reference to FIG. That is, display_primaries_x and display_primaries_y represent the color gamut of the master monitor, and white_point_x and white_point_y represent the position of white in the color gamut. max_display_mastering_luminance and min_display_mastering_luminance represent the dynamic range of the master monitor.

As described above, when the master monitor information is included in the video stream and the master monitor information is also included in the Data Base information as described above, the master monitor information included in the video stream is preferentially used.

The master monitor information contained in the video stream may contain more detailed information than the master monitor information contained in the Data Base information. For example, when mastering_monitor_info described with reference to FIG. 7 is used as the master monitor information described in the Data Base information, the amount of information in the video stream shown in FIG. 39 is larger.

By preferentially using the master monitor information contained in the video stream, it becomes possible to perform processing efficiently and with higher accuracy (more in line with the author's intention).

If it is possible to include master monitor information in the video stream, Clip Information as Data Base information contains information indicating whether or not the corresponding video stream contains master monitor information. Described with.

FIG. 40 is a diagram showing a part of ClipInfo () of Clip Information.

In ClipInfo (), in addition to the mastering_monitor_color_primaries and mastering_monitor_luminance described with reference to FIG. 20, a 1-bit mastering_monitor_sei_paresent_flag is described.

mastering_monitor_sei_paresent_flag = 1 indicates that the corresponding video stream contains the master monitor information of FIG. Also, mastering_monitor_sei_paresent_flag = 0 indicates that the corresponding video stream does not contain master monitor information.

If the value of mastering_monitor_sei_paresent_flag is 1, processing is performed using the master monitor information included in the corresponding video stream, and if it is 0, processing is performed using the master monitor information contained in ClipInfo (). It will be done.

The master monitor information may be described in the Index table or Play List, and the mastering_monitor_sei_paresent_flag may be included in the Clip Information.

Here, the reproduction process of the reproduction apparatus 1 will be described with reference to the flowcharts of FIGS. 41 and 42.

The processing of FIGS. 41 and 42 is a processing when the master monitor information can be included not only in the Data Base information but also in the video stream.

In step S101, the read control unit 71 of the controller 51 controls the disk drive 52 and reads the Data Base information from the optical disk 11.

In step S102, the read control unit 71 determines whether or not the value of mastering_monitor_sei_paresent_flag included in Clip Information is 1.

Since the video stream corresponding to Clip Information does not include master monitor information, if it is determined that the value of mastering_monitor_sei_paresent_flag is not 1, the controller 51 performs normal playback processing in step S103. That is, the process described with reference to FIGS. 35 and 36 is performed using the master monitor information included in the Data Base information. After the normal regeneration process in step S103, the process ends.

On the other hand, when it is determined that the value of mastering_monitor_sei_paresent_flag is 1, in step S104, the read control unit 71 controls the disk drive 52 and reads the video stream from the optical disk 11. The video stream read from the optical disk 11 is supplied to the decoding processing unit 56.

In step S105, the master monitor information acquisition unit 72 analyzes the video stream supplied to the decoding processing unit 56 and acquires the master monitor information included in the video stream as SEI. The acquired master monitor information is supplied to the decoding control unit 73.

In step S106, the decoding control unit 73 determines whether or not the display device 2 corresponds to the master monitor information based on the information acquired by the display information acquisition unit 74 by performing the process of FIG. 33. ..

When it is determined in step S106 that the display device 2 corresponds to the master monitor information, in step S107, the decoding unit 81 of the decoding processing unit 56 decodes the video stream supplied from the disk drive 52. The video data obtained by decoding is supplied to the communication unit 58 via the output unit 84.

In step S108, the communication unit 58 outputs the master monitor information acquired and supplied by the master monitor information acquisition unit 72 of the controller 51 and the video data obtained by decoding by the decoding processing unit 56 to the display device 2. After that, reading and decoding of the video stream are continued, and the process ends, for example, when the playback is completed to the end of the video stream.

On the other hand, when it is determined in step S106 that the display device 2 does not correspond to the master monitor information, in step S109, the decoding control unit 73 determines whether or not the display 104 corresponds to the color gamut of the content. .. The determination here is made based on the master monitor information acquired by the master monitor information acquisition unit 72 and the information representing the performance of the display 104 acquired by the display information acquisition unit 74.

When it is determined in step S109 that the display 104 corresponds to the color gamut of the content, in step S110, the decoding control unit 73 determines whether or not the display 104 corresponds to the dynamic range of the content. The determination here is also made based on the master monitor information acquired by the master monitor information acquisition unit 72 and the information representing the performance of the display 104 acquired by the display information acquisition unit 74.

If it is determined in step S110 that the display 104 also corresponds to the dynamic range of the content, in step S111, the decoding unit 81 of the decoding processing unit 56 decodes the video stream supplied from the disk drive 52. The video data obtained by decoding is supplied to the communication unit 58 via the output unit 84.

In step S112, the communication unit 58 outputs the video data obtained by decoding by the decoding processing unit 56 to the display device 2. After that, reading and decoding of the video stream are continued, and the process ends, for example, when the playback is completed to the end of the video stream.

In this way, when the display device 2 cannot understand the master monitor information, the master monitor information acquired from the video stream is not output, and only the video data obtained by decoding the video stream is output.

On the other hand, if it is determined in step S110 that the display 104 does not correspond to the dynamic range of the content, in step S113, the decoding unit 81 of the decoding processing unit 56 decodes the video stream supplied from the disk drive 52. The video data obtained by decoding is supplied to the dynamic range conversion unit 82.

In step S114, the dynamic range conversion unit 82 refers to the master monitor information and converts the video data obtained by decoding by the decoding unit 81 into data having a narrow dynamic range.

In step S115, the communication unit 58 outputs the video data after the dynamic range conversion to the display device 2. After that, reading and decoding of the video stream and conversion of the dynamic range are continued. For example, when the playback is completed to the end of the video stream, the processing ends.

On the other hand, if it is determined in step S109 that the display 104 does not correspond to the color gamut of the content, in step S116 (FIG. 42), the decoding control unit 73 determines whether the display 104 corresponds to the dynamic range of the content. Is determined.

If it is determined in step S116 that the display 104 corresponds to the dynamic range of the content, in step S117, the decoding unit 81 of the decoding processing unit 56 decodes the video stream supplied from the disk drive 52.

In step S118, the color gamut conversion unit 83 refers to the master monitor information and converts the video data obtained by decoding by the decoding unit 81 into data having a narrowed color gamut.

In step S119, the communication unit 58 outputs the video data after the color gamut conversion to the display device 2. After that, reading and decoding of the video stream and conversion of the color gamut are continued. For example, when the playback is completed to the end of the video stream, the processing ends.

On the other hand, when it is determined in step S116 that the display 104 does not correspond to the dynamic range of the content, in step S120, the decoding unit 81 of the decoding processing unit 56 decodes the video stream supplied from the disk drive 52. ..
The video data obtained by decoding is supplied to the dynamic range conversion unit 82.

In step S121, the dynamic range conversion unit 82 refers to the master monitor information and converts the video data obtained by decoding by the decoding unit 81 into data having a narrow dynamic range. Further, the color gamut conversion unit 83 refers to the master monitor information and converts the video data after the dynamic range conversion by the dynamic range conversion unit 82 into data having a narrower color gamut. The video data after conversion of the dynamic range and the color gamut is output from the color gamut conversion unit 83 to the output unit 84 and supplied to the communication unit 58.

In step S122, the communication unit 58 outputs the video data after conversion of the dynamic range and the color gamut to the display device 2. After that, the reading of the video stream, the decoding of the read video stream, the conversion of the dynamic range and the color gamut are continued, and the processing ends, for example, when the playback is completed to the end of the video stream.

As described above, when the master monitor information is included in both the video stream and the Data Base information, the master monitor information included in the video stream is preferentially used to process efficiently and with higher accuracy. Will be able to do.

In addition, corresponding to the processing of FIGS. 41 and 42, the display device 2 performs the same processing as the processing described with reference to FIG. 37.

<< About recording device >>
FIG. 43 is a block diagram showing a configuration example of the recording device 201.

The data generated by the recording device 201 is recorded on the optical disk 11 and reproduced by the reproduction device 1. Actually, the optical disk is duplicated based on the master board on which the content is recorded by the recording device 201, and one of them is provided to the reproduction device 1 as the optical disk 11 and reproduced.

The recording device 201 includes a controller 211, a coding processing unit 212, and a disk drive 213. The video data to be the master generated by the author while checking the display on the master monitor is input to the coding processing unit 212.

The controller 211 is composed of a CPU, ROM, RAM and the like. The controller 211 executes a predetermined program and controls the overall operation of the recording device 201.

In the controller 211, the Data Base information generation unit 211A is realized by executing a predetermined program. The Data Base information generation unit 211A generates the Data Base information including the master monitor information as described above and outputs it to the disk drive 213.

The coding processing unit 212 encodes the input video data according to a format such as HEVC. The coding processing unit 212 outputs the video stream obtained by encoding the master video data to the disk drive 213. The video stream will optionally include master monitor information as an SEI.

The disk drive 213 records the Data Base information supplied from the controller 211 and the file for storing the video stream supplied from the coding processing unit 212 on the optical disk 11 according to the directory structure of FIG.

<Recording process>
Next, the recording process of the recording device 201 will be described with reference to the flowchart of FIG. 44. The process of FIG. 44 starts when the master video data is input to the recording device 201 via the network or a predetermined recording medium.

In step S201, the Data Base information generation unit 211A generates Data Base information including master monitor information.

In step S202, the coding processing unit 212 encodes the input video data according to a format such as HEVC to generate a video stream.

In step S203, the disk drive 213 records the data base information supplied from the controller 211 and the file storing the video stream supplied from the coding processing unit 212 on the optical disk 11, and ends the processing.

<Computer configuration example>
The series of processes described above can be executed by hardware or software. When a series of processes are executed by software, the programs constituting the software are installed from the program recording medium on a computer embedded in dedicated hardware, a general-purpose personal computer, or the like.

FIG. 45 is a block diagram showing a configuration example of hardware of a computer that executes the above-mentioned series of processes programmatically.

The CPU (Central Processing Unit) 251 and the ROM (Read Only Memory) 252 and the RAM (Random Access Memory) 253 are connected to each other by a bus 254.

An input / output interface 255 is further connected to the bus 254. An input unit 256 including a keyboard and a mouse, and an output unit 257 including a display and a speaker are connected to the input / output interface 255. Further, the input / output interface 255 is connected to a storage unit 258 made of a hard disk, a non-volatile memory, etc., a communication unit 259 made of a network interface, etc., and a drive 260 for driving the removable media 261.

In the computer configured as described above, the CPU 251 loads the program stored in the storage unit 258 into the RAM 253 via the input / output interface 255 and the bus 254 and executes the above-mentioned series of processes. Is done.

The program executed by the CPU 251 is recorded on the removable media 261 or provided via a wired or wireless transmission medium such as a local area network, the Internet, or a digital broadcast, and is installed in the storage unit 258.

The program executed by the computer may be a program that is processed in chronological order according to the order described in this specification, or may be a program that is processed in parallel or at a necessary timing such as when a call is made. It may be a program in which processing is performed.

The embodiment of the present technology is not limited to the above-described embodiment, and various changes can be made without departing from the gist of the present technology.

For example, the present technology can have a cloud computing configuration in which one function is shared by a plurality of devices via a network and jointly processed.

Further, each step described in the above-mentioned flowchart can be executed by one device or can be shared and executed by a plurality of devices.

Further, when a plurality of processes are included in one step, the plurality of processes included in the one step can be executed by one device or shared by a plurality of devices.

In the present specification, the system means a set of a plurality of components (devices, modules (parts), etc.), and it does not matter whether all the components are in the same housing. Therefore, a plurality of devices housed in separate housings and connected via a network, and a device in which a plurality of modules are housed in one housing are both systems. ..

The effects described herein are merely exemplary and not limited, and may have other effects.

1 Playback device, 2 Display device, 11 Optical disc, 51 Controller, 52 Disk drive, 53 Memory, 56 Decoding processing unit, 58 Communication unit, 71 Read control unit, 72 Master monitor information acquisition unit, 73 Decoding control unit, 74 Display information Acquisition unit, 81 Decoding unit, 82 Dynamic range conversion unit, 83 Color gamut conversion unit, 84 Output unit

Claims (14)

A video stream of content including HDR video, an acquisition unit that acquires monitor information representing a plurality of brightness of the master monitor used in producing the video of the content, and an acquisition unit.
A playback device including an output unit that outputs the monitor information to the display device. The playback device according to claim 1, wherein the output unit outputs the monitor information described in the optional area in the HDMI data format. The reproduction device according to claim 2, wherein the output unit outputs the monitor information to the display device capable of understanding the monitor information. The reproduction device according to claim 2 or 3, wherein the plurality of luminances include a maximum luminance and a minimum luminance. Further provided with a decoding unit for decoding the video stream,
The playback device according to any one of claims 2 to 4, wherein the output unit outputs the monitor information together with the video data obtained by decoding the video stream. Further provided with a conversion unit that converts the video data obtained by decoding the video stream into video data of an image having a brightness that can be displayed by a display device that cannot understand the monitor information.
The playback device according to any one of claims 1 to 5, wherein the output unit outputs video data obtained by conversion. An information acquisition unit that acquires information indicating display performance, which is transmitted from the display device before the content is reproduced, and an information acquisition unit.
The reproduction device according to any one of claims 1 to 6, further comprising a control unit that controls an output to a display device based on the information acquired by the information acquisition unit. Acquires the video stream of the content including the HDR image and the monitor information representing the plurality of brightness of the master monitor used for producing the image of the content.
An information processing method including a step of outputting the monitor information to a display device. Display performance information indicating its own display performance is transmitted to a playback device that reproduces content including a video stream of HDR video before playback of the content, and the content transmitted from the playback device. A display device including a communication unit that receives monitor information representing multiple brightness of the master monitor used for video production. The display device according to claim 9, wherein the communication unit receives the monitor information described in the optional area in the HDMI data format.
The display device according to claim 10, wherein the communication unit receives the monitor information transmitted from the reproduction device when it is determined that the communication unit is a device capable of understanding the monitor information. The communication unit receives the monitor information transmitted together with the video data obtained by decoding the video stream in the playback device, and receives the monitor information.
The display device according to any one of claims 9 to 11, further comprising a display unit for displaying an image based on the video data. The video data transmitted from the playback device is further provided with a conversion unit that converts the video data into displayable brightness video data based on the monitor information.
The display device according to claim 12, wherein the display unit displays an image based on video data obtained by converting the brightness. Display performance information indicating its own display performance is transmitted to a playback device that plays back content including a video stream of HDR video before the content is played back.
An information processing method including a step of receiving monitor information representing a plurality of brightness of a master monitor used for producing a video of the content transmitted from the playback device.

Images