JP2020022179A - Reproduction method, program and reproducer - Google Patents

Abstract

To further improve a reproduction method, a reproducer and a program of video data including a high dynamic range video recorded in a recording medium.SOLUTION: In a home theater system, a video stream including at least one of an HDR stream where a dynamic range of the brilliance of a video corresponds to an HDR, and an SDR stream corresponding to an SDR having the dynamic range of the brilliance of the video narrower than the HDR, and identification information indicating whether or not the HDR stream is contained in the video stream are recorded in a recording medium. In the reproduction method, the identification information is read from the recording medium, reproduction capacity information indicating whether or not a reproducer can reproduce the HDR stream, and display capacity information indicating whether or not a display device connected with the reproducer can display the video of the HDR are acquired, and a video stream to be reproduced is determined in the video stream, according to the identification information thus read, and the reproduction capacity information and the display capacity information thus acquired.SELECTED DRAWING: Figure 22

Description

  The present disclosure relates to a method, a device, and a program for reproducing video data including a high dynamic range (HDR) video recorded on a recording medium.

  2. Description of the Related Art Conventionally, a technique relating to a DVD has been disclosed (for example, see Patent Document 1).

JP-A-9-282848

  However, in the above-mentioned patent documents, further improvement was required.

  A reproduction method according to an aspect of the present disclosure is a reproduction method by a reproduction apparatus that reproduces a video stream recorded on a recording medium, wherein the recording medium has a high dynamic range of video luminance. And a video stream including at least one of an SDR stream corresponding to a standard dynamic range (SDR) in which a dynamic range of video brightness is smaller than HDR, and the video stream includes the HDR stream. Identification information indicating whether or not the HDR stream is read, and the playback method reads the identification information from the recording medium, and playback capability information indicating whether or not the playback device can playback the HDR stream. Indicates whether a display device connected to the playback device can display HDR video. Acquiring the display capability information, determining the video stream to be reproduced from among the video streams according to the read identification information and the acquired reproduction capability information and display capability information, and determining the determined video stream And reproducing a reproduction signal obtained by the reproduction to the display device, wherein the identification information indicates whether the video stream includes a first HDR stream; Indicating whether the video stream includes a second HDR stream, wherein the determination is that the identification information is that the video stream includes the first HDR stream and the second HDR stream. And the reproduction capability information indicates that the first HDR stream can be reproduced, and the display capability When the information indicates that the video of the first HDR stream can be displayed, and the reproduction capability information indicates that the second HDR stream cannot be reproduced, or the display capability information indicates that the second HDR stream cannot be reproduced. When indicating that the video of the HDR stream cannot be displayed, the video stream that is indicated as the first HDR stream by the identification information is determined as the video stream to be reproduced.

  Further, a program according to an aspect of the present disclosure is a program for causing a computer to execute the above-described reproduction method.

  Further, a playback device according to an aspect of the present disclosure is a playback device that plays back a video stream recorded on a recording medium, wherein the recording medium has a dynamic range of video luminance of a high dynamic range (HDR). A video stream including at least one of a corresponding HDR stream, an SDR stream corresponding to a standard dynamic range (SDR) having a dynamic range of video luminance smaller than HDR, and the video stream including the HDR stream. Identification information indicating whether or not the HDR stream has been read, and the playback device has a reading unit that reads the identification information from the recording medium; and a playback capability that indicates whether the playback device can play back the HDR stream. Information and whether the display device connected to the playback device can display HDR video. An acquiring unit for acquiring display capability information; a determining unit for determining a video stream to be reproduced from the video streams in accordance with the read identification information and the acquired reproduction capability information and display capability information. And a playback unit that plays back the determined video stream, and an output unit that outputs a playback signal obtained by the playback to the display device, wherein the identification information is Indicating whether a first HDR stream is included and whether the video stream includes a second HDR stream, wherein the identification information includes the first HDR stream in the video stream; And the second HDR stream are included, and the reproduction capability information is the first HDR stream. When the display capability information indicates that the video of the first HDR stream can be displayed, and the display capability information indicates that the second HDR stream cannot be reproduced. Or when the display capability information indicates that the video of the second HDR stream cannot be displayed, the video to be reproduced is a video stream that is indicated by the identification information as being the first HDR stream. Determine as a stream.

  A reproduction method according to an aspect of the present disclosure is a reproduction method by a reproduction apparatus that reproduces a video stream recorded on a recording medium, wherein the recording medium has a high dynamic range of video luminance. One or more video streams including at least one of an HDR stream corresponding to the above, an SDR stream corresponding to a standard dynamic range (SDR) having a dynamic range of video luminance smaller than the HDR, and the one or more video streams. And identification information indicating whether or not the HDR stream is included. In the reproduction method, the identification information is read from the recording medium, and whether or not the reproduction device can reproduce the HDR stream is determined. And the display device connected to the playback device can display HDR video. A video stream to be reproduced from the one or more video streams in accordance with the read identification information and the obtained reproduction capability information and the display capability information. Is determined, the determined video stream is reproduced, and a reproduction signal obtained by the reproduction is output to the display device.

  According to the above aspect, further improvement can be realized.

FIG. 1 is a schematic diagram illustrating a home theater system using a playback device according to an embodiment of the present disclosure. FIG. 2 is a diagram showing a configuration of the BD-ROM. FIG. 3 is a diagram showing the internal structure of the INDEX file. FIG. 4 is a diagram showing the configuration of an AV clip. FIG. 5 is a diagram schematically showing each stream multiplexed on the AV clip. FIG. 6 is a diagram showing the details of the video frame sequence stored in the PES packet sequence. FIG. 7 is a diagram showing the structure of a TS packet and a source packet in an AV clip. FIG. 8 is a diagram showing a data structure of the PMT. FIG. 9 is a diagram showing the internal structure of the clip information file. FIG. 10 is a diagram showing the internal structure of the stream attribute information. FIG. 11 is a diagram showing the internal structure of the entry map. FIG. 12 is a diagram showing the internal structure of a playlist. FIG. 13 is a diagram showing the internal structure of a play item. FIG. 14 is a diagram showing an internal structure of a playlist including a sub path. FIG. 15 is a diagram showing the internal configuration of the playback device. FIG. 16 is a diagram showing a list of system parameters of the playback device. FIG. 17 is a diagram showing details of the internal configuration of the system target decoder of the playback device. FIG. 18 is a diagram showing the relationship between the standard dynamic range and the high dynamic range of the luminance level. FIG. 19 is a diagram showing details of the data structure of the playlist file. FIG. 20 is a diagram showing a combination pattern of main videos in a playlist. FIG. 21A is a diagram illustrating a data configuration example when only a main video stream of an HDR video exists. FIG. 21B is a diagram illustrating a data configuration example in a case where only a main video stream that is an HDR compatible SDR exists in a playlist. FIG. 21C is a diagram illustrating a data configuration example in a case where only a main video stream that is an SDR that is not HDR compatible exists in the playlist. FIG. 21D is a diagram illustrating an example of a data configuration when a playlist includes an essential HDR main video stream and a first optional HDR main video stream. FIG. 21E is a diagram illustrating an example of a data configuration when a playlist includes an essential HDR main video stream and a second optional HDR main video stream. FIG. 21F is a diagram illustrating an example of a data configuration when a playlist includes an essential HDR main video stream and an HDR-compatible SDR main video stream. FIG. 21G is a diagram illustrating an example of a data configuration when a playlist includes an essential HDR main video stream and an HDR-incompatible SDR main video stream. FIG. 22 is a flowchart showing a method of selecting (determining) a main video stream to be reproduced in the case of the AV reproduction mode. FIG. 23 is a flowchart showing a method for selecting a main video stream to be reproduced in the program reproduction mode. FIG. 24 is a flowchart illustrating an example of an output method for outputting video including SDR2 video to a display device when SDR2 video is selected. FIG. 25 is a flowchart illustrating an example of an output method for outputting a video including an SDR1 video to a display device when the SDR1 video is selected. FIG. 26 is a flowchart illustrating an example of an output method for outputting video including HDR1 video to a display device when HDR1 video is selected. FIG. 27 is a flowchart illustrating another example of an output method for outputting video including HDR1 video to a display device when HDR1 video is selected. FIG. 28 is a flowchart illustrating an example of an output method for outputting video including HDR2 video to a display device when HDR2 video is selected. FIG. 29 is a flowchart illustrating an example of an output method for outputting video including HDR3 video to a display device when HDR3 video is selected.

(Knowledge underlying the present disclosure)
In the above-mentioned patent documents, further improvement was required. The present inventor has found that the following problems occur with respect to a recording medium such as a DVD described in the section “Background Art”.

  In order to distribute moving image contents such as movie works, optical disks such as DVDs and Blu-ray (registered trademark) Discs are widely used. In particular, Blu-ray (registered trademark) Disc (BD) can handle HD (High Definition) of 1920 × 1080, whereas conventional DVD is SD (Standard Definition), so that higher image quality can be obtained. Can be stored. In recent years, video contents having higher resolutions such as 4K (3840 × 2160) and 8K (7680 × 4320) exceeding the HD resolution (hereinafter, referred to as “high-resolution video”) have also appeared as video contents. 2. Description of the Related Art Home-use playback devices capable of playing back 4K video have become widespread. In addition to the high-resolution video described above, a high dynamic range (HDR) for improving the contrast and color expression of the video by taking a wider dynamic range of the luminance of the video as compared with the related art as a high image quality technology. ) Technology is gaining attention. Since video contents compatible with the HDR technology have also appeared along with this, recording and reproduction of video contents with high resolution and high dynamic range on recording media such as optical disks will be required in the future.

  In the BD, the dynamic range of the luminance of the video is expanded to a video stream (hereinafter, referred to as “SDR stream”) corresponding to a standard dynamic range (SDR), which is a conventional method, and the dynamic range of the SDR is expanded. Either one or both of the video streams (hereinafter, referred to as “HDR streams”) corresponding to the high dynamic range (HDR), which is the method described above, is recorded. In addition, there are a plurality of different schemes in the HDR stream. An HDR stream corresponding to one of a plurality of different systems or a plurality of HDR streams respectively corresponding to a plurality of different systems is recorded on the BD.

  On the other hand, some playback devices have an HDR stream playback capability and some do not, and some display devices also have HDR video display capability. Also, there may be a playback device having a playback capability of a plurality of HDR streams corresponding to a plurality of HDR formats, and a display device having a display capability of a plurality of HDR videos corresponding to the plurality of HDR formats. obtain.

  As described above, since the playback capability differs depending on the playback device, and the display capability varies depending on the display device, depending on the combination of the playback device and the display device connected to each other, any one of the plurality of video streams recorded on the recording medium is determined. Whether the video stream corresponding to the dynamic range of the system is selected for reproduction and display differs.

  For example, if the playback device has the playback capability of the HDR stream, but the display device connected to the playback device does not have the capability of displaying the HDR video, the playback device has the HDR stream recorded on the recording medium. There is a problem that video contents cannot be displayed on a display device with image quality corresponding to HDR.

  Based on the above examinations, the present inventors examined the following improvement measures to solve the above-mentioned problems.

  A reproduction method according to an aspect of the present disclosure is a reproduction method by a reproduction apparatus that reproduces a video stream recorded on a recording medium, wherein the recording medium has a high dynamic range of video luminance. And a video stream including at least one of an SDR stream corresponding to a standard dynamic range (SDR) in which a dynamic range of video brightness is smaller than HDR, and the video stream includes the HDR stream. Identification information indicating whether or not the HDR stream is read, and the playback method reads the identification information from the recording medium, and playback capability information indicating whether or not the playback device can playback the HDR stream. Indicates whether a display device connected to the playback device can display HDR video. Acquiring the display capability information, determining the video stream to be reproduced from among the video streams according to the read identification information and the acquired reproduction capability information and display capability information, and determining the determined video stream And reproducing a reproduction signal obtained by the reproduction to the display device, wherein the identification information indicates whether the video stream includes a first HDR stream; Indicating whether the video stream includes a second HDR stream, wherein the determination is that the identification information is that the video stream includes the first HDR stream and the second HDR stream. And the reproduction capability information indicates that the first HDR stream can be reproduced, and the display capability When the information indicates that the video of the first HDR stream can be displayed, and the reproduction capability information indicates that the second HDR stream cannot be reproduced, or the display capability information indicates that the second HDR stream cannot be reproduced. When indicating that the video of the HDR stream cannot be displayed, a video stream that is indicated as the first HDR stream by the identification information is determined as the stream to be reproduced.

  Further, the second HDR stream may be a video stream having a predetermined higher priority than the first HDR stream.

  Further, a program according to an aspect of the present disclosure is a program for causing a computer to execute the above-described reproduction method.

  Further, a playback device according to an aspect of the present disclosure is a playback device that plays back a video stream recorded on a recording medium, wherein the recording medium has a dynamic range of video luminance of a high dynamic range (HDR). A video stream including at least one of a corresponding HDR stream, an SDR stream corresponding to a standard dynamic range (SDR) having a dynamic range of video luminance smaller than HDR, and the video stream including the HDR stream. Identification information indicating whether or not the HDR stream has been read, and the playback device has a reading unit that reads the identification information from the recording medium; and a playback capability that indicates whether the playback device can play back the HDR stream. Information and whether the display device connected to the playback device can display HDR video. An acquiring unit for acquiring display capability information; a determining unit for determining a video stream to be reproduced from the video streams in accordance with the read identification information and the acquired reproduction capability information and display capability information. And a playback unit that plays back the determined video stream, and an output unit that outputs a playback signal obtained by the playback to the display device, wherein the identification information is Indicating whether a first HDR stream is included and whether the video stream includes a second HDR stream, wherein the identification information includes the first HDR stream in the video stream; And the second HDR stream are included, and the reproduction capability information is the first HDR stream. When the display capability information indicates that the video of the first HDR stream can be displayed, and the display capability information indicates that the second HDR stream cannot be reproduced. Or when the display capability information indicates that the video of the second HDR stream cannot be displayed, the identification information indicates that the video stream that is the first HDR stream is the stream to be reproduced. To be determined.

  A reproduction method according to an aspect of the present disclosure is a reproduction method by a reproduction apparatus that reproduces a video stream recorded on a recording medium, wherein the recording medium has a high dynamic range of video luminance. One or more video streams including at least one of an HDR stream corresponding to the above, an SDR stream corresponding to a standard dynamic range (SDR) having a dynamic range of video luminance smaller than the HDR, and the one or more video streams. And identification information indicating whether or not the HDR stream is included. In the reproduction method, the identification information is read from the recording medium, and whether or not the reproduction device can reproduce the HDR stream is determined. And the display device connected to the playback device can display HDR video. A video stream to be reproduced from the one or more video streams in accordance with the read identification information and the obtained reproduction capability information and the display capability information. Is determined, the determined video stream is reproduced, and a reproduction signal obtained by the reproduction is output to the display device.

  According to this, since the video stream to be reproduced is determined according to three pieces of information of the identification information, the reproduction capability information, and the display capability information, it is possible to output a video of an appropriate video stream to the display device.

  Also, for example, the determination indicates that, among the one or more video streams, the read identification information is included in the one or more video streams, and the acquired reproduction capability information can be reproduced. And a video stream indicating that the acquired display capability information can be displayed may be determined as the stream to be reproduced.

  For this reason, the video of the appropriate video stream can be output to the display device.

  Also, for example, in the determination, when there are two or more video streams that can be played back by the playback device and can be displayed on the display device, a video having a predetermined higher priority among the two or more video streams. A stream may be determined as the stream to be reproduced.

  For this reason, a video of a more appropriate video stream can be output to the display device.

  Also, for example, the identification information further indicates whether the SDR stream is included in the one or more video streams, and in the determination, the identification information includes the HDR stream in the one or more video streams. And when including the SDR stream, the playback capability information indicates that the HDR stream can be played, and when the display capability information indicates that the HDR video can be displayed, it is the HDR stream. A video stream corresponding to the identification information indicating that the HDR stream cannot be reproduced, or the display capability information indicates that the HDR stream cannot be reproduced, or the display capability information indicates that the HDR stream cannot be reproduced. When the video cannot be displayed, the SDR stream is used. The video stream corresponding to said identification information indicating the bets may be determined as a stream to the playback.

  According to this, when the HDR stream can be reproduced and displayed, the video of the HDR stream is output to the display device. For this reason, a higher quality image can be output to the display device.

  Also, for example, the identification information further includes, for each of the one or more video streams, whether the video stream includes a first HDR stream, and whether the video stream includes a second HDR stream. And whether the identification information indicates that the one or more video streams include the first HDR stream and the second HDR stream. When the reproduction capability information indicates that the second HDR stream can be reproduced, and the display capability information indicates that the video of the second HDR stream can be displayed, the identification information indicates that the second HDR stream can be used. A video stream indicated to be present is determined as the stream to be reproduced, and the reproduction capability information is determined. Indicates that the first HDR stream can be reproduced, and the display capability information indicates that the video of the first HDR stream can be displayed, and the reproduction capability information indicates that the second HDR stream can be reproduced. When the display capability information indicates that the video of the second HDR stream cannot be displayed, or when the display capability information indicates that the video of the second HDR stream cannot be displayed, the video stream that is identified as the first HDR stream by the identification information May be determined as the stream to be reproduced.

  Further, for example, the second HDR stream may be a video stream having a predetermined higher priority than the first HDR stream.

  According to this, when the second HDR stream having a higher priority can be reproduced and displayed, the video of the second HDR stream can be output to the display device. Thereby, a more appropriate image can be output to the display device.

  Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

(Embodiment)
An embodiment of a reproducing method according to the present disclosure will be described with reference to the drawings.

  FIG. 1 is a schematic diagram illustrating a home theater system using a playback device according to an embodiment of the present disclosure. This home theater system can display HDR images in addition to 2840 images of 3840 pixels × 2160 pixels (hereinafter referred to as “4K”).

  As shown in FIG. 1, the home theater system plays back a BD-ROM disc 101, and includes a playback device 102, a display device 103, and a remote controller 104.

  The BD-ROM disc 101 is a read-only recording medium. The BD-ROM disc 101 stores, for example, a movie as content. This content includes a video stream representing 4K 2D video. The 4K 2D video is either an HDR video or an SDR video, and includes either an HDR stream or an SDR stream, or both. These video streams are arranged on the BD-ROM disc 101 in extent units, and are accessed by the playback device 102 using a data structure described later.

  The playback device 102 has a BD-ROM drive 121 mounted thereon. The BD-ROM drive 121 is an optical disk drive based on the BD-ROM system. The playback device 102 reads a video stream from the BD-ROM disc 101 using the BD-ROM drive 121. The playback device 102 plays back the video stream by decoding the read video stream into video data / audio data. Here, the playback device 102 can play back the video stream as both an SDR4K 2D video and an HDR4K 2D video. Hereinafter, the operation mode of the playback device 102 when playing back 2D video of SDR4K is referred to as “SDR playback mode”, and the operation mode of the playback device 102 when playing back 2D video of HDR4K is referred to as “HDR playback mode”.

  The playback device 102 is connected to the display device 103 via an HDMI (registered trademark) (High-Definition Multimedia Interface) cable 122. The playback device 102 converts video data / audio data obtained by decoding the video stream into a video signal / audio signal (also referred to as a reproduction signal) of the HDMI (registered trademark) system, and converts the video signal / audio signal into an HDMI (registered trademark) cable. The data is transmitted to the display device 103 through 122. The playback device 102 further exchanges CEC messages with the display device 103 through the HDMI (registered trademark) cable 122. Thereby, the playback device 102 can inquire the display device 103 whether or not the HDR video can be displayed.

  The display device 103 is, for example, a liquid crystal display. The display device 103 displays an image on the screen 131 according to the image signal, and generates sound from a built-in speaker according to the audio signal. The display device 103 is capable of displaying HDR video.

  Remote controller 104 includes an operation unit and a transmission unit. The operation unit includes a plurality of buttons. Each button is associated with each function of the playback device 102 or the display device 103, such as turning the power on or off or starting or stopping playback of the BD-ROM disc 101. The operation unit detects pressing of each button by the user, and transmits identification information of the button to the transmission unit by a signal. The transmission unit converts a signal from the operation unit into a signal IR based on infrared rays (or another wireless method) and sends the signal IR to the playback device 102 or the display device 103. On the other hand, the playback device 102 and the display device 103 each receive the signal IR transmitted from the remote controller 104 and execute the function indicated by the received signal IR. Thus, the user can remotely control the playback device 102 or the display device 103.

  Next, a data structure for storing 2D video of a BD-ROM as a recording medium according to the present disclosure will be described.

  FIG. 2 is a diagram showing a configuration of the BD-ROM.

  In FIG. 2, the fourth row shows the BD-ROM disc 101, and the third row shows the tracks 202 on the BD-ROM disc 101. The track 202 in FIG. 2 is drawn by extending the track 202 formed in a spiral shape from the inner circumference to the outer circumference of the BD-ROM disc 101 in the horizontal direction. The BD-ROM disc 101 has a recording area in a spiral form from the inner circumference to the outer circumference like other optical disks, for example, DVD and CD, and is provided between a lead-in on the inner circumference and a lead-out on the outer circumference. It has a volume area in which logical data can be recorded. In the volume area, a serial number is assigned in units of accessing the optical disk in order from the top, and this number is called a logical address. Reading data from an optical disk is performed by specifying a logical address. Here, the logical addresses are defined as being continuous even in the physical arrangement on the optical disk. That is, data having continuous logical addresses can be read out without the optical pickup of the BD-ROM drive 121 of the playback device 102 performing seek. Further, inside the lead-in, there is a special area called BCA (Burst Cutting Area) which can be read only by the BD-ROM drive 121. Since this area cannot be read from the application, it is often used for, for example, copyright protection technology.

  In the volume area, volume information of the file system is recorded from the beginning, and subsequently, application data such as video data is recorded. The file system is a mechanism for expressing data on a disk in units called directories or files. As the file system, in the case of the BD-ROM disc 101, UDF (Universal Disc Format) is used. Even in the case of a PC (personal computer) that is used every day, data recorded on a hard disk in a structure such as a directory or a file is expressed on a computer by a file system called FAT or NTFS, thereby improving usability. This file system makes it possible to read logical data recorded in the same manner as a normal PC using a directory and file structure.

  In the directory or file structure on the BD-ROM disc 101, a BDMV directory is located immediately below a root directory (ROOT). The BDMV directory is a directory in which data such as AV contents and management information handled by the BD-ROM disc 101 is recorded. Under the BDMV directory, an INDEX file in which an index table constituting a title is defined, a PLAYLIST directory, a CLIPINFO directory, a STREAM directory, and a PROGRAM directory are arranged. An AV clip (XXX.M2TS) in which AV contents such as video and audio are multiplexed and stored, a clip information file (XXX.CLPI) in which management information of the AV clip is stored, and a play that defines a logical playback path of the AV clip The list file (YYY.MPLS) and the BD program file (AAA.PROG) in which a program for defining a dynamic scenario are stored are arranged under the above-mentioned STREAM directory, CLIPINFO directory, PLAYLIST directory, and PROGRAM directory, respectively. Is done.

  The data structure of each file located under the BDMV directory will be described below.

  First, the INDEX file will be described. FIG. 3 is a diagram showing the internal structure of the INDEX file.

  As shown in FIG. 3, the INDEX file has an index table. The index table is a table of the highest layer that defines a title configuration such as all titles, a top menu, and a FirstPlay stored in the BD-ROM disc 101. In this table, all titles, a top menu, and a BD program file to be executed first from FirstPlay are specified. The playback device 102 of the BD-ROM disc 101 executes a predetermined BD program file with reference to the index table each time a title or menu is called. Here, the FirstPlay is set by the content provider, and a BD program file that is automatically executed when the BD-ROM disc 101 is reproduced is set. In the top menu, for example, a BD program file to be called when a command “return to menu” is executed by a user operation using the remote controller 104 or the like is set.

  Returning to FIG. 2, the BD program file (AAA.PROG) stores a program to be executed by being specified from the title. There are multiple files for the program, and the prefix (AAA) is used to identify the program. As a program used here, in the case of a BD, a program of an original interpreter system called command navigation is used. However, since the language system is not the essence of the present disclosure, Java (registered trademark) or JavaScript (registered trademark) is used. It may be a general-purpose programming language such as. A play list to be reproduced by this program is specified.

  Next, the AV clip (XXX.M2TS) and the clip information file (XXX.CLPI) will be described.

  An AV clip is a digital stream in the MPEG-2 transport stream format.

  FIG. 4 is a diagram showing the configuration of an AV clip. As shown in the figure, an AV clip is obtained by multiplexing one or more of a video stream (video stream), an audio stream, a presentation graphics stream (PG), and an interactive graphics stream. The video stream indicates the main video and sub-video of the movie, the audio stream (IG) indicates the main audio portion of the movie and the sub-audio mixed with the main audio, and the presentation graphics stream indicates the subtitle of the movie. Here, the main image indicates a normal image displayed on the screen, and the sub-image is an image displayed on a small screen in the main image. The interactive graphics stream indicates an interactive screen created by arranging GUI parts on the screen. The video stream is encoded by a method such as MPEG-2, MPEG-4 AVC, or SMPTE VC-1. The audio stream can be AC-3, Dolby Digital Plus (Dolby Digital Plus), MLP (Meridian Lossless Packing: registered trademark), DTS (Digital Theater System: registered trademark), DTS-HD, or linear PCM. (Pulse Code Modulation).

  The configuration of the video stream will be described. In moving image compression encoding such as MPEG-2, MPEG-4 AVC, and SMPTE VC-1, the data amount is compressed by utilizing the spatial and temporal redundancy of a moving image. As a method of utilizing the redundancy in the time direction, inter-picture prediction coding is used. In the inter-picture prediction coding, when a certain picture is coded, a picture located forward or backward in display time order is set as a reference picture. Then, the amount of motion from the reference picture is detected, and the amount of data is compressed by removing the redundancy in the spatial direction from the difference between the motion-compensated picture and the current picture.

  Here, a picture for which intra-picture prediction coding is performed using only a current picture without having a reference picture is referred to as an I picture. A picture is a single unit of coding that includes both frames and fields. A picture to be subjected to inter-picture predictive encoding with reference to one already processed picture is called a P picture, and a picture to be subjected to inter-picture predictive encoding by simultaneously referring to two already processed pictures is called a B picture. , And a picture referred to by another picture among B pictures is called a Br picture. A frame in the case of a frame structure or a field in the case of a field structure is referred to as a video access unit here.

  Each stream included in the AV clip is identified by a PID (Packet ID). As PIDs, for example, 0x1011 for video streams used for movie images, 0x1100 to 0x111F for audio streams, 0x1200 to 0x121F for presentation graphics, and 0x1400 to 0x141F for interactive graphics streams However, 0x1B00 to 0x1B1F are allocated to the video stream used for the sub-picture of the movie, and 0x1A00 to 0x1A1F are allocated to the audio stream used for the sub-audio to be mixed with the main audio.

  FIG. 5 is a diagram schematically showing each stream multiplexed on the AV clip.

  First, a video stream 501 composed of a plurality of video frames and an audio stream 504 composed of a plurality of audio frames are converted into PES packet sequences 502 and 505, respectively, and further converted into TS packets 503 and 506. Similarly, the presentation graphics stream 507 and the interactive graphics stream 510 are converted into PES packet sequences 508 and 511, respectively, and further converted into TS packets 509 and 512. The AV clip 513 is configured by multiplexing these TS packets 503, 506, 509, 512 into one stream.

  FIG. 6 is a diagram showing the details of the video frame sequence stored in the PES packet sequence.

  In FIG. 6, the first row shows the video frame sequence of the video stream, and the second row shows the PES packet sequence. As shown in FIG. 6, a plurality of Video Presentation Units I picture yy1, P picture yy2, B picture yy3 and yy4 in a video stream are divided for each picture, and each divided picture is stored in a payload of a PES packet. Is done. Each PES packet has a PES header. In the PES header, a PTS (Presentation Time-Stamp) which is a display time of the picture and a DTS (Decoding Time-Stamp) which is a decoding time of the picture are stored.

  FIG. 7 is a diagram showing the structure of a TS packet and a source packet in an AV clip.

  As shown in FIG. 7, the TS packet sequence has a plurality of TS packets. Each of the plurality of TS packets is a 188-byte fixed-length packet composed of a 4-byte TS header having information such as a PID for identifying a stream, and an 184-byte TS payload for storing data. The packet is divided and stored in the TS payload. In the case of a BD-ROM, a 192 byte source packet is configured by adding a 4-byte TP_Extra_Header to a TS packet, and each source packet is written to an AV clip. Information such as ATS (Arrival_Time_Stamp) is described in TP_Extra_Header. The ATS indicates a transfer start time of the TS packet to a PID filter of a system target decoder 1503 described later. An AV clip is configured by arranging a plurality of source packets as shown in the lower part of FIG. The number incremented from the beginning of the AV clip is called SPN (Source Packet Number).

  In addition, the TS packet included in the AV clip includes a PAT (Program Association Table), a PMT (Program Map Table), a PCR (Program Clock Reference), etc., in addition to the streams such as video, audio, and subtitles. The PAT indicates what is the PID of the PMT used in the AV clip. The PID of the PAT itself is registered as 0. The PMT has the PID of each stream such as video, audio, subtitles, and the like included in the AV clip, and the attribute information of the stream corresponding to each PID. The PMT has various descriptors related to the AV clip. The descriptor includes copy control information for instructing permission or prohibition of copying the AV clip. In order to synchronize the ATS (Arrival Time Clock) which is the time axis of the ATS with the STC (System Time Clock) which is the time axis of the PTS and DTS, the PCR packet is transmitted to the ATS transmitted to the decoder. It has information of the corresponding STC time.

  FIG. 8 is a diagram for explaining the data structure of the PMT in detail.

  At the head of the PMT, a PMT header describing the length of data included in the PMT is arranged. Behind that, a plurality of descriptors related to the AV clip are arranged. The above-described copy control information and the like are described as descriptors. After the descriptor, a plurality of pieces of stream information on each stream included in the AV clip are arranged. The stream information is composed of a stream descriptor describing a stream type, a stream PID, and stream attribute information (frame rate, aspect ratio, etc.) for identifying a compression codec of the stream. There are as many stream descriptors as the number of streams existing in the AV clip.

  FIG. 9 is a diagram showing the internal structure of the clip information file.

  As shown in FIG. 9, the clip information file is management information of the AV clip, and has a one-to-one correspondence with the AV clip. The clip information file includes clip information, stream attribute information, and an entry map.

  The clip information includes a system rate, a reproduction start time, and a reproduction end time, as shown in FIG. The system rate indicates a maximum transfer rate of an AV clip to a PID filter of a system target decoder described later. The interval between ATSs included in the AV clip is set to be equal to or less than the system rate. The playback start time is the PTS of the video frame at the head of the AV clip, and the playback end time is set to the PTS of the video frame at the end of the AV clip plus the playback interval for one frame.

  FIG. 10 is a diagram showing the internal structure of the stream attribute information.

  As the stream attribute information, as shown in FIG. 10, attribute information on each stream included in the AV clip is registered for each PID. The stream attribute information has different attribute information corresponding to each of the video stream, the audio stream, the presentation graphics stream, and the interactive graphics stream. The video stream attribute information includes information on what kind of compression codec the corresponding video stream has been compressed, the resolution of each picture data constituting the video stream, the aspect ratio, and the frame. It has information indicating how much the rate is. The audio stream attribute information indicates what compression codec the corresponding audio stream has been compressed, what the number of channels included in the audio stream is, what language it corresponds to, and what the sampling frequency is And the like. These pieces of information are used in the playback device for initialization of a decoder before playback.

  FIG. 11 is a diagram showing the internal structure of the entry map.

  As shown in FIG. 11, the entry map stores entry map header information 1101, a PTS indicating the display time of each I picture of the video stream included in the AV clip, and the SPN of the AV clip where each I picture starts. Table information. Here, the paired PTS and SPN information shown in one row of the table is called an entry point. A value that is incremented for each entry point with the head being 0 is referred to as an entry point ID (hereinafter, referred to as “EP_ID”). By using this entry map, the playback device can specify the file position of the AV clip corresponding to an arbitrary point on the time axis of the video stream. For example, at the time of special playback such as fast forward or rewind, an I picture registered in an entry map is specified, and processing is efficiently performed without analyzing an AV clip by reproducing from the specified I picture. Can be. An entry map is created for each video stream multiplexed in an AV clip, and is managed by PID. In the entry map, entry map header information 1101 is stored at the head. The entry map header information 1101 stores information such as the PID of the video stream indicated by the entry map and the number of entry points.

  Next, the playlist file (YYY.MPLS) will be described. FIG. 12 is a diagram showing the internal structure of a playlist.

  The playlist indicates the playback path of the AV clip 1204. As shown in FIG. 12, the play list is composed of one or more play items 1201, and each play item indicates a playback section for the AV clip 1204. Each play item 1201 is identified by a play item ID, and is described in an order to be reproduced in the play list. The playlist includes an entry mark 1202 indicating a reproduction start point. The entry mark 1202 is provided for a playback section defined by each play item. As shown in FIG. 12, the entry mark 1202 is provided at a position that can be a reproduction start point for a play item, and is used for cueing reproduction. For example, by adding an entry mark 1202 at the beginning of a chapter in a movie title, playback can be started from the beginning of the chapter. Here, a playback path of a series of play items is defined as a main path 1205. The AV clip information 1203 is information in which the decoding time / display time from the beginning of the AV clip 1204 and the logical address of the AV clip 1204 are associated with each other.

  The contents of the play item will be described. FIG. 13 is a diagram showing the internal structure of a play item.

  The play item includes clip information 1301 to be reproduced (referenced), a reproduction start time 1302, a reproduction end time 1303, a connection condition 1310, and a stream selection table 1305. Since the reproduction start time and the reproduction end time are time information, the reproduction device refers to the entry map of the clip information file and acquires the SPN corresponding to the specified reproduction start time and reproduction end time. The playback device performs a playback process by specifying the read start position from the acquired SPN.

  The connection condition 1310 indicates the type of connection with the forward play item.

  When the connection condition 1310 of the play item is “1”, it indicates that the AV clip indicated by the play item does not guarantee seamless connection with the AV clip indicated by the play item preceding the play item.

  When the connection condition 1310 of the play item is “5” or “6”, it is ensured that the AV clip indicated by the play item is seamlessly connected to the AV clip indicated by the play item preceding the play item. Is shown.

  When the connection condition 1310 is “5”, the continuity of the STC between play items may be broken. That is, in this case, the video display time at the end of the AV clip of the play item before connection and the video display time at the head of the AV clip of the play item after connection may be discontinuous. However, after the AV clip of the play item before connection is input to the PID filter of the system target decoder 1503 to be described later and subsequently, the AV clip of the play item after connection is input to the PID filter of the system target decoder 1503 and reproduced, It is necessary to create an AV clip so that the decoding of the system target decoder 1503 does not fail. There is also a constraint condition that the end frame of the audio of the AV clip of the play item before connection and the first frame of the audio of the play item after connection must overlap on the reproduction time axis.

  When the connection condition 1310 is “6”, when the AV clip of the play item before connection and the AV clip of the play item after connection are combined, it must be able to be reproduced as one AV clip. That is, the STC is continuous between the AV clip of the play item before connection and the AV clip of the play item after connection, and the ATC is also continuous.

  The stream selection table 1305 includes a plurality of stream entries 1309. Each of the plurality of stream entries 1309 includes a stream selection number 1306, stream path information 1307, and stream identification information 1308.

  The stream selection number 1306 is a number that is sequentially incremented from the head of the stream entry 1309 included in the stream selection table, and is a number used by the playback device to identify a stream.

  The stream path information 1307 is information indicating to which AV clip the stream indicated by the stream identification information 1308 is multiplexed. For example, if the stream path information 1307 is “main path”, it indicates the AV clip of the corresponding play item, and if “sub path ID = 1”, the playback section of the corresponding play item in the sub path indicated by the sub path ID Shows the AV clip of the sub play item corresponding to. Sub-paths are described in the next section.

  The stream identification information 1308 is information such as a PID and indicates a stream multiplexed on the referenced AV clip. In the stream entry 1309, attribute information of each stream is also recorded. Here, the attribute information of each stream is information indicating the property of the corresponding stream, and includes, for example, a language attribute in the case of audio, presentation graphics, or interactive graphics.

  Next, a playlist including a sub path will be described. FIG. 14 is a diagram showing an internal structure of a playlist including a sub path.

  A playlist can have one or more sub-paths as shown in FIG. The sub path is given an ID as a sub path ID in the order registered in the playlist. The sub path ID is used to identify a sub path. The sub path indicates a series of reproduction paths that are reproduced in synchronization with the main path. The sub play item has clip information 1301, a reproduction start time 1302, and a reproduction end time 1303 to be reproduced in the same manner as the play item. The reproduction start time 1302 and the reproduction end time 1303 of the sub play item are represented on the same time axis as the main path. For example, when a certain stream entry 1309 registered in the stream selection table 1305 of play item # 2 indicates the presentation graphics 1 with the sub path ID = 0, the play item # 2 in the sub path with the sub path ID = 0 The presentation graphics 1 multiplexed in the AV clip of the sub play item # 2 to be reproduced in synchronization with the reproduction section of # 1 is reproduced in the reproduction section of play item # 2. Also, the sub play item has a field called SP connection condition having the same meaning as the connection condition of the play item. The AV clip at the sub-playitem boundary where the SP connection condition is "5" or "6" needs to keep the same condition as the connection condition "5" or "6".

  The above is the data structure for storing the 2D video in the BD-ROM that is the recording medium according to the present disclosure.

  Subsequently, a playback device (2D playback device) that plays back a BD-ROM storing 2D video according to the present disclosure will be described.

  FIG. 15 is a diagram showing the internal configuration of the playback device. The 2D playback device 1500 includes a BD-ROM drive 1501, read buffer 1502, system target decoder 1503, program memory 1504, management information memory 1505, program execution unit 1506, playback control unit 1507, player variable 1508, user event processing unit 1509. And a plane adder 1510.

  The BD-ROM drive 1501 reads various data from a BD-ROM disc based on a request from the reproduction control unit 1507. The AV clip read from the BD-ROM disc is transferred to the read buffer 1502, the INDEX file, the playlist file, and the clip information file are transferred to the management information memory 1505, and the BD program file is transferred to the program memory 1504.

  The read buffer 1502 stores data read using a BD-ROM drive, the management information memory 1505 stores management information of an INDEX file, a playlist file, and a clip information file, and the program memory 1504 stores a BD program file. . Each of the read buffer 1502, the management information memory 1505, and the program memory 1504 is a buffer composed of a memory or the like.

  The system target decoder 1503 performs a demultiplexing process on the source packet read into the read buffer 1502, and performs a stream decoding process. The system target decoder 1503 acquires from the reproduction control unit 1507 information such as a codec type and a stream attribute necessary for decoding a stream included in the AV clip. The system target decoder 1503 converts the decoded main video stream, sub video video stream, interactive graphics stream, and presentation graphics stream into main video planes, sub video planes, and interactive graphics planes (IG planes), which are plane memories. And a presentation graphics plane (PG plane). Also, the system target decoder 1503 mixes the decoded main audio stream and sub audio stream, and outputs the mixed result to a speaker or the like. Further, the system target decoder 1503 decodes graphics data such as JPEG or PNG to be displayed on a menu or the like transferred from the program execution unit 1506 and writes the decoded graphics data to an image plane. Details of the system target decoder 1503 will be described later.

  The user event processing unit 1509 requests the program execution unit 1506 and the reproduction control unit 1507 to execute processing in response to a user operation through the remote controller. For example, when a button is pressed on the remote control, the program execution unit 1506 is requested to execute a command included in the button. For example, when the fast forward button or the rewind button is pressed on the remote controller, the reproduction control unit 1507 is instructed to execute the fast forward process or the rewind process on the AV clip of the currently reproduced playlist.

  The playback control unit 1507 controls the BD-ROM drive 1501 and the system target decoder 1503 to control the playback of AV clips. The reproduction control unit 1507 interprets play list information based on a reproduction instruction from the program execution unit 1506 and a notification from the user event processing unit 1509, and controls a reproduction process of an AV clip. Further, the reproduction control unit 1507 sets and refers to the player variable 1508 to perform a reproduction operation.

  The player variables 1508 include a system parameter (SPRM) indicating the state of the playback device and a general parameter (GPRM) that can be used for general use.

  FIG. 16 is a list of system parameters (SPRM).

SPRM (0): Language code SPRM (1): Main audio stream number SPRM (2): Subtitle stream number SPRM (3): Angle number SPRM (4): Title number SPRM (5): Chapter number SPRM (6): Program number SPRM (7): Cell number SPRM (8): Selection key information SPRM (9): Navigation timer SPRM (10): Playback time information SPRM (11): Mixing mode for karaoke SPRM (12): Parental country Information SPRM (13): Parental level SPRM (14): Player setting value (video)
SPRM (15): Player setting value (audio)
SPRM (16): Language code for audio stream SPRM (17): Language code for audio stream (extended)
SPRM (18): Language code for subtitle stream SPRM (19): Language code for subtitle stream (extended)
SPRM (20): Player region code SPRM (21): Sub-video stream number SPRM (22): Sub-audio stream number SPRM (23): Playback state SPRM (24): 3D video playback capability SPRM (25): HDR video / Graphics playback capability SPRM (26): HDR display capability SPRM (27): HDR output mode SPRM (28): HDR output preference SPRM (29): Reserved SPRM (30): Reserved SPRM (31): Reserved SPRM (32) ) : Reserve

  SPRM (10) is updated each time each picture data belonging to the AV clip is displayed. That is, when the playback device displays new picture data, SPRM (10) is updated to a value indicating the display time (PTS) of the new picture data. By referring to the SPRM (10), it is possible to know the current reproduction point.

  The language code for the audio stream of SPRM (16) and the language code for the subtitle stream of SPRM (18) are items that can be set in the OSD or the like of the playback device, and indicate the default language code of the playback device. For example, if the language code of the audio stream of SPRM (16) is English, a stream entry having the same language code is searched from the play item stream selection table and the audio stream is selected in reproducing the playlist. The function of playing back and playing can be included in the BD program file.

  The SPRM (25) includes information indicating whether or not the system target decoder 1503 can decode the HDR quality main video stream. It also includes information indicating whether graphics data such as JPEG and PNG transferred from the program execution unit 1506 can be converted to HDR image quality.

  The SPRM (26) includes information indicating whether a display device such as a television connected to the playback device can display HDR video.

  The SPRM (27) includes information indicating whether the playback device outputs display data output from the plane addition unit 1510 to the connected display device in HDR image quality or SDR image quality. .

  The SPRM (28) includes user preference information as to whether the playback device gives priority to outputting in HDR image quality or to give priority to outputting in SDR image quality.

  The reproduction control unit 1507 performs reproduction while checking the state of the system parameter. SPRM (1), SPRM (2), SPRM (21), and SPRM (22) indicate an audio stream number, a subtitle stream number, a sub-video stream, and a sub-audio stream number, respectively. Corresponding to the selected stream selection number 1306. For example, it is assumed that the audio stream number SPRM (1) has been changed by the program execution unit 1506. The reproduction control unit 1507 compares the stream selection table 1305 of the currently reproduced play item with the stream selection number 1306, refers to the matching stream entry 1309, and switches the audio stream to be reproduced. In this way, it is switched which audio stream, which subtitle stream, and which sub-video stream are to be reproduced.

  The program execution unit 1506 is a processor that executes a program stored in a BD program file. The program execution unit 1506 operates according to the stored program and performs the following control.

  (1) Instruct the reproduction control unit 1507 to reproduce the play list.

  (2) Transfer PNG and JPEG for menu and game graphics to the system target decoder and display them on the screen.

  These controls can be freely performed in accordance with the creation of a program, and how to control them depends on the BD program file programming process in the authoring process.

  The plane addition unit 1510 instantaneously superimposes the main video plane, the sub video plane, the interactive graphics plane, the presentation graphics plane, and the image plane, and displays them on a screen such as a TV.

  Next, the system target decoder 1503 will be described with reference to FIG. FIG. 17 is a diagram showing details of the internal configuration of the system target decoder.

  The CLOCK 1712 supplies, for example, a clock signal having a frequency of 27 (MHz) to the ATC counter 1711. The ATC counter 1711 generates an ATC value based on a clock signal supplied from the CLOCK 1712.

  The source depacketizer 1710 interprets a source packet transferred to the system target decoder 1503, extracts a TS packet, and sends out the TS packet to the PID filter. In this transmission, the source depacketizer 1710 adjusts the input time to the decoder according to the ATS of each source packet.

  Specifically, at the moment when the value of the ATC generated by the ATC counter 1711 becomes equal to the ATS value of the source packet, the source depacketizer 1710 converts only the TS packet into a PID according to the recording rate of the AV clip. Forward to filter.

  The PID filter 1714 converts the TS packet output from the source depacketizer 1710 whose PID matches the PID required for reproduction into a main video video decoder 1700, a sub video video decoder 1720, IG decoder 1740, PG decoder 1730, main audio decoder 1750, and sub audio decoder 1760. For example, in the case of a BD-ROM, the PID filter is provided to the main video video decoder 1700 when the PID included in the TS packet is 0x1011 and to the sub video video decoder 1720 when the PID is 0x1B00 to 0x1B1F. Is from 0x1100 to 0x111F, to the main audio decoder 1750, if the PID is from 0x1A00 to 0x1A1F, to the sub audio decoder 1760, if the PID is from 0x1200 to 0x121F, to the PG decoder 1730, and from 0x1400 to 0x141F. In this case, it is transferred to IG decoder 1740.

  The CLOCK 1716 supplies, for example, a clock signal having a frequency of 27 (MHz) to the STC 1715. The STC 1715 holds, based on the clock signal supplied from the CLOCK 1716, an STC (System Time Clock) that is a time axis of the time (PTS and DTS) related to the decoding of the corresponding decoder. When the PID of the TS packet matches the PID of the PCR, the STC 1715 is synchronized with the ATC time when the information of the STC time included in the PCR is supplied from the PID filter 1714. The above-mentioned corresponding decoder controls the decoding timing with reference to the STC time held by the STC 1715.

  The main video decoder 1700 includes a transport stream buffer (TB) 1701, a multiplexing buffer (MB) 1702, an elementary stream buffer (EB) 1703, a compressed video decoder 1704, and a DPB (Decoded Picture Viewer) 1704.

  The TB 1701 is a buffer that temporarily stores the TS packets when the TS packets including the video stream are output from the PID filter.

  The MB 1702 is a buffer for temporarily storing PES packets when outputting a video stream from the TB 1701 to the EB 1703. When data is transferred from the TB 1701 to the MB 1702, the TS header of the TS packet is removed.

  The EB 1703 is a buffer in which pictures (I picture, B picture, and P picture) in a coding state are stored. When data is transferred from the MB 1702 to the EB 1703, the PES header is removed.

  The compressed video decoder 1704 creates a frame / field image by decoding each video access unit of the video elementary stream according to a predetermined decoding time (DTS). Since the compression encoding format of the video stream multiplexed into the AV clip includes MPEG2, MPEG4 AVC, VC1, and the like, the decoding method of the compressed video decoder 1704 is switched according to the attribute of the stream. The compressed video decoder 1704 transfers the decoded frame / field image to the DPB 1705, and writes the corresponding frame / field image to the main video plane 1708 at the display time (PTS).

  The DPB 1705 is a buffer that temporarily stores the decoded frame / field image. The DPB 1705 is a buffer used by the compressed video decoder 1704 to refer to an already decoded picture when decoding a P picture, a B picture, or the like, which has been subjected to inter-picture prediction coding, for each video access unit.

  The sub-video decoder 1720 has the same configuration as the main video decoder 1700, decodes an input sub-video stream, and writes a picture to the sub-video plane 1725 at a display time (PTS).

  The PG decoder 1730 extracts and decodes the presentation graphics stream from the TS packet input from the source depacketizer 1710, and writes uncompressed graphics data to the PG plane 1735 at the timing of the display time (PTS).

  The IG decoder 1740 extracts and decodes an interactive graphics stream from a TS packet input from the source depacketizer 1710, and writes uncompressed graphics data to the IG plane 1745 at a display time (PTS).

  The main audio decoder 1750 has a buffer buffer, removes information such as a TS header and a PES header while storing data in the buffer, and performs audio stream decoding processing to obtain audio data in an uncompressed LPCM state. . The main audio decoder outputs the obtained audio data to the audio mixer 1765 at the timing of the reproduction time (PTS). Since the compression encoding format of the audio stream multiplexed to the AV clip includes AC3, DTS, and the like, the main audio decoder switches the decoding method of the compressed audio according to the attribute of the stream to perform the decoding process. .

  The sub audio decoder 1760 has a configuration similar to that of the main audio decoder 1750, performs decoding of an input sub audio stream, and outputs uncompressed LPCM audio data obtained by decoding at the display time. Output to the audio mixer 1765. Since the compression encoding format of the audio stream multiplexed into the AV clip includes Dolby Digital Plus and DTS-HD LBR, the sub audio decoder 1760 switches the decoding method of the compressed audio in accordance with the attribute of the stream. Perform decoding processing.

  The audio mixer 1765 mixes (superimposes) uncompressed audio data output from the main audio decoder and uncompressed audio data output from the sub audio decoder, and outputs the resulting data to a speaker or the like.

  The image processor 1770 decodes the graphics data (PNG / JPEG) transferred from the program execution unit 1506 and outputs it to the image plane 1775 according to the display time designated by the program execution unit 1506.

  The above is the configuration of the 2D playback device according to the present disclosure.

<Reproduction of data including HDR video>
Next, the high dynamic range of the video content will be described with reference to FIG. FIG. 18 is a diagram showing the relationship between the standard dynamic range and the high dynamic range of the luminance level.

  In conventional video data, one pixel in one picture is represented by 8-bit luminance information and 8-bit × 2 color information. In particular, the luminance information is information associated with a luminance level at which a display device such as an LED display or a plasma display can emit light. The correspondence shown in FIG. 9 shows a relationship in which brightness levels are associated with each other. The luminance information of each pixel of the decoded video signal is converted into a luminance level in the display device according to the luminance signal conversion relationship (EOTF) of FIG. Conventionally, in the EOTF, the upper limit of the luminance level is set to 100 [nit] based on the standard light emission performance of the conventional display device, and the luminance level is associated with the 8-bit bit code value signal in this luminance level range. ing. The video content represented by the EOTF shown in FIG. 18A is called a standard dynamic range (SDR) video.

  On the other hand, with the advance of the light emission performance of the display device, it is possible to emit light to a higher luminance level of 100 [nit] or more, and to display an image at a wider luminance level in a higher luminance region than in the past. Now you can do it. As a result, as shown in the EOTF shown in FIG. 18B, the luminance level and the 10-bit luminance can be increased in a wide range of luminance levels up to a higher luminance level (for example, 10000 [nit]) than FIG. 18A. An EOTF associated with a bit code value signal has been devised. The video content expressed using the EOTF of FIG. 18B is called a high dynamic range (HDR) video.

  The EOTF corresponding to the HDR video (hereinafter referred to as “HDR EOTF”) is not the only curve shown in FIG. 18B, but the upper limit of the luminance level and the length of the bit code value to be allocated. And the conversion method may be different. That is, there are various shapes of the HDR EOTF curve.

  For example, in an EOTF corresponding to an SDR video (hereinafter, referred to as “SDR EOTF”) shown in FIG. 18A, one pair of luminance levels L1 to 100 is determined by the bit code values X1 to Y1. It is associated with 1. On the other hand, in the HDR EOTF shown in FIG. 18B, it is assumed that the values of the bit code values X2 to Y2 are associated one-to-one with the values of the luminance levels L1 to L100. At this time, if the HDR EOTF from X2 to Y2 draws the same curve as the SDR EOTF, the HDR video content represented by the HDR EOTF shown in FIG. Even if input to a certain display device, it is displayed as an SDR video without being converted. In other words, the video content drawn by the HDR EOTF obtained by using the SDR EOTF to extend the high-brightness level information to the SDR EOTF is an SDR video that can be displayed in the HDR, and therefore, is not HDR compatible. SDR video.

<Flag indicating presence / absence of HDR video stream>
Here, a case is considered where the playback device reads out and plays back data including a video stream recorded on a recording medium (for example, a BD).

  One or more video streams are recorded on the recording medium. The one or more video streams include, for example, at least one of an HDR stream (HDR video stream) corresponding to HDR and an SDR stream (SDR video stream) corresponding to SDR. Further, the playlist file is recorded on the recording medium as described above.

  The playlist file includes, when reproducing an AV clip recorded on a recording medium (for example, a BD), identification information indicating what kind of video stream is included in the reproduced AV clip. Specifically, the identification information indicates whether or not one or more video streams recorded on the recording medium include an HDR stream. Further, the identification information may indicate whether or not the SDR stream is included in one or more video streams recorded on the recording medium. Also, the identification information may indicate whether or not one or more video streams recorded on the recording medium include an HDR video stream corresponding to an HDR1 video (see below), or may include an HDR2 video ( It may indicate whether an HDR video stream corresponding to HDR3 video (see below) is included or not. , May indicate whether an SDR video stream corresponding to an SDR1 video (see below) is included, or indicates whether an SDR video stream corresponding to an SDR2 video (see below) is included. You may. Note that the identification information only needs to be recorded on the recording medium, and need not be included in the playlist file.

  FIG. 19 is a diagram showing details of the data structure of the playlist file.

  As shown in FIG. 19, is_HDR1, is_HDR2, is_HDR3, is_SDR1, and is_SDR2 are identification information indicating presence / absence of a video stream as a main video in the playlist information in the playlist.

  is_HDR1 is identification information indicating whether or not an HDR video stream corresponding to the HDR video 1 using the essential HDR technology exists in the playlist.

  is_HDR2 is identification information indicating whether or not an HDR video stream corresponding to the HDR video 2 using the first option HDR technology (first HDR technology) exists in the playlist.

  is_HDR3 is identification information indicating whether there is an HDR video stream corresponding to HDR video 3 using a second option HDR technology (second HDR technology) different from the first option HDR technology.

  is_SDR1 is identification information indicating whether or not an HDR-compatible SDR video (SDR1 video) video stream exists.

  is_SDR2 is identification information indicating whether or not a video stream of an HDR-incompatible SDR video (SDR2 video) exists.

  A playlist can include one or more primary video streams. Therefore, information (video_combination_type) indicating a combination of the main video streams included in the playlist may be recorded separately from the identification information indicating presence / absence described above.

  The main video stream that may be present in the playlist may be limited to some patterns due to the nature of the technology used.

  As an example, the pattern may be limited to a pattern satisfying the following two restrictions.

  (1) An HDR video stream using the first or second optional HDR technology also requires an HDR video stream essential for reproducing the HDR video stream. For this reason, the HDR video stream does not exist alone, and there must be an HDR video stream of an essential HDR technology.

  (2) As the SDR video stream, only one of an HDR-compatible SDR video stream and an HDR-incompatible SDR video stream is sufficient. For this reason, the playlist cannot include both of these SDR video streams.

  In the case where the above-described restrictions exist, the combination patterns are limited to 14 as shown in FIG. FIG. 20 is a diagram showing a combination pattern of main videos in a playlist.

  The playback device determines a main video stream to be played from one or more main video streams included in the playlist according to the playback capability of the playback device itself and the display capability of a display device connected to the playback device. . The one or more main video streams are video streams of the same video content. The playback device acquires playback capability information indicating the playback capability of the playback device and display capability information indicating the display capability of the display device in order to determine the main video stream to be played, and stores them in the player variable 1508.

  SPRM (25) is playback capability information indicating the playback capability of the playback device. The SPRM (25) includes information indicating whether the playback device can decode the HDR video stream using the essential HDR technology, and whether the playback device can decode the HDR video stream using the first option HDR technology. And information indicating whether the playback device can decode the HDR video stream using the second optional HDR technology. The SPRM (25) also holds information indicating whether or not the playback device can perform HDR conversion so that graphics data drawn by the SDR technique can be superimposed and displayed on the HDR video stream.

  SPRM (26) is display capability information indicating the display capability of the display device. The SPRM (26) holds information indicating whether or not a display device connected to the playback device can display an HDR video stream using HDR technology as an HDR video. The SPRM (26) includes information indicating whether a display device connected to the playback device can display an HDR stream using an essential HDR technology, and an HDR using the first option HDR technology. Information indicating whether a video stream can be displayed and information indicating whether the display device can display an HDR video stream using the second optional HDR technology are held.

  FIGS. 21A to 21C are diagrams illustrating a data configuration example in a case where only one main video stream exists in the playlist.

  FIG. 21A is a diagram illustrating a data configuration example when only a main video stream of an HDR video exists.

  Since is_HDR1 indicates “1” in the playlist information, it can be determined that there is an essential HDR main video stream as the main video stream recorded on the recording medium. The fact that is_HDR1 is “1” indicates that the main video is registered in the stream selection table. The stream attribute information of the main video includes is_HDR indicating whether or not the main video is an HDR video. Since the is_HDR indicates “1”, it can be determined that the main video stream is an HDR video.

  FIG. 21B is a diagram illustrating a data configuration example in a case where only a main video stream that is an HDR compatible SDR exists in a playlist.

  Since is_SDR1 indicates “1” in the playlist information, it can be determined that an HDR-compatible SDR video exists as the main video stream recorded on the recording medium. Also, the fact that is_SDR1 is “1” indicates that the main video is registered in the stream selection table. The stream attribute information of the main video includes is_HDR indicating whether or not the main video is an HDR video. Since is_HDR indicates “0”, it can be determined that the main video stream is an SDR video.

  FIG. 21C is a diagram illustrating a data configuration example in a case where only a main video stream that is an SDR that is not HDR compatible exists in the playlist.

  Since is_SDR2 indicates “1” in the playlist information, it can be determined that an HDR-compatible SDR video exists as the main video stream recorded on the recording medium. Also, the fact that is_SDR2 is “1” indicates that the main video is registered in the stream selection table. The stream attribute information of the main video includes is_HDR indicating whether or not the main video is an HDR video. Since is_HDR indicates “0”, it can be determined that the main video stream is an SDR video.

  FIGS. 21D and 21E are diagrams illustrating an example of a data configuration when a playlist includes a plurality of HDR main video streams.

  FIG. 21D is a diagram illustrating an example of a data configuration when a playlist includes an essential HDR main video stream and a first optional HDR main video stream.

  Since is_HDR1 present in the playlist information indicates “1”, it can be determined that there is an essential HDR main video stream as the main video stream recorded on the recording medium. The fact that is_HDR1 is “1” indicates that the main video is registered in the stream selection table. The stream attribute information of the main video includes is_HDR indicating whether or not the main video is an HDR video. Since is_HDR indicates “1”, it can be determined that the main video stream is an HDR video.

  Also, since is_HDR2 present in the playlist information indicates “1”, it can be determined that the first optional HDR main video stream exists. Also, the fact that is_HDR2 is “1” indicates that extended metadata necessary for extending to HDR video is recorded for the main video registered in the stream selection table.

  The extended metadata includes Type information indicating a type, and the Type information indicates that the type is HDR video 2.

  FIG. 21E is a diagram illustrating an example of a data configuration when a playlist includes an essential HDR main video stream and a second optional HDR main video stream.

  Since is_HDR1 present in the playlist information indicates “1”, it can be determined that there is an essential HDR main video stream as the main video stream recorded on the recording medium. The fact that is_HDR1 is “1” indicates that the main video is registered in the stream selection table. The stream attribute information of the main video includes is_HDR indicating whether or not the main video is an HDR video. Since is_HDR indicates “1”, it can be determined that the main video stream is an HDR video.

  Also, since is_HDR3 present in the playlist information indicates “1”, it can be determined that the second optional HDR main video stream exists. Also, the fact that is_HDR3 is “1” indicates that an extension stream for extending to HDR video is recorded in the sub path for the main video registered in the stream selection table.

  The sub-path includes Type information indicating the type of the sub-path, and the Type information indicates that the type is an extended stream for HDR video 3.

  FIGS. 21F and 21G are diagrams illustrating an example of the data configuration in the case where the HDR main video stream and the SDR main video stream exist in the playlist.

  FIG. 21F is a diagram illustrating an example of a data configuration when a playlist includes an essential HDR main video stream and an HDR-compatible SDR main video stream.

  Since is_HDR1 present in the playlist information indicates “1”, it can be determined that there is an essential HDR main video stream as the main video stream recorded on the recording medium. The fact that is_HDR1 is “1” indicates that the main video is registered in the stream selection table. The stream attribute information of the main video includes is_HDR indicating whether or not the main video is an HDR video. Since is_HDR indicates “1”, it can be determined that the main video stream 1 is an HDR video.

  On the other hand, since is_SDR1 present in the playlist information indicates “1”, it can be determined that an HDR-compatible SDR video exists as the main video stream recorded on the recording medium. The HDR compatible SDR video is registered as the main video 2 video in the extension stream selection table. The stream attribute information of the main video 2 video includes is_HDR indicating whether the main video 2 video is an HDR video. Since is_HDR indicates “0”, it can be determined that the main video stream 2 is an SDR video.

  FIG. 21G is a diagram illustrating an example of a data configuration when a playlist includes an essential HDR main video stream and an HDR-incompatible SDR main video stream.

  Since is_HDR1 present in the playlist information indicates “1”, it can be determined that there is an essential HDR main video stream as the main video stream recorded on the recording medium. The fact that is_HDR1 is “1” indicates that the main video is registered in the stream selection table. The stream attribute information of the main video includes is_HDR indicating whether or not the main video is an HDR video. Since is_HDR indicates “1”, it can be determined that the main video stream 1 is an HDR video.

  On the other hand, since is_SDR2 present in the playlist information indicates “1”, it can be determined that an HDR-incompatible SDR video exists as the main video stream recorded on the recording medium. The HDR-incompatible SDR video is registered as the main video 2 video in the extension stream selection table. The stream attribute information of the main video 2 video includes is_HDR indicating whether the main video 2 video is an HDR video. Since is_HDR indicates “0”, it can be determined that the main video stream 2 is an SDR video.

<Selection method of main video stream-HDMV>
The reproduction control unit 1507 selects (determines) a main video stream to be reproduced according to the reproduction capability of the reproduction device and the display capability of the display device from among the main video streams included in the playlist read from the recording medium. I do.

  FIG. 22 is a flowchart showing a method of selecting (determining) a main video stream to be reproduced in the case of the AV reproduction mode. FIG. 22 is a flowchart in the case where graphics are constituted by HDMV.

  First, when reading the playlist from the recording medium, the playback control unit 1507 determines how many main video streams present in the playlist are registered (S101). Specifically, the playback control unit 1507 determines the number of main video streams in the playlist from the values of is_HDR1, is_HDR2, is_HDR3, is_SDR1, and is_SDR2 of the playlist information to determine whether each type of main video stream exists. Identify by.

  If the playback control unit 1507 determines that there is only one main video stream registered in the playlist ("one" in S101), the playback control unit 1507 determines that the only registered main video stream is a video stream to be played back. It is determined (is determined) whether or not is_HDR1 in the playlist is “1” (S102). That is, in step S102, it is determined whether or not only one SDR video stream is registered in the playlist.

  When it is determined that is_HDR1 is “1” (Yes in S102), the playback control unit 1507 selects the HDR1 video as the video stream to be played (S104). In this case, since it is possible to specify that there is one main video stream and that the main video stream is an HDR video stream, it is possible to determine that the main video stream is an HDR1 video, which is an essential HDR.

  When the playback control unit 1507 determines that is_HDR1 is “0” (No in S102), the playback control unit 1507 determines whether is_SDR1 is “1” (S103).

  When it is determined that is_SDR1 is “1” (Yes in S103), the playback control unit 1507 selects the SDR1 video as the video stream to be played (S105). In this case, since is_SDR1 is “1”, it can be determined that the main video is an HDR-compatible SDR video.

  When it is determined that is_SDR1 is “0” (No in S103), the playback control unit 1507 selects the SDR2 video as the video stream to be played (S106). In this case, since there is one main video stream, is_HDR1 is “0”, and is_SDR1 is “0”, it can be determined that the main video is an HDR-incompatible SDR video.

  In steps S105 and S106, the SDR video stream is selected because only the SDR video stream is registered in the playlist in step S102.

  If the playback control unit 1507 determines that there are two or more main video streams registered in the playlist ("two or more" in S101), the display device connected to the playback device can display HDR video. It is determined whether or not (S107). Specifically, the reproduction control unit 1507 determines whether or not the SPRM (26) held as the player variable 1508 is "1". Note that when the playback control unit 1507 determines that the SPRM (26) is “1”, it can determine that the display device can display the HDR video, and when it determines that the SPRM (26) is “0”, It can be determined that the display device cannot display the HDR video. After the end of the determination in step S107, the playback control unit 1507 checks the main video stream present in the playlist.

  Here, when there are a plurality of HDR videos and the display device can display the HDR videos, the playback device preferentially selects a high-definition HDR video from the HDR videos that can be played back and displayed. It is desirable to reproduce the selected HDR video. Here, it is assumed that the HDR video has high definition in the order of HDR video 3, HDR video 2, and HDR video 1. In the present embodiment, when it is determined that there are a plurality of HDR videos, it is determined whether HDR video 3 and HDR video 2 can be played back and displayed in this order, and it is determined that playback is possible and displayed first. The selected HDR video is selected, but the selection method is not limited to this. That is, in the selection of the main video stream to be reproduced, when there are two or more video streams that can be reproduced by the reproducing device and can be displayed by the display device, a predetermined priority is higher among the two or more video streams. What is necessary is just to select a video stream.

  If the playback control unit 1507 determines that the display device connected to the playback device can display the HDR video (Yes in S107), the HDR video 3 exists in the playlist, and the playback device It is determined whether or not there is an ability to reproduce (S108). Specifically, the playback control unit 1507 determines whether or not is_HDR3 is “1” and SPRM (25) indicates “HDR video 3 can be decoded”.

  If the playback control unit 1507 determines that the HDR video 3 exists in the playlist and the playback device has the ability to play back the HDR video 3 (Yes in S108), the playback control unit 1507 selects the HDR3 video as the video stream to be played back. (S112).

  If the playback control unit 1507 determines that the HDR video 3 does not exist in the playlist or that the playback device does not have the ability to play the HDR video 3 (No in S108), the HDR video 2 exists in the playlist. Then, it is determined whether or not the playback device has a capability of playing back the HDR video 2 (S109). Specifically, the reproduction control unit 1507 determines whether or not is_HDR2 is “1” and SPRM (25) indicates “HDR2 video can be decoded”.

  If the playback control unit 1507 determines that the HDR video 2 exists in the playlist and the playback device has the ability to play back the HDR video 2 (Yes in S109), the playback control unit 1507 selects the HDR2 video as the video stream to be played back. (S113).

  In step S112 and step S113, the determination is performed in the order of step S108 and step S109. Since the HDR video stream satisfying the determination is selected as the video stream to be reproduced, the reproduction capability of the reproduction device and the display device Among the HDR video streams that satisfy the display capability, an HDR video stream having a predetermined high priority is selected.

  If the playback control unit 1507 determines that the HDR video 2 does not exist in the playlist or that the playback device does not have the ability to play back the HDR video 2 (No in S109), the HDR video required as a video stream to be played back is provided. Is selected (S114).

  When the playback control unit 1507 determines in step S107 that the display device connected to the playback device cannot display the HDR video (No in S107), the playback control unit 1507 determines whether an SDR video stream exists in the playlist. Is determined (S110). Specifically, the reproduction control unit 1507 determines whether or not is_SDR1 is “1”.

  When it is determined that is_SDR1 is “1” (Yes in S110), the playback control unit 1507 selects the SDR1 video as the video stream to be played (S115). In this case, since is_SDR1 is “1” as described above, it can be determined that the main video is an HDR-compatible SDR video.

  When the playback control unit 1507 determines that is_SDR1 is “0” instead of “1” (No in S110), the playback control unit 1507 determines whether or not is_SDR2 is “1” (S111). In this case, since is_SDR2 is “1”, it can be determined that the main video is an HDR-compatible SDR video.

  When it is determined that is_SDR2 is “1” (Yes in S111), the playback control unit 1507 selects the SDR2 video as the video stream to be played (S116).

  When the playback control unit 1507 determines that is_SDR2 is not “1” but “0” (No in S111), the playback control unit 1507 determines that neither the SDR1 video nor the SDR2 video exists. That is, since there is no SDR video, in this case, the essential HDR1 video is selected as a video stream to be reproduced.

<Selection method of main video stream-BD-J>
FIG. 23 is a flowchart showing a method of selecting (determining) a main video stream to be reproduced in the case of the program reproduction mode.

  The program playback mode differs from the AV playback mode in FIG. 22 only in the determination in S107, and step S207 is performed instead of step S107. In step S207, specifically, the playback control unit 1507 performs the process when there are two or more main video streams in the playlist (“two or more” in S101), and determines whether the display device connected to the playback device is It is determined whether the HDR video can be displayed and the playback device has a conversion capability of converting graphics from SDR to HDR. If the determination in step S207 is Yes, the process proceeds to step S108, and if the determination in step S207 is No, the process proceeds to step S110. The other steps are the same as those in the flowchart in the case of the AV reproduction mode in FIG.

<Display method on display device>
The playback device decodes (reproduces) the main video stream selected by the selection method shown in FIG. 22 or FIG. 23, and supplies a playback signal indicating a video obtained by being decoded (reproduced) to the playback device. Output to the display device. Then, the display device displays the video of the main video stream output by the playback device.

  FIGS. 24 to 29 are flowcharts showing processing until the main video stream selected by the above-described selection method is output to the display device.

  FIG. 24 is a flowchart illustrating an example of an output method for outputting video including SDR2 video to a display device when SDR2 video is selected.

  As shown in FIG. 24, in FIG. 22 or FIG. 23, if the HDR-incompatible SDR2 video is selected by performing step S106 or step S116 (* 1), the playback device displays the SDR2 video during playback. It is determined whether there is a BD-J graphic to be made (S301). The BD-J graphics is, for example, graphics data (PNG / JPEG) stored in the image plane 1775 shown in FIG.

  The graphics data (PNG / JPEG) stored in the image plane 1775 is output from the image processor 1770, for example.

  The image processor 1770, for example, decodes graphics data (PNG / JPEG) transferred from the program execution unit 1506 that executes a Java (registered trademark) program corresponding to the BD program, and is specified by the program execution unit 1506. The decoded graphics data (PNG / JPEG) is output to the image plane 1775 according to the display time.

  Further, a Java (registered trademark) program corresponding to the BD program may include a program for generating graphics data. In this case, the generated graphics data may be transferred from the program execution unit 1506 that performs the BD program to the image processor 1770, and the image processor 1770 may output the transferred graphics data to the image plane 1775.

  When the playback device determines that there is BD-J graphics to be displayed during playback of the SDR2 video (Yes in S301), the playback device decodes the SDR2 video and the BD-J graphics (S302).

  The playback device combines (superimposes) the SDR2 video image and the BD-J graphics image obtained by decoding with SDR image quality (S303).

  On the other hand, when the playback device determines that there is no BD-J graphics to be displayed during playback of the SDR2 video (No in S301), the playback device decodes the SDR2 video (S304).

  The playback device outputs, to the display device, a playback signal indicating a video of SDR image quality obtained by combining or a playback signal indicating an image of SDR2 video obtained by decoding (S305).

  FIG. 25 is a flowchart illustrating an example of an output method for outputting a video including an SDR1 video to a display device when the SDR1 video is selected.

  As shown in FIG. 25, in FIG. 22 or FIG. 23, when the HDR compatible SDR1 video is selected by performing step S105 or step S115 (* 2), the playback device displays the SDR1 video during playback. It is determined whether there is a BD-J graphic to be processed (S401).

  When the playback device determines that there is BD-J graphics to be displayed during playback of the SDR1 video (Yes in S401), the playback device decodes the SDR1 video and the BD-J graphics (S402).

  The playback device combines (superimposes) the SDR1 video image and the BD-J graphics image obtained by decoding with SDR image quality (S403).

  The playback device outputs a playback signal indicating a video of SDR image quality obtained by the synthesis to the display device (S404). In step S404, the playback device outputs to the display device a playback signal indicating a video of SDR image quality obtained by decoding in step S408 described below.

  On the other hand, when the playback device determines that there is no BD-J graphics to be displayed during playback of the SDR1 video (No in S401), the playback device determines whether the display device can perform HDR display (S405). Specifically, in this case, the playback device determines whether SPRM (26) is “1”.

  When the playback device determines that the display device can perform HDR display (Yes in S405), the SDR1 video is HDR compatible, and thus decodes the SDR1 video with HDR image quality (S406).

  The playback device outputs a playback signal indicating the video of the SDR1 video obtained by decoding in step S406 to the display device (S407).

  On the other hand, when the playback device determines that the display device is not capable of HDR display (No in S405), the playback device decodes the SDR1 video with SDR image quality (S408).

  FIG. 26 is a flowchart illustrating an example of an output method for outputting video including HDR1 video to a display device when HDR1 video is selected.

  As shown in FIG. 26, in FIG. 22 or FIG. 23, when the HDR1 video is selected by performing step S104 (* 3), the playback device displays the BD-J graphics to be displayed when the HDR1 video is played back. It is determined whether or not there is (S501).

  If the playback device determines that there is BD-J graphics to be displayed during playback of the HDR1 video (Yes in S501), the playback device determines whether the playback device has a conversion capability of converting graphics from SDR to HDR. (S502). Specifically, the playback device determines whether or not the SPRM (25) indicates that “graphics can be converted to HDR”.

  When determining that the playback device has a conversion capability of converting graphics from SDR to HDR (Yes in S502), the playback device decodes the HDR1 video and the BD-J graphics (S503).

  The playback device converts the BD-J graphics video obtained by decoding into HDR image quality, and outputs the HDR1 video video obtained by decoding and the BD-J video obtained by converting the video into HDR quality. The image of the J graphics is combined (superimposed) with the HDR image quality (S504).

  If the playback device determines that there is no conversion capability for converting graphics from SDR to HDR (No in S502), the playback device cannot decode the graphics video to the HDR1 video, and thus decodes only the HDR1 video. (S505).

  When the playback device determines that there is no BD-J graphics to be displayed during playback of the HDR1 video (No in S501), the playback device decodes the HDR1 video (S506).

  After step S503, after step S504, or after step S506, the playback device determines whether or not the display device can perform HDR display (S507). Specifically, in this case, the playback device determines whether SPRM (26) is “1”.

  If the playback device determines that the display device can perform HDR display (Yes in S505), the playback device (i) decodes the video in HDR image quality obtained by combining in step S503, and (ii) decodes the video in step S504. The obtained HDR1 video image or (iii) a reproduction signal indicating the HDR1 video image obtained by decoding in step S506 is output to the display device (S508).

  If the playback device determines that the display device is not capable of HDR display (No in S505), the playback device performs (i) HDR image quality video obtained by combining in step S503, and (ii) decode in step S504. Of the HDR1 video obtained by performing the decoding, or (iii) the HDR1 video obtained by decoding in step S506 is converted into the video of SDR quality, and the video of SDR quality obtained by the conversion is converted. Is output to the display device (S509). Here, the video of SDR image quality obtained by the conversion is an HDR-incompatible SDR video. This is because the purpose of converting from HDR to SDR is to display an image on a display device that supports only SDR display. In short, a display device that supports only SDR display may not be able to display HDR-compatible SDR video.

  FIG. 27 is a flowchart illustrating another example of an output method for outputting video including HDR1 video to a display device when HDR1 video is selected. In the output method shown in FIG. 27, in the determination in step S207, it is determined that the display device can display the HDR video and the graphics can be converted from the SDR to the HDR. I use.

  As shown in FIG. 27, in FIG. 22 or FIG. 23, when the HDR1 video is selected by performing step S114 (* 4), the playback device displays the BD-J graphics to be displayed when the HDR1 video is played back. It is determined whether or not there is (S601).

  When the playback device determines that there is BD-J graphics to be displayed during playback of the HDR1 video (Yes in S601), the playback device has already determined Yes in the determination of step S207, and thus decodes the HDR1 video and the BD-J graphics. (S602).

  The playback device converts the BD-J graphics image obtained by decoding into HDR image quality, and outputs the HDR1 video image obtained by decoding and the BD-J image obtained by converting the image into HDR image quality. -Combine (superimpose) the image of the J graphics with the HDR image quality (S603).

  On the other hand, when the playback device determines that there is no BD-J graphics to be displayed during playback of the HDR1 video (No in S601), the playback device decodes the HDR1 video (S604).

  The playback device outputs, to the display device, a playback signal indicating a video of HDR image quality obtained by combining or a playback signal indicating an HDR1 video image obtained by decoding (S605).

  FIG. 28 is a flowchart illustrating an example of an output method for outputting video including HDR2 video to a display device when HDR2 video is selected. In the output method shown in FIG. 28, similarly to FIG. 27, in the determination of step S207, it is determined that the display device can display the HDR video and can convert the graphics from the SDR to the HDR. Therefore, this determination result is used. Steps S701 to S705 of the flowchart of FIG. 28 correspond to S601 to S605 of the flowchart of FIG. 27, respectively. If HDR2 video is used instead of HDR1 video, it is the same as the flowchart of FIG. Omitted.

  FIG. 29 is a flowchart illustrating an example of an output method for outputting video including HDR3 video to a display device when HDR3 video is selected. In the output method illustrated in FIG. 29, in the determination of step S207, similarly to FIGS. 27 and 28, it is determined that the display device can display the HDR video and that the graphics can be converted from SDR to HDR. Therefore, this determination result is used. Steps S801 to S805 in the flowchart in FIG. 29 correspond to S601 to S605 in the flowchart in FIG. 27, respectively. If HDR3 video is used instead of HDR1 video, it is the same as the flowchart in FIG. Omitted.

  As described above, in order to display the video content on a display device that cannot perform HDR display, if the playback device has the ability to convert the dynamic range of video luminance from HDR to SDR, the playback device must be able to display HDR video. To the SDR video, and the display device may display the converted SDR video. Alternatively, if the same SDR stream as the video content of the HDR stream is recorded on the recording medium, the playback device selects and plays back the SDR stream instead of the HDR stream so that the display device can play back the played SDR video. It may be displayed.

  In addition, the display device has an HDR video display capability, and when the playback device has a playback capability of two different types of HDR streams (a first HDR stream and a second HDR stream), the display device has If the first HDR stream and the second HDR stream are recorded, the playback device may play back the first HDR stream or play back the second HDR stream. Note that, in this case, when the display device can display a higher quality image by displaying using the video of the first HDR stream, the playback device can select and reproduce the first HDR stream. desirable.

  As described above, the playback device selects and plays a reproducible and displayable video stream according to the playback capability of the playback device and the display capability of the display device. If there are a plurality of video stream candidates that can be reproduced and displayed, the reproduction device selects the best video content for the viewer.

  As described above, in the reproducing method of the reproducing apparatus of the present embodiment, one or more video streams and identification information are read from the recording medium, and the reproduction capability information indicating whether the reproducing apparatus can reproduce the HDR stream, Display capability information indicating whether or not the display device connected to the playback device can display the video acquires display capability information, and one or more of the read identification information and the acquired reproduction capability information and display capability information A video stream to be reproduced is determined from the video streams, the determined video stream is reproduced, and a reproduction signal obtained by the reproduction is output to a display device.

  According to this, since the video stream to be reproduced is determined according to three pieces of information of the identification information, the reproduction capability information, and the display capability information, it is possible to output a video of an appropriate video stream to the display device.

  Further, in the determination, based on the read identification information and the acquired reproduction capability information and display capability information, a video stream that can be reproduced by the reproduction device and displayed on the display device is selected from one or more video streams. decide. For this reason, the video of the appropriate video stream can be output to the display device.

  In the determination, when there are two or more video streams that can be reproduced by the reproduction device and displayed on the display device, a video stream having a predetermined higher priority is determined from the two or more video streams. For this reason, a video of a more appropriate video stream can be output to the display device.

  According to this, when the HDR stream can be reproduced and displayed, the video of the HDR stream is output to the display device. For this reason, a higher quality image can be output to the display device.

  According to this, when the HDR3 video as the second HDR stream having a higher priority can be reproduced and displayed, the HDR3 video can be output to the display device. As a result, an appropriate image with higher image quality can be output to the display device.

  Further, the present invention may be realized as a reproducing apparatus that performs the reproducing method.

  That is, the playback device includes a reading unit, an acquisition unit, a determination unit, a playback unit, and an output unit. The reading unit reads one or more video streams and identification information from the recording medium. The acquisition unit acquires playback capability information indicating whether the playback device can play back the HDR stream and display capability information indicating whether a display device connected to the playback device can display HDR video. . The determining unit determines a video stream to be reproduced from one or more video streams according to the read identification information and the acquired reproduction capability information and display capability information. The reproduction unit reproduces the determined video stream. The output unit outputs a reproduction signal obtained by the reproduction to a display device.

  In each of the above embodiments, each component may be configured by dedicated hardware, or may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

  As described above, the recording medium, the reproducing device, and the reproducing method according to one or more aspects of the present disclosure have been described based on the embodiments, but the present disclosure is not limited to the embodiments. Unless departing from the gist of the present disclosure, various modifications conceivable to those skilled in the art may be applied to the present embodiment, and a form constructed by combining components in different embodiments may be one or more of the present disclosure. It may be included within the scope of the embodiment.

  Note that the above description is merely an example, and various applications can be applied to a person skilled in the art.

  The present disclosure relates to a reproduction technique of a high dynamic range video, and as described above, is useful as a reproduction method, a reproduction apparatus, a program, and the like that can determine and output an appropriate video stream from a video stream recorded on a recording medium. is there.

101 Disc 102 Playback device 103 Display device 104 Remote control 121 BD-ROM drive 122 Cable 131 Screen 202 Track 501 Video stream 502, 505, 508, 511 PES packet sequence 503, 506, 509, 512 TS packet 504 Audio stream 507 Presentation graphics Stream 510 interactive graphics stream 513 AV clip 1101 entry map header information 1201 play item 1202 entry mark 1203 AV clip information 1204 AV clip 1205 main path 1301 clip information 1302 playback start time 1303 playback end time 1305 stream selection table 1306 stream selection number 1307 story Path information 1308 stream identification information 1309 stream entry 1310 connection condition 1500 playback device 1501 BD-ROM drive 1502 read buffer 1503 system target decoder 1504 program memory 1505 management information memory 1506 program execution unit 1507 playback control unit 1508 player variable 1509 user event processing unit 1510 Plane adder 1701 TB
1702 MB
1703 EB
1704 Compressed video decoder 1705 DPB

Claims (4)

A playback method by a playback device that plays back a video stream recorded on a recording medium,
In the recording medium,
Video including at least one of an HDR stream whose dynamic range of video luminance corresponds to a high dynamic range (HDR) and an SDR stream corresponding to a standard dynamic range (SDR) whose dynamic range of video luminance is narrower than HDR Streams and
And identification information indicating whether or not the HDR stream is included in the video stream,
The reproduction method includes:
Reading the identification information from the recording medium,
The playback device acquires playback capability information indicating whether or not the HDR stream can be played back, and display capability information indicating whether a display device connected to the playback device can display HDR video,
According to the read identification information and the obtained reproduction capability information and the display capability information, determine a video stream to be reproduced from the video streams,
Playing the determined video stream,
A playback method for outputting a playback signal obtained by the playback to the display device,
The identification information indicates whether or not the video stream includes a first HDR stream, and whether or not the video stream includes a second HDR stream;
The determination is a case where the identification information indicates that the video stream includes the first HDR stream and the second HDR stream,
When the reproduction capability information indicates that the first HDR stream can be reproduced, and when the display capability information indicates that the video of the first HDR stream can be displayed, the reproduction capability information indicates that the second HDR stream can be displayed. When the HDR stream of the second HDR stream cannot be reproduced, or when the display capability information indicates that the video of the second HDR stream cannot be displayed, the identification information indicates that the stream is the first HDR stream. A video stream to be reproduced is determined as the video stream to be reproduced. The reproduction method according to claim 1, wherein the second HDR stream is a video stream having a predetermined higher priority than the first HDR stream.   A program for causing a computer to execute the reproduction method according to claim 1. A playback device that plays back a video stream recorded on a recording medium,
In the recording medium,
Video including at least one of an HDR stream whose video dynamic range corresponds to a high dynamic range (HDR) and an SDR stream corresponding to a standard dynamic range (SDR) whose video dynamic range is narrower than HDR Streams and
And identification information indicating whether or not the HDR stream is included in the video stream,
The playback device,
A reading unit that reads the identification information from the recording medium;
Acquisition for acquiring playback capability information indicating whether the playback device can play back the HDR stream and display capability information indicating whether a display device connected to the playback device can display HDR video. Department and
A determining unit that determines a video stream to be reproduced from the video streams according to the read identification information and the acquired reproduction capability information and the display capability information;
A playback unit that plays back the determined video stream;
An output unit that outputs a reproduction signal obtained by the reproduction to the display device,
The identification information indicates whether or not the video stream includes a first HDR stream, and whether or not the video stream includes a second HDR stream;
The determination is a case where the identification information indicates that the video stream includes the first HDR stream and the second HDR stream,
When the reproduction capability information indicates that the first HDR stream can be reproduced, and when the display capability information indicates that the video of the first HDR stream can be displayed, the reproduction capability information indicates that the second HDR stream can be displayed. When the HDR stream of the second HDR stream cannot be reproduced, or when the display capability information indicates that the video of the second HDR stream cannot be displayed, the identification information indicates that the stream is the first HDR stream. A video stream to be reproduced is determined as the video stream to be reproduced.

Images