Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N9/00—Details of colour television systems
  • H04N9/79—Processing of colour television signals in connection with recording
  • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
  • H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
  • H04N9/8042—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N5/00—Details of television systems
  • H04N5/76—Television signal recording
  • H04N5/91—Television signal processing therefor
  • H04N5/92—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
• • G—PHYSICS
  • G11—INFORMATION STORAGE
  • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
  • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
  • G11B20/10—Digital recording or reproducing
• • G—PHYSICS
  • G11—INFORMATION STORAGE
  • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
  • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
• • G—PHYSICS
  • G11—INFORMATION STORAGE
  • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
  • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
  • G11B27/005—Reproducing at a different information rate from the information rate of recording
• • G—PHYSICS
  • G11—INFORMATION STORAGE
  • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
  • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
  • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
• • G—PHYSICS
  • G11—INFORMATION STORAGE
  • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
  • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
  • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
  • G11B27/102—Programmed access in sequence to addressed parts of tracks of operating record carriers
  • G11B27/105—Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
• • G—PHYSICS
  • G11—INFORMATION STORAGE
  • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
  • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
  • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
  • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
  • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
  • G11B27/32—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier
  • G11B27/327—Table of contents
  • G11B27/329—Table of contents on a disc [VTOC]
• • G—PHYSICS
  • G11—INFORMATION STORAGE
  • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
  • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
  • G11B20/00086—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy
• • G—PHYSICS
  • G11—INFORMATION STORAGE
  • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
  • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
  • G11B20/10—Digital recording or reproducing
  • G11B20/10527—Audio or video recording; Data buffering arrangements
  • G11B2020/1062—Data buffering arrangements, e.g. recording or playback buffers
  • G11B2020/10675—Data buffering arrangements, e.g. recording or playback buffers aspects of buffer control
• • G—PHYSICS
  • G11—INFORMATION STORAGE
  • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
  • G11B2220/00—Record carriers by type
  • G11B2220/20—Disc-shaped record carriers
  • G11B2220/25—Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
  • G11B2220/2537—Optical discs
  • G11B2220/2541—Blu-ray discs; Blue laser DVR discs
• • G—PHYSICS
  • G11—INFORMATION STORAGE
  • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
  • G11B2220/00—Record carriers by type
  • G11B2220/20—Disc-shaped record carriers
  • G11B2220/25—Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
  • G11B2220/2537—Optical discs
  • G11B2220/2562—DVDs [digital versatile discs]; Digital video discs; MMCDs; HDCDs
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N5/00—Details of television systems
  • H04N5/76—Television signal recording
  • H04N5/765—Interface circuits between an apparatus for recording and another apparatus
  • H04N5/775—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television receiver
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N5/00—Details of television systems
  • H04N5/76—Television signal recording
  • H04N5/78—Television signal recording using magnetic recording
  • H04N5/782—Television signal recording using magnetic recording on tape
  • H04N5/783—Adaptations for reproducing at a rate different from the recording rate
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N5/00—Details of television systems
  • H04N5/76—Television signal recording
  • H04N5/84—Television signal recording using optical recording
  • H04N5/85—Television signal recording using optical recording on discs or drums
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N9/00—Details of colour television systems
  • H04N9/79—Processing of colour television signals in connection with recording
  • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
  • H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
  • H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N9/00—Details of colour television systems
  • H04N9/79—Processing of colour television signals in connection with recording
  • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
  • H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
  • H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
  • H04N9/8233—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal the additional signal being a character code signal
  • H04N9/8244—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal the additional signal being a character code signal involving the use of subcodes

Definitions

• Data recording apparatus and data recording method data processing apparatus and data processing method, program and program recording medium, data recording medium, and data structure
• the present invention relates to a data recording device and a data recording method, a data processing device and a data processing method, a program and a program recording medium, a data recording medium and a data structure, and in particular, for example, highly convenient data.
• the present invention relates to a data recording device and a data recording method, a data processing device, a data processing method, a program, a program recording medium, a data recording medium, and a data structure.
• images Digital Versatile Disc
• DVD devices that perform various types of processing using DVDs have also become widespread.
• a DVD device for example, a DVD recorder that records and reproduces data of a television broadcast program, etc. on a DVD, and a powerful navigation system that records map information on a DVD and displays the map information
• game devices that record game programs on DVDs and execute the programs.
• Non-Patent Document 1 DVD Specification for Read-Only Disc Part 3; Version 1.1 December 1997”.
• the present invention has been made in view of such a situation, and enables data processing with high convenience and the like to be performed.
• the data recording apparatus of the present invention is configured to select information of an intra picture that is a random access point included in video data and detect position information of a plurality of pictures following the selected intra picture.
• a detection unit configured to specify a picture having position information that is separated from the intra picture by a predetermined distance among the position information of the plurality of pictures detected by the detection unit, and a detection unit
• a recording unit configured to record the position information of the plurality of pictures detected by the above and the information of the picture designated by the designation unit together with the video data on a recording medium.
• An extraction unit for extracting the position information of a picture corresponding to a predetermined number of sectors from among the position information of a plurality of pictures detected by the detection unit can be further provided.
• the position information of the plurality of pictures detected by the detection unit based on the position information of the picture corresponding to the predetermined number of sectors out of the position information of the plurality of pictures extracted by the section from the intra picture
• the picture of the position information of the picture separated by a predetermined distance can be designated, and the recording unit further includes a predetermined sector among the position information of the plurality of pictures extracted by the extraction unit.
• Information on picture positions corresponding to the numbers can be recorded on a data recording medium.
• the predetermined number of sectors is set according to a capacity for buffering the video data recorded by the device that reproduces the video data recorded on the data recording medium. Can be determined.
• the data recording method of the present invention includes a detection step of selecting information of an intra picture serving as a random access point included in video data and detecting position information of a plurality of pictures following the selected intra picture; Among the position information of a plurality of pictures detected by the detection step process, a designation step for designating a picture of the picture position information that is a predetermined distance away from the inner picture, and a plurality of positions detected by the detection step process; A recording step of recording the position information of the picture and the information of the picture designated in the processing of the designation step on the data recording medium together with the video data.
• a first program includes a detection step of selecting information of an intra picture that is a random access point included in a video data and detecting position information of a plurality of pictures following the selected intra picture.
• a detection step of selecting information of an intra picture that is a random access point included in a video data and detecting position information of a plurality of pictures following the selected intra picture.
• a specification step for specifying a picture with picture position information separated from the intra picture by a predetermined distance, and a plurality of pieces detected in the detection step processing And a recording step of recording the picture information specified in the processing of the designated step on the data recording medium together with the video data.
• the program of the first program recording medium of the present invention selects information of an intra picture that is a random access point included in video data and detects position information of a plurality of pictures following the selected intra picture And a specifying step for specifying a picture having picture position information separated from the intra picture by a predetermined distance from the position information of the plurality of pictures detected in the detection step process, And a recording step of recording the position information of the plurality of pictures detected in the processing of the output step and the information of the picture specified in the processing of the specifying step on a data recording medium together with the video data.
• the data processing apparatus of the present invention includes a plurality of intra pictures that are random access points included in the video data, position information of a plurality of pictures that respectively follow a plurality of intra pictures, and a plurality of pictures that respectively follow a plurality of intra pictures.
• a reading unit configured to read from the recording medium together with the video data, the designation information designating a picture that is a predetermined distance away from the intra-frame, respectively, and read by the reading unit Designation that designates a picture that is a predetermined distance away from the intra picture among a plurality of pictures that are random access points recorded on the data recording medium and a picture that follows the intra picture.
• intra pictures and intra pictures A selection unit configured to select a plurality of pictures following the channel, and all of the plurality of pictures following the intra-frame selected by the selection unit up to a picture that is a predetermined distance away from the intra picture and the intra structure. And a playback unit configured to fast-forward playback of the video data by using the picture.
• a picture that is separated from the intra picture by a predetermined distance may be a picture that is separated from the intra picture to a distance in the vicinity of the predetermined number of sectors.
• the predetermined number of sectors can be set according to the capacity buffered when the video data recorded on the recording medium is reproduced.
• the data processing method of the present invention is a random processing included in video data.
• the multiple intra pictures that serve as access points the positional information of the multiple pictures that respectively follow the multiple intra pictures, and the multiple pictures that respectively follow the multiple intra pictures, a picture that is separated from the intra picture by a predetermined distance.
• the second program of the present invention includes a plurality of intra pictures that are random access points included in the video data, position information of a plurality of pictures that respectively follow a plurality of intra pictures, and a plurality of pictures that respectively follow a plurality of intra pictures.
• a designation step for designating a picture that is a predetermined distance away from the intra-picture is read from the data recording medium together with the video data, and is recorded on the data recording medium read by the processing of the readout step. Based on the designation information that designates a picture that is a predetermined distance away from the intra picture among a plurality of intra pictures that are random access points for the video overnight and a plurality of pictures that follow the intra picture.
• Intra pictures and intrapics A plurality of pictures following the turbocharger
• the selection step to be selected and the video data from all the pictures following the picture selected in the selection step up to a predetermined distance from the intra picture and the intra picture. It is characterized by having a computer execute a process including a playback step for fast-forward playback.
• the program of the second program recording medium of the present invention includes a plurality of intra pictures serving as random access points included in the video data, position information of a plurality of pictures respectively following a plurality of intra pictures, and a plurality of pictures.
• the data recording medium of the present invention includes a plurality of picture position information following an intra picture selected from intra-picture information serving as a random access point included in video data, and a plurality of picture position information.
• the data including the information specifying the picture that is a predetermined distance away from the intra picture is recorded. It is recorded.
• the data structure of the present invention includes a plurality of picture position information among a plurality of picture position information following the intra-picture selected from intra-picture information serving as a random access point included in the video data, and a plurality of picture position information.
• the position information the information specifying a picture that is a predetermined distance away from the intra picture is included.
• information on an intra picture serving as a random access point included in video data is selected, and a plurality of pictures following the selected intra picture are selected.
• the position information of the picture is detected, and among the detected position information of the plurality of pictures, the picture of the position information of the picture that is a predetermined distance away from the intra picture is specified, and the position information of the detected plurality of pictures
• the information of the designated picture is recorded on the data recording medium together with the video data.
• position information of a plurality of intra pictures serving as random access points included in the video data and a plurality of pictures following each of the plurality of intrastructures is read from the recording medium together with the video data, and read out. Designation that specifies multiple pictures that are random access points for video data recorded on the recorded data recording medium and pictures that are a predetermined distance away from the intra picture among the pictures that follow the intra picture.
• intra pictures and images A plurality of pin following the tiger picture A picture is selected, and video data is fast-forwarded and reproduced by all pictures up to a picture that is a predetermined distance away from an intra picture and an intra picture among a plurality of pictures following the selected intra picture.
• the data recording device and data processing device of the present invention may be independent devices or blocks that perform data processing.
• FIG. 1 is a block diagram showing a hardware configuration example of an embodiment of a disc playback apparatus to which the present invention is applied.
• FIGS. 2A and 2B show software executed by CPU 12.
• Fig. 3 is a block diagram showing an example of the module group configuration.
• Fig. 3 is a diagram showing the relationship between the actual time lapse and the clocking of the 90 kHz clock.
• Fig. 4 is the actual time lapse and the video decoder
• FIG. 5 is a block diagram showing a configuration example of the buffer control module 2 15, and
• FIG. 6 is a directory on the disk 1 0 1.
• Fig. 7 shows an example configuration
• Fig. 7 shows the syntax of the "PLAYL I ST. DAT" file
• Fig. 8 shows P 1 Fig.
• FIG. 9 shows the syntax of ayltemO
• Fig. 9 shows the syntax of PlayListMarkO
• Fig. 10 shows the value of mark_type, and the relationship between MarkO type and 4
• Fig. 11 shows PlayListO , PlayltemO, clip, and the relationship between the program streams stored in the clip stream file
• Fig. 12 shows the clip information file ClipO syntax
• Fig. 13 shows the elementary stream Identifying stre
• FIG. 16 shows the EPjnapO syntax
• Fig. 17 shows the relationship between the index_N_minusl value of Fig. 16 and the IstRe and Picture 4th Re-pictures
• Fig. 18 A
• Figure B shows the syntax of the MPEG-2 System program stream, program stream pack, and program stream pack header.
• Figures 19A and 19B show the MPEG-2 Syst Fig. 20 shows the syntax of em PES packet, Fig. 20 A, Fig. 20 B and Fig.
• FIG. 20 C show the syntax of MPEG-2 System PES packet
• Figure 1 B shows the syntax of the MPEG-2 System PES packet
• Fig. 22 and Fig. 22B are diagrams showing the relationship between the value described in the s tream-id of PES_packet 0 in MPEG-2 System and the attributes of the elementary stream
• Fig. 23 is adopted by the disc playback device
• Fig. 24 shows the syntax of rivate_streaml_PES_payloadO.
• Fig. 25 shows the value of private_stream_id and the attributes of the elementary stream stored in private_payload ().
• Fig. 26 shows the syntax of private_stream2_PES_payload (), Fig.
• FIG. 27 shows the syntax of au_information ()
• Fig. 28 shows the pic_struct
• Fig. 2 9 is the "PLA Fig. 30 shows a specific example of "YLIST.DAT” file.
• Fig. 30 A and Fig. 30 B show specific examples of clip information files "00001. CLP", "00002. CLP", "00003. CLP”.
• Fig. 3 Fig. 1 shows a specific example of EPjnapO in clip information file "00001. CLP”.
• Fig. 3 2 shows a specific example of PyListMarkO in PlayList # 0 and PlayListt # 1
• FIG. 33 is a flowchart for explaining the pre-reproduction process
• FIG. 34 is a flowchart for explaining the reproduction process
• FIG. 33 is a flowchart for explaining the pre-reproduction process
• FIG. 34 is a flowchart for explaining the reproduction process
• FIG. 33 is a flowchart for explaining the pre-reproduction process
• FIG. 34 is a flowchart
• FIG. 35 is a flowchart for explaining the relationship between the decoding order and the output order.
• FIG. 36 is a diagram for explaining the configuration of the video decoder
• FIG. 37 is a diagram for explaining the configuration of the DPB in FIG. 36
• FIG. 38 is a flowchart for explaining the time update process
• FIG. 3 Fig. 9 is a diagram explaining the time update process according to the value of pic-struct.
• Fig. 40 is a flowchart explaining the Playltem transfer process. 41
• FIG. 41 is a flowchart for explaining time code display processing
• FIG. 42 is a flowchart for explaining stream switching processing
• FIG. 43 is a flowchart for explaining processing of the buffer control module 2 15, FIG. The figure shows a flowchart explaining the processing of the buffer control module 2 15, FIG.
• FIG. 45 shows the flowchart explaining the video stream reading process
• FIG. 46 shows the audio stream reading process
• FIG. 47 is a flowchart for explaining subtitle stream reading processing
• FIG. 48 is a flowchart for explaining resynchronization processing
• FIG. 49 is a flowchart for explaining mark processing
• FIG. Fig. 0 is a diagram for explaining match determination in mark processing.
• Fig. 51 shows playListEnd timing.
• Fig. 52 shows the playListEnd timing.
• Fig. 53 shows the event interval.
• Fig. 54 shows the output attribute control process.
• Figure 5 shows the pts—change point and Dynamic In described in the clip information file “00003. CLP”.
• Fig. 56 shows a specific example of a set with foO.
• Fig. 56 shows a specific example of a set with foO.
• Fig. 56 is a flowchart explaining subtitle display control processing.
• Fig. 57 is a flowchart explaining capture control processing and background Z screen saver processing.
• Fig. 58 is Fig. 59 shows another syntax of private_stream2_PES_payload (), Fig. 59 shows another syntax of au_information (),
• Fig. 60 is a block diagram showing an example of the hardware configuration of a disk recording device, and
• Fig. 61 shows Fig. 60 is a block diagram for explaining the functions realized by the disc recording device of Fig. 60,
• Fig. 62 is a flowchart for explaining the Ep_map generation processing,
• Fig. 63 is a flowchart for explaining fast-forward playback processing, and Fig. 64.
• FIG. 6 is a flowchart for explaining entry point selection processing.
• Fig. 65 shows other functions implemented by the disc recording device of Fig. 60.
• Block diagram the 66 figure shows other syntax of EPjnapO
• 6 7 Figure is a diagram for explaining the priority_flag sixth 5 Figure
• 68 figure is a flowchart illustrating the priority setting process.
• the data recording apparatus of the present invention selects information of an intra picture that becomes a random access point included in video data, and detects position information of a plurality of pictures following the selected intra picture. And a position of a picture that is separated from the intraframe by a predetermined distance among position information of a plurality of pictures detected by the detector (for example, the multiplexer 4 2 1 in FIG. 61).
• a designation unit configured to designate a picture of information (for example, the controller 4 2 5 in FIG. 61), position information of a plurality of pictures detected by the detection unit, and a picture designated by the designation unit
• a recording section for example, a disk drive 4 0 9 in FIG. 60 configured to record the information on the recording medium together with the video data. It is a sign.
• a detection step selecting information of an intra picture that becomes a random access point included in video data and detecting position information of a plurality of pictures following the selected intra picture
• the picture position information picture that is a predetermined distance away from the intra picture is shown in FIG.
• Designation step for designating for example, the flow chart in Fig.
• Step S 3 8 6 of g And over processing of Step S 3 8 6 of g), the position information of the plurality of pictures detected by the processing of the detection step, and a data recording medium together with the information specified of 3 picture Bideode Isseki in the process of specifying step Recording step (for example, the processing of step S 3 86 in the flowchart of FIG. 62).
• the data processing apparatus includes a plurality of intra pictures that are random access points included in the video data, position information of a plurality of pictures that respectively follow a plurality of intra pictures, and a plurality of pictures that respectively follow a plurality of intra pictures.
• a reading unit (for example, the disk drive 1 0 2 in FIG. 1) is configured to read designation information for designating a picture that is a predetermined distance away from the intraframe from a data recording medium together with video data. ) And a plurality of intra pictures that serve as random access points of video data recorded on the data recording medium read by the reading unit, and a plurality of pictures following the intra picture, at a predetermined distance from the intra picture.
• a selection unit (for example, a player control module 2 1 2 in FIG. 2A and FIG. 2B) that selects a plurality of pictures following the intra picture and the intra picture based on the designated information, and a selection unit Among the multiple pictures following the intra picture selected by, a playback unit configured to fast-forward and play back the video with all the pictures from the intra picture to a picture that is a predetermined distance away from the intra picture (for example, 2) and the decoder control module 2 1 4) of FIG. 2A and FIG. 2B.
• a data processing method includes a plurality of intra pictures that are random access points included in video data, and a plurality of intra pictures. Record the position information of the pictures following each checker and the designation information that specifies the pictures separated from the traffic by a predetermined distance from the pictures following each of the intra pictures, along with the video data.
• a reading step read from the medium (for example, the process of step S 39 1 in the flowchart of FIG. 62), and a random access point for video data recorded on the data recording medium read in the reading step process.
• FIG. 1 is a block diagram showing a hardware configuration example of an embodiment of a disk reproducing apparatus to which the present invention is applied.
• the disc player shown in FIG. 1 can be applied to, for example, a disc player, a game device, a force-navigation system, and the like.
• the disc 10 1 is, for example, an optical disc such as a DVD, a magneto-optical disc, or a magnetic disc.
• the evening there is a record of the evening required to play back the content data.
• the data recorded on the disc 10 1 includes a program that can execute the computer program if necessary.
• the disk 10 1 which is a disk-shaped recording medium is adopted as the recording medium:
• Other examples of the recording medium include a semiconductor memory and a tape-shaped recording medium. Also good.
• the disc playback device receives and distributes data from a server or the like that stores data similar to the data recorded on the disc 1 0 1 via a network such as the Internet. It is also possible. In addition, the disc playback device can receive the data from the server and other devices, record it on the disc 1 0 1, and then process the data recorded on the disc 1 0 1. It is.
• a disk 1 0 1 is detachable from the disk drive 1 0 2.
• the disk drive 1 0 2 has a built-in interface (not shown), and is connected to the drive-in evening face 1 1 4 through the inside evening face.
• the disk drive 1 0 2 drives the disk 1 0 1 mounted on it and reads from the drive interface 1 1 4 In accordance with a read-out command, data is read from the disk 1 0 1 and supplied to the drive interface 1 14.
• 3 Bus 1 1 1 has CPlKCentral Processing Unit) 1 1 2, Memory 1 1 3, Drive interface 1 14, Input interface 1 1 5, Video decoder 1 1 6, Audio decoder 1 1 7, Video output interface 1 1 8 Audio output interface 1 1 9 is connected.
• CPU 1 1 2 and memory 1 1 3 form a computer system. That is, the CPU 11 2 executes a software module group described later, which is a program stored in the memory 1 13, controls the entire disk reproducing apparatus, and performs various processes described later.
• the memory 1 1 3 stores software module groups executed by the CPU 1 1 2. Memory 1 1 3 temporarily stores data necessary for operation of CPU 1 1 2.
• the memory 1 13 can be configured by only a nonvolatile memory or a combination of a volatile memory and a nonvolatile memory.
• the memory 1 1 3 It can be configured with only volatile memory.
• the program (software module group) executed by the CPU 1 1 2 can be stored in advance in the memory 1 1 3 as a recording medium built in the disk playback device.
• the program can be a disc 1 0 1, a flexible disc other than the disc 1 0 1, a CD-ROM (Compact Disc Read 0 nly Memory), an M0 (Magneto Optical) disc, a magnetic disc, a memory card, etc.
• a removable recording medium can be provided as so-called package software.
• the program can be stored in the memory 11 3 in advance, or can be installed from the removable recording medium as described above into the disk reproducing device. Also, the program can be transferred wirelessly from a download site to a disk playback device via a digital satellite broadcasting artificial satellite, or via a network such as a LAN (Local Area Network) or Internet. The program can be transferred to the disc playback device via wire, and the program transferred in this way can be received by the input interface 1 1 5 and installed in the built-in memory 1 1 3.
• LAN Local Area Network
• the program may be processed by one CPU, or may be processed by multiple CPUs in a distributed manner.
• the drive interface 1 1 4 controls the disk drive 1 0 2 under the control of the CPU 1 1 2 so that the disk drive 1 0 2 reads the data read from the disk 1 0 1 into the bus 1 1 1 through CPU 1 1 2, memory 1 1 3, video decoder 1 1 6, audio decoder 1 1 7, etc.
• the input interface 1 1 5 receives a signal supplied when a user operates a key (button) (not shown) or a remote control (remote control commander), and passes through the bus 1 1 1. Supplied to CPU1 1 2
• the incoming interface 115 functions as a communication interface such as a mote (including an ADSL (Asymmetric Digital Subscriber Line) mote) or a NIC (Network Interface Card).
• Video decoder 1 1 6 is a disk drive 1 0 2 Decode the encoded video data read from the link 1 0 1 and supplied via the drive-in interface 1 1 4 and bus 1 1 1, and the resulting video data is sent to the bus 1 1 1 To the CPU 1 1 2 via the video output interface 1 1 8.
• the audio decoder 1 1 7 decodes the encoded audio data read from the disk 1 0 1 by the disk drive 1 0 2 and supplied via the drive interface 1 1 4 and the bus 1 1 1, The resulting audio data is supplied to the CP U 1 1 2 and the audio output interface 1 1 9 via the bus 1 1 1.
• the video output interface 1 1 8 performs necessary processing on the video data supplied via the bus 1 1 1 and outputs it from the video output terminal 1 2 0.
• the audio output interface 1 1 9 performs necessary processing for audio data supplied via the bus 1 1 1 and outputs it from the audio output terminal 1 2 1.
• the video output terminal 1 2 0 is connected to a video output device such as a CRT (Cathode Ray Tube) or a liquid crystal panel (not shown), and therefore the video data output from the video output terminal 1 2 0 Is supplied to the video output device and displayed.
• the audio output terminal 1 2 1 is connected to an audio output device such as a speaker or an amplifier (not shown). Therefore, the audio data output from the audio output terminal 1 2 1 is supplied to the audio output device. Is output.
• video data and audio data can be supplied from the disc playback device to the video output device and the audio output device either by wire or wirelessly.
• FIG. 2 A and Fig. 2 B are executed by CPU 1 1 2 in Fig. 1.
• 2 shows a configuration example of a software module group.
• the software module group executed by the CPU 1 1 2 is roughly classified into an operating system (OS) 2 0 1 and a video content playback program 2 1 0 as an application program.
• OS operating system
• video content playback program 2 1 0 video content playback program
• the operating system 20 1 When the disc player is turned on, the operating system 20 1 starts up first, performs necessary processing such as initial settings, and calls the video content playback program 2 1 0, which is an application program. -Operating system 20 1 provides infrastructure-related services such as file reading for video content playback program 2 10.
• the operating system 20 for example, with regard to file reading, in response to a file reading request from the video content playback program 2 1 0, the disk drive 1 0 via the drive interface 1 1 4. Operate 2 to read the data on disc 1 0 1 and provide it to the video content playback program 2 1 0.
• the operating system 20 0 1 also interprets the file system.
• the operating system 201 has a multitasking function, and can operate a plurality of software modules in a time-sharing manner. That is, the video content playback program 210 is composed of several software modules, but each software module can operate in parallel.
• Video content playback program 2 1 0 Video content playback program 2 1 0
• the video content playback program 2 1 0 is a script control module. 2 1 1, player control module 2 1 2, content data supply module 2 1 3, decode control module 2 1 4, buffer control module 2 1 5, video decoder control module 2 1 6, audio decoder control module 2 1 7.
• the video content playback program 2 1 0 is software that plays a central role in playback of the disc 1 0 1.
• the disc 1 0 1 When the disc 1 0 1 is inserted (inserted) into the disc drive 1 0 2, the disc 1 0 1 Check if 1 is a formatted disc with content recorded later. Further, the video content playback program 2 1 0 reads and executes a script file (to be described later) from the disc 1 0 1, and plays back the content recorded on the disc 1 0 1 from the disc 1 0 1.
• the metadata file necessary for the file is read, and the playback of content is controlled based on the metadata.
• the script control module 2 1 1 interprets and executes the script program (script) described in the script file recorded on the disk 1 0 1.
• script program for example, “Operate the graphics processing module 2 19 to create and display images such as menus” and “Display menus according to signals from Ul OJser Interface (remote control etc.)”. Change (for example, move the power on the menu) It is possible to describe actions such as “control the player control module 2 1 2”. .
• the player control module 2 1 2 refers to metadata or the like recorded on the disc 1 0 1 and performs control related to content reproduction. That is, the player control module 2 1 2 analyzes, for example, PrayList O and Cl ip O, which will be described later, recorded on the disc 100 1, and the content data supply module 2 according to the analysis result. Controls 1 3, decode control module 2 1 4, buffer control module 2 1 5 '. In addition, the player control module 2 1 2 performs control such as switching a stream to be played back, switching a stream to be described later, in accordance with an instruction from the script control module 2 1 1 or the incoming coin face 1 1 5. Further, the player control module 2 1 2 acquires time from the decode control module 2 1 4 and performs time display, processing of a mark (Mark O) described later, and the like.
• a mark Mark O
• the content data supply module 2 1 3 follows the control of the player control module 2 1 2 or, based on the amount of data stored in the buffer control module 2 1 5, Requests the operating system 2 0 1 to read the evening and metadata.
• the metadata read from the disk 10 1 by the operating system 2 0 1 in response to a request from the content data supply module 2 1 3 is supplied to the necessary modules.
• the content data read from the disc 1 0 1 in response to a request from the content data supply module 2 1 3 by the operating system 2 0 1. Is supplied to the buffer control module 2 1 5.
• the decode control module 2 1 4 controls the operation of the video decoder control module 2 1 6, the audio decoder control module 2 1 7, and the subtitle decoder control module 2 1 8 according to the control from the player control module 2 1 2. To do.
• the decode control module 2 1 4 has a clock unit 2 1 4 A that measures the time, and outputs the video data output by the control of the video decoder control module 2 1 6 and synchronizes with the video data.
• the output of the data to be output at the same time (ie, the output of the data), that is, here, the synchronization of the output of the audio data output by the control of the audio decoder control module 2 1 7 14 A may be autonomously timed by counting a reference clock supplied from outside or an internal clock synchronized with a decoder or the like.
• the software-based decoder which is realized by controlling the various modules shown in Fig. 2A and Fig. 2B, performs independent timekeeping processing by software separately from these processes. This will increase the processing load on the CPU 1 1 2. For this reason, the timekeeping unit 2 14 A is required to update the time according to the video data output from the decoder.
• FIG. 3 shows the relationship between the time and the actual elapsed time when the timer 2 14 A shows an independent clock.
• the timer 2 1 4 A counts up with a 90 kHz clock, so it increases from the time 0 in a straight line on the upper right, and the time indicated by the clock at the time of 33.3 ms is 3003. It has become.
• FIG. 4 shows an example of the time when the timer 2 14 A shows a clock that updates the time according to the video data output of the video decoder 3 . In the case of Fig.
• the clock output time is updated to 3003 when 33.3 milliseconds elapses, the output time is updated to 7507 after 83.3 milliseconds elapses, and 1 1 The output time is updated to 1 051 0 when 6 milliseconds have passed.
• the output time of one frame is 16.66 milliseconds.
• Fig. 3 the time actually changes in a staircase pattern with a resolution of l / 90kHz, but for comparison with Fig. 4, it is represented by a straight line in Fig. 3. .
• the clock unit 2 14 A updates the time according to the video data output described with reference to FIG.
• the buffer control module 2 1 5 has a built-in buffer 2 1 5 A which is a part of the storage area of the memory 1 1 3 in FIG. 1.
• the content data supply module 2 1 is included in the buffer 2 1 5 A.
• the buffer control module 2 1 5 is stored in the buffer 2 1 5 A according to the request of the video decoder control module 2 1 6, the audio decoder control module 2 1 7, or the frame decoder control module 2 1 8.
• the data is supplied to the video decoder control module 2 1 6, the audio decoder control module 2 1 7, or the caption decoder control module 2 1 8.
• the buffer control module 2 15 includes a video reading function unit 2 3 3, an audio reading function unit 2 3 4, and a subtitle reading function unit 2 3 5 which will be described later with reference to FIG.
• buffer The control module 2 1 5 can process the video decoder control module 2 1 6 and other requests by the video read function unit 2 3 3 ⁇ : and thus stored in the buffer 2 1 5 A
• the data is supplied to the video decoder control module 2 1 6.
• the buffer control module 2 1 5 processes the data request from the audio decoder control module 2 1 7 by the audio read function unit 2 3 4, thereby storing the data stored in the buffer 2 1 5 A.
• the video decoder control module 2 1 6 operates the video read function section 2 3 3 (Fig. 5) in the buffer control module 2 15 to convert the video data encoded data (video encoded data) into a video archive.
• the data is read from the buffer 2 1 5 A of the buffer control module 2 1 5 in units of units and supplied to the video decoder 1 1 6 in FIG.
• the video decoder control module 2 16 controls the video decoder 1 16 to decode data in units of video access units. Further, the video decoder control module 2 16 supplies video data obtained as a result of decoding by the video decoder 1 16 to the graphics processing module 2 19.
• the video access unit is, for example, one picture (one frame or one field) of the video data.
• Audio decoder control module 2 1 7 is a buffer control module. By operating the audio readout function part 2 3 4 (Fig. 5) in the control 2 1 5, the audio data encoded data (audio encoded data) is buffered in units of audio access units. 1 is read from the buffer 2 1 5 A of the control module 2 1 5 and supplied to the audio decoder 1 1 7 in Fig. 1. Also, the audio decoder control module 2 1 7 controls the audio decoder 1 1 7 In addition, the audio decoder control module 2 1 7 decodes the audio data obtained as a result of decoding by the audio decoder 1 1 7 to the audio output module 2 2 1. Supply.
• the audio access unit is a predetermined data amount of audio data (for example, output in synchronization with one picture).
• the audio access unit has a known fixed length, for example.
• the subtitle decoder control module 2 1 8 operates the subtitle read function section 2 3 5 (Fig. 5) in the buffer control module 2 1 5 to encode the subtitle data (subtitle encoded data). Read from buffer 2 1 5 A of buffer control module 2 1 5 in units of subtitle access units.
• the subtitle decoder control module 2 18 is provided with subtitle decoding software (not shown), and decodes data read from the buffer 2 15 A. Further, the subtitle decoder control module 2 18 supplies the subtitle data (subtitle image data) obtained as a result of the decoding to the graphics processing module 2 19.
• the subtitle access unit is a predetermined amount of subtitle data (for example, output in synchronization with one picture).
• This implementation In the form, the size of the subtitle access unit is described at the head of the subtitle access unit, for example.
• the graphics processing module 2 1 9 expands or reduces the caption data from the subtitle decoder control module 2 1 8 according to the instructions of the player control module 2 1 2, and converts it to the video data from the video decoder control module 2 1 6. Superimpose caption data.
• the graphics processing module 2 19 makes the image frame of the video data after being superimposed with the caption data match the display screen of the video output device connected to the video output terminal 120 in FIG. Enlarge or reduce the video data, and output the resulting video data to the video output module 220.
• the graphics processing module 2 19 generates menus and messages according to the instructions of the script control module 2 1 1 and the player control module 2 1 2 and overlays the output video data.
• the graphics processing module 2 19 has the ratio of the video output device connected to the video output terminal 120 in FIG. 1 and the video data recorded in the disk 110 1.
• the aspect ratio of the video data to be output to the video output module 220 is converted based on information indicating the aspect ratio.
• the graphics processing module 2 1 9 performs squeeze processing to reduce the video data output to the video output module 2 2 0 in the horizontal direction (horizontal direction), and outputs the data that displays black on the left and right .
• the video output device When the ratio is 4: 3 and the information indicating the aspect ratio of the video data indicates the aspect ratio of 16: 9, the graph box processing module 2 1 9 , Video output module 2 2 0 Outputs video data squeezed vertically (vertical direction) and puts data that displays black on the top and bottom.
• the graphics processing module 2 1 9 outputs the video output to the video output module 2 20 as it is without squeezing.
• the graphics processing module 2 19 captures the video data currently being processed in response to a request from the player control module 2 1 2, for example. Further, the graphics processing module 2 19 stores the captured video data or supplies it to the player control module 2 12.
• Video output module 220
• the video output module 220 exclusively occupies a part of the memory 1 1 3 in Fig. 1 and uses it as a FIFO (First In First Out) buffer 22 OA, and video data from the graphics processing module 2 1 9 Is temporarily stored, and the video data stored in the buffer 220A is appropriately read out and output to the video output terminal 120 (Fig. 1).
• FIFO First In First Out
• the audio output module 2 2 1 exclusively occupies a part of the memory 1 1 3 in Fig. 1 and uses it as a FIFO buffer 2 2 1 A.
• the audio decoder control module 2 1 7 (audio decoder 1 1 7 ) Temporarily store audio data from the buffer 2 2 1 A The audio data stored in is properly read out and output to the audio output terminal 1 2 1 (Fig. 1).
• the audio output module 2 2 1 has dual (the audio data from the audio decoder control module 2 1 7 is the audio data of the “main audio” on the left channel and the audio data of the “sub audio” on the right channel ( In the case of audio data in the Dual) mode, audio data from the audio decoder control module 2 1 7 is output to the audio output terminal 1 2 1 in accordance with the audio output mode specified in advance.
• the audio output module 2 2 1 when “main audio” is designated as the audio output mode, the audio output module 2 2 1 is connected to the audio of the left channel of the audio decoder from the audio decoder control module 2 1 7. The data is copied as audio data for the right channel, and the audio data for the left and right channels (“main audio” audio data) is output to the audio output terminal 1 2 1. Also, when “Sub Audio” is specified as the audio output mode, the audio output module 2 2 1 is connected to the audio channel of the right channel from the audio decoder control module 2 1 7. The evening is copied as left channel audio data, and the left channel and right channel audio data (“sub audio” audio data) is output to the audio output terminal 1 2 1. Furthermore, when “Main / Sub” is specified as the audio output mode, the audio output module 2 2 1 uses the audio data from the audio decoder control module 2 1 7 as it is, the audio output terminal 1 2 1 Output to.
• the audio from the audio decoder control module 2 1 7 If the data is in stereo (Audio) mode, the audio output module 2 2 1 will not change the audio output mode from the audio decoder control module 2 1 7 regardless of the audio output mode designation. The evening is output to the audio output terminal 1 2 1 as it is.
• the audio output mode can be specified interactively by the user operating the remote controller or the like on a screen or the like on which a menu generated by the video content playback program 2 1 0 is displayed.
• FIG. 5 shows a configuration example of the buffer control module 2 15 of FIGS. 2A and 2B.
• the buffer control module 2 15 exclusively uses a part of the memory 1 1 3 in FIG. 1 as a buffer 2 1 5 A, and is read from the disk 1 0 1 to the buffer 2 1 5 A. Temporarily store the data. Also, the buffer control module 2 15 reads out the data stored in the buffer 2 15 A, and the video decoder control module 2 1 6 and audio decoder control module 2 shown in FIGS. 1 7 or subtitle decoder control module 2 1 8
• the noffer control module 2 15 has a data head pointer storage unit 2 3 1 and a data write pointer storage unit 2 3 2 that are part of the memory 1 1 3 in addition to the buffer 2 15 A, As internal modules, it has a video reading function unit 2 3 3, an audio reading function unit 2 3 4, and a caption reading function unit 2 3 5.
• the sofa 2 1 5 A is, for example, a ring buffer, which sequentially stores data read from the disk 1 0 1 and stores the data for that storage capacity, then overwrites the oldest data overnight. The latest data It is memorized in an endless loop.
• the data heading memory section 2 3 1 is the position where the oldest data that has not yet been read from the buffer 2 1.5 A among the data 3 stored in the buffer 2 15 A is stored. Stores the first data point indicating (address).
• the data write pointer storage unit 2 3 2 stores a write pointer that points to the buffer 2 15 A where the latest data read from the disk 1 0 1 is written.
• the position pointed to by the data write pointer is updated clockwise (clockwise) in the figure every time data read from disk 1 0 1 is stored in buffer 2 15 A
• the position pointed to by the data head pointer is updated clockwise in the figure as data is read from buffer 2 15 A. Therefore, in the data stored in buffer 2 15 A, valid data is stored in the clockwise direction from the position indicated by the data start pointer to the position indicated by the data write pointer. It is data.
• the video readout function unit 2 3 3 receives a video stream (element stream for video data from the buffer 2 1 5 A). ) Is read and supplied to the video decoder control module 2 1 6.
• the audio readout function section 2 3 4 also receives an audio stream from the buffer 2 15 A Read out the stream and supply it to the audio decoder control module 2 1 7.
• the subtitle reading function section 2 3 5 is also in response to a request from the subtitle decoder control module 2 1 8 in FIGS. 2A and 2B.
• the subtitle stream (elementary stream related to subtitle data) is read from buffer 2 15 A and supplied to subtitle decoder control module 2 1 3 8.
• a program stream (MPEG2-System Program Stream) conforming to the MPEG (Moving Picture Experts Group) 2 standard is recorded on the disc 1 0 1, and the disc 2 1 5 A has a disc stream.
• the program stream read from 1 0 1 is stored.
• one or more elementary streams such as a video stream, an audio stream, and a subtitle stream are time-division multiplexed.
• the video reading function unit 2 33 3 has a program stream demultiplexing function, and reads the video stream separately from the program stream stored in the buffer 2 15 A.
• the audio reading function unit 234 also has a program stream demultiplexing function, and reads the audio stream separately from the program stream stored in the buffer 2 15 A.
• the subtitle reading function unit 2 3 5 also has a program stream demultiplexing function, and reads the subtitle stream separately from the program stream stored in the buffer 2 15 A.
• the video readout function unit 2 3 3 has a video readout pointer storage unit 2 4 1, a streara_id register 242, and an au-informationO register 243 which are a part of the memory 1 1 3 in FIG. .
• the video readout pointer storage unit 24 1 stores a video readout pointer indicating the position (address) of the buffer 2 1 5 A where the video stream is stored, and the video readout function unit 2 3 3 is a buffer 2 1 5 A, the data stored at the position indicated by the video read pointer is read out as a video stream.
• stream_id Regis evening 24 2 Buffer 2 1 5 Analyzes the program stream stored in A, and stores the stream_id (to be described later) for specifying the video stream to be read from the program stream.
• the au_information 0 register 243 stores au_information (), which will be described later, which is data necessary for reading the video stream from the buffer 2 15 A.
• the audio reading function unit 234 has an audio reading boy memory unit 251, a stream_id register 252 and a private_stream_id register 253, which are a part of the memory 11 13 of FIG.
• the audio read pointer storage unit 2 51 stores an audio read pointer indicating the position (address) of the buffer 2 15 A where the audio stream is stored, and the audio read function unit 2 34 stores the buffer 2 1 5
• the data stored at the position indicated by the audio read pointer in A is read as an audio stream.
• the stre amjd register 2 5 2 and the private stream_id register 2 5 3 analyze the program stream stored in the buffer 2 1 5 A and identify the audio stream to be read from the program stream.
• the subtitle read function unit 23 5 is a subtitle read function flag storage unit 2 6 which is a part of the memory 1 1 3 of FIG. 1.
• the subtitle read function flag storage unit 2 61 stores a subtitle read function flag.
• the subtitle read function flag stored in the subtitle read function flag storage unit 2 61 is, for example, 0, the subtitle read function unit 2 35 does not function and is stored in the subtitle read function flag storage unit 26 1
• the subtitle read function flag is 1, for example, read subtitle Function part 2 3 5 functions.
• the subtitle read-out memory unit 2 6 2 stores the subtitle read-out point that points to the position (address) where the curtain stream is stored in the buffer 2 1 5 A, and the subtitle read-out function unit 2 3 5 uses the buffer 2 1 5 Reads the data stored at the position indicated by the character readout pointer of A as a subtitle stream.
• s eam_id registers 2 6 3 and 1 " ⁇ & 16_3 ⁇ 6 & 111_ id registers 2 64 analyze the program stream stored in buffer 2 1 5 A and identify the subtitle stream to be read from that program stream To store stream_id and private_stream_id, which will be described later.
• FIG. 6 schematically shows the directory structure of the disk 1001.
• file system of the disk 100 for example, ISOGntern at ional Organization for Standardizaton) -9660 and UDF (Universa 1 Disk Format: http://www.osta.org/specs/)
• a file system is used, and the overnight files recorded on the disc 100 are managed hierarchically by the directory structure.
• the file system is not limited to the file system described above.
• the "VIDEO" directory is placed in the root directory that indicates the base point of the file system.
• the "VIDEO" directory contains two directories, the "CLIP” directory and the "STREAM” directory. Li is placed. —
• the “VIDEO” directory contains two directories, “SCRIPT.DAT” and “PLAYLIST.DAT”, in addition to the two directories “CLIP” and “STREAM”. The file is located.
• the “SCRIPT.DAT” file is a script file that describes the script program.
• the “SCRIPT.DAT” file describes a script program used to make the playback mode of the disc 100 1 interactive.
• the script program described in the “SCRIPT.DAT” file is interpreted and executed by the script control module 2 1 1 in FIG. 2A and FIG. 2B.
• the “PLAYLIST.DAT” file stores one or more playlists (PlayListO in FIG. 7 to be described later) in which playback procedures of content such as video data recorded on the disc 100 1 are described.
• One or more clip information files are placed in the “CLIP” directory, and one or more clip stream files are placed in the “STREAM” directory. That is, in FIG. 6, the “CLIP” directory contains three clip information files “00001. CLP”, “00002 CLP”, “00003. CLP”, and the “STREAM” directory contains Three clip stream files “00001.PS”, "00002.PS”, and "00003.PS" are placed.
• the clip stream file contains a program stream that is time-division multiplexed one or more elementary streams obtained by compressing and encoding data such as video data, audio data, and caption data.
• the clip information file describes metadata related to the clip stream, such as the nature of the corresponding clip stream file. That is, the clip stream file and the clip information file are
• the clip stream file is given a file name according to the naming rule of 5 characters + period + "PS".
• the clip information file and the corresponding clip stream file File names are assigned according to the same naming rule: 5 numbers + period + "CLP”.
• a file is a clip stream file or a clip information file can be identified by the extension of the file name (the part to the right of the period), and the corresponding clip stream file And the clip information file can be identified by whether the part other than the extension of the file name (the part on the left side of the period) matches.
• FIG. 7 shows the internal structure (syntax) of the “PLAYLIST.DAT” file under the “VIDEO” directory in FIG.
• the “Syntax” column indicates the data structure
• the “No. of bits” column indicates the “Syntax” in the corresponding row.
• “bslbf” bit string left bit first
• “Mnemonic” column indicates that the data in the “Syntax” column of the corresponding line is sent from the left bit.
• "uimsbf” unsigned integer most significant bit first
• “Syntax” column of the corresponding line is an unsigned integer value and sent from the most significant bit.
• PLAYLIST.DAT name_length (8 bits) and name.string (255 bytes) for describing information such as the name (file name) and so on are sequentially arranged from the top.
• name_length represents the size of name_string arranged after that in number of bytes.
• name_string represents the name (file name) of the “PLAYLIST.DAT” file.
• name_string from the beginning to the number of bytes represented by name_length is used as a valid name. For example, if name_length is 10, the first 10 bytes from name_string are interpreted as a valid name.
• PlayLists (16 bits). number—0 and PlayLists represents the number of subsequent PlayList 0s. After numbe r_o and PlayLists, the number of PlayLists equal to the number of PlayLists is arranged.
• PlayList 0 is a playlist in which the playback procedure of the clip stream file recorded on the disc 100 1 is described, and has the following internal structure.
• PlayList and data_length (32 bits) are arranged at the head of PlayList 0.
• PlayLis data-length indicates the size of PlayList 0.
• the 15-bit reserved—for_word—alignment is placed to align with the 16-bit position at the 1-bit capture—enable_flag—PlayList position that is placed after that.
• capture_enable_nag If PlayList is 0 or 1, for example 1, it indicates that secondary use of video data belonging to PlayList 0 is permitted, and capture_enable_flag_PlayList is 0 or 1, for example 0 , It means that secondary use of video data belonging to PlayList () is not permitted.
• capture_enable_flag_PlayList is 1 bit, but in addition, capture_enable-flag_PlayList is composed of multiple bits.
• secondary use of video data belonging to PlayListO can be allowed in stages. That is, a capture_enable_flag PlayList can be composed of, for example, 2 bits.
• capture—enable_flag—PlayList is 00B (B indicates that the preceding number is a binary number)
• capture—enable_flag_P yList When the value of 01B is 01B, only secondary use that allows video data to be reduced to a size of 64X64 pixels or less can be permitted. If the value of capture_enable_flag_P yList is 10B, secondary use of video data can be permitted without size restrictions.
• capture-enable-flag-PlayList is 2 bits as described above, reserved_for_word-alignment placed before it is 14 bits to take a word line.
• capture_enable-flag_PlayList can also allow secondary use outside the disc playback device.
• the video data is, for example, a recording medium that can be attached to and detached from the disc playback device or other media that can be connected to the disc playback device. It is recorded on a recording medium that can be attached to and detached from the apparatus, or transmitted to another apparatus via a network such as Internet.
• the video data can be added with information for limiting the number of times the video data is recorded on the recording medium and the number of times it is distributed.
• PlayLis name-length represents the size of the PlayLis name_st ring that is placed after that in bytes
• PlayLis name_string represents the name of PyList ().
• PlayltemO units a content playback procedure can be described in PlayltemO units.
• a unique ID (Identification) in the PlayList 0 is assigned to each Playl m () in the PlayList 0 corresponding to the number of PlayLists. That is, the first PlayltemO in PlayList 0 is assigned an ID number of 0, and the subsequent PlayltemOs are assigned IDs of serial numbers 1, 2,.
• PlayListMarkO is placed after PlayltemO for the number_o and the number of Play It ems.
• PlayListMarkO is a set of MarkOs, which will be described later, which is a mark on the time axis of playback performed in accordance with PlayList 0. Details thereof will be described later with reference to FIG.
• FIG. 8 shows the internal structure of Play- temO included in PlayList 0 of FIG.
• length (16 bits) is arranged, and length represents the size of PlayltemO including it.
• C1 ip_Information_file_name_length represents the size of CI ip—Information_file — ⁇ e that is placed after that in terms of ⁇ and ⁇ .
• CI ip—Information—file_name is the clip information file (file with extension PS in Fig. 6) that corresponds to the clip stream file (file with PS extension in Fig. 6) played by Playtem temO. ) Represents the file name.
• Clip_Information-file-name and so on recognize the file name of the clip information file to be played by PlayltemO and identify the clip stream file according to the naming convention described above for the file name of the clip stream file and clip information file. be able to.
• Clip_ Information- file_name is followed by IN_time (32 bits) and 0 UT_time (32 bits).
• IN_time and OUT time are time information that specifies the playback start position and playback end position of the clip stream file specified by CI ip_Information—file—name, respectively. '
• the position including the beginning of the clip stream file can be specified as the playback start position.
• the position including the end of the clip stream file as the playback end position. Can be specified.
• PlayltemO the content from the IN_time to the OUT-time of the clip stream file specified from the CI ip_Informat information-name is played.
• the content played back by PlayltemO will be referred to as a clip as appropriate below.
• FIG. 9 shows the internal structure of PlayListMarkO included in PlayList 0 of FIG.
• PlayListMarkO is a set of zero or more MarkOs that serves as a mark on the time axis of reproduction performed according to P1ayListO (FIG. 7) including the PlayListMarkO.
• one MarkO represents time information that represents one time on the time axis of playback performed according to PlayListO
• type information that represents the type of MarkO
• the type information represents a type that causes an event Argument information that becomes the argument of the event Have at least.
• length (32 bits) is arranged at the head of PlayListMarkO.
• length represents the size of PlayListMarkO including it.
• number_of_PlayList_marks (16 pits) is placed, and 11111 ⁇ 6 and 0? 1 & 1 ⁇ 3 and [ ⁇ 5 represents the number of MarkOs that follow. After the number—0 and PlayListjnarks, the structure of MarkO is described by the number—o, P1 ayLis, and the number of marks.
• Mark_type (8 pits) is placed at the beginning of MarkO.
• mark_type is the type information described above, and represents the type of MarkO that contains it. In the present embodiment, for example, three types of MarkO types are prepared: Chapter, Chapter, Index, and Event.
• the MarkO of type “Chapuyu” (hereinafter referred to as “Chapuyu Mark” as appropriate) is a mark of the top position of the chapter that is the unit of cueing to divide PlayListO.
• MarkO of type index (hereinafter referred to as “index mark” as appropriate) is a mark of the head position of the index, which is a unit that subdivides the chapter.
• the event type MarkO (hereinafter referred to as event mark as appropriate) is a mark of the position where an event is generated during the playback of the content according to PlayListO. The occurrence of an event due to an event mark is notified to the script control module 2 1 1 as described later.
• mark_type of the evening mark is set to 1.
• 2 is set in the markjype of the index mark
• 3 is set in the mark_type of the event mark.
• mark_name-length (8-bit) is placed after mark-type.
• mark-name_st ring (24 bytes) is placed.
• mark—name_length and mark—name—string are used to describe the name of MarkO
• mark—name—length is the effective size of mark—nam e—string
• mark—name—s tr ing is , MarkO name is shown respectively. Therefore, the mark_name-string leading force to the number of bytes indicated by mark-name-leng th represent a valid name of MarkO.
• PlayltemO (FIG. 8) to which Mark 0 belongs is specified by ref_to_PlayItem_id, and as a result, the clip information file and the clip stream file are specified as described in FIG.
• mark_time_stamp represents the time indicated by MarkO in the clip stream file specified by re_to_PlayItem_id.
• FIG. 11 shows the relationship between PlayListO, Playltem (), clips, and program streams stored in clip stream files.
• PlayListO is composed of three PlayltemOs, and each of the three PlayltemOs is given ID # 0, # 1 and # 2 are attached.
• Playltem () with ID # i is described as Playltem # i as appropriate.
• clips that are contents played back by PlayltemftO, Playltem # l, and Playltem # 2 are shown as Clip A, Clip B, and Clip C, respectively.
• the clip entity is a program stream from IN_time to 0UT_time among the program streams stored in the clip stream file specified by CI ip_Information—nie_name in PlayltemO in FIG.
• the program streams as the entities of clip A, clip B, and clip C are shown as program stream A, program stream B, and program stream C, respectively.
• time tO is the time at which Playltem # l is played
• re_to_PlayItem—id describes 1 as the ID of the PyItem # l.
• program stream B which is the entity of clip B
• time_stamp corresponds to time 10 in the clip stream file in which program stream B is stored. The time is described.
• entry—ES—stream_id and entry—ES—private_s tream—id are used to identify the elementary stream when MarkO is associated with the particular elementary stream. Is done. That is, entry_ES_stream_id describes the stream id (to be described later) of the elementary stream associated with MarkO. Also, ei ry_ES_private_ In stream_id, private_stream_id (described later) of the elementary stream associated with MarkO is described as required. j For example, in a clip where video stream # 1 and video stream # 2 are multiplexed, when playing video stream # 1 and when playing video stream # 2.
• Video stream # 2 stream_id and private_stream_i (i are described in video stream # 2 entry— ES— stream— id and entry_ES— private_stream— id It is done.
• mark_data (3 2 bits) is placed after entry—ES_private—stream—id.
• mark_data is argument information that becomes an argument of an event generated by the event mark when MarkO is an event mark. Mark_data can also be used as the number of the chapter index represented by the chapter mark or index mark when MarkO is a chapter mark or index mark.
• FIG. 12 shows the internal structure of such a clip information file ClipO.
• resentation_start_time and presentation end_time are sequentially arranged.
• Cliff information file Represents the beginning and end time of the clip stream corresponding to ClipO. Note that the time of the clip stream file is described in a multiple of 90 kHz used for the time of MP EG2-System.
• capture_enable_flag_PlayList in Fig. 7 indicates whether or not secondary use of video data belonging to PlayListO corresponding to the video stream played back by PyListO is permitted.
• Capture_enable—flag 1 CI ip indicates whether secondary usage of video data corresponding to the video element list stored in the clip stream file corresponding to the clip information file C pO is permitted. Therefore, the capture_enable_flag_PlayList shown in FIG. 7 and the capture_enable_flag_Clip shown in FIG. Note that capture_enable_flag_Cl ip in Fig. 12 can also be set to multiple bits instead of 1 bit as described in capture_enable_flag_PlayList in Fig. 7.
• Length (16 bits) is placed at the beginning of StreamlnfoO, and this length represents the size of StreamlnfoO including it. Following the length, stream—id (8 bits) and private_stream_id (8 bits) are arranged, and the element stream associated with StreamlnfoO is specified by this stream—id and private—stream—id. .
• Fig. 13 shows the relationship between stream_id and private_streara_id for identifying the elementary list and the elementary stream.
• the stream_id is the same as that specified in the MPEG2-System standard, and its value is determined in advance for each attribute of the elementary stream in the MPEG2-System standard. Therefore, an elementary stream having an attribute defined in the MPEG 2-System standard can be specified only by stream_id.
• e_stream_id is an elementary stream with attributes not specified in the MPEG2-System standard. This is information for identification.
• the data is encoded with the encoding method specified by MPEG.
• Video elementalist stream ATRAC (Adaptive TRansform Acoustic Coding) system audio element stream (hereinafter referred to as ATRAC audio stream), LP6M (Linear Pulse Code Modulation) system Stre am for the elementary stream of the four attributes of the audio elementary stream (hereinafter referred to as the LPCM audio stream) and the subtitle elementary stream (hereinafter referred to as the subtitle stream) It shows the relationship between id and private—stream—id. '
• an elementary stream of a video encoded with the encoding method specified by MPEG has a value in the range of OxEO to OxEF. It is specified that multiplexing is performed using stream_id that identifies the elementary stream. Therefore, the elementary element stream of a video encoded by the encoding method stipulated by MPEG can be identified by streamjd having a value in the range of Ox E0 to OxEF. Restreams can be multiplexed into the program stream.
• the elementary stream of the video encoded with the encoding method specified in MPEG can be identified by the stream_id value in the range of OxEO to OxEF, so private-stream-id is unnecessary. is there.
• stream_id is not defined for ATRAC audio stream, LPCM audio stream, and subtitle stream.
• OxBD which is a value representing the attribute “private stream 1” in the MPE G2-System, in its sam-id.
• private_s earn—id is used for identification. 1
• a private stream_id in the range of 0x00 to OxOF is used to identify an ATRAC audio stream. Therefore, 16 ATRAC audio streams can be multiplexed in the program stream.
• the value private_streaDi_id in the range of 0x10 to OxlF is used for identifying the LPCM audio stream. Therefore, 16 LPCM audio streams can be multiplexed in the program stream.
• private_stream_id with a value in the range of 0x80 to 0x9F is used to identify the subtitle stream. Therefore, 32 subtitle streams can be multiplexed in the program stream.
• StaticInfoO and reserved_for_word_alignment (8 bits) are sequentially arranged after the private stream_id.
• Staticlnf o () contains information that does not change during playback, including 51 &"(; 11 ⁇ 0 (), 5 63111111 [element_list_stream_id and private_st_ream_id described in 00] Details of Static Info 0 will be described later with reference to FIG.
• reserved_for—word—al ignment is used to take word alignment.
• number_of—Dynamic Info (8 bits) is allocated, and number_ofJ) ynainicInfo represents the number of sets of pts_change_point (32 bits) and Dynamiclnfo 0 that are subsequently allocated.
• pts—change_point represents the time when the Dynamiclnfo information paired with it is valid.
• pts_change_point which represents the beginning time of the elementary stream ream, is present at ion_s tar described at the beginning of the clip information file Clip 0 corresponding to the clip stream file that stores the elementary stream. Equal to time.
• Dynamiclnf o 0 describes dynamic information that changes during the playback of the elementary stream identified by stream_id ⁇ kI ⁇ private_stream—id-ck ".
• EP_napO is placed after the number_of—dynamiclfo pts—change_point and DynamicInfoO. EPjnapO will be described later with reference to FIG.
• Fig. 14 shows the syntax of StaticInfoO.
• the content of StaticInfoO differs depending on the attribute of the corresponding elementary list.
• the attribute of the elementary stream corresponding to StaticInfoO is determined by the stream_id and private_stream_id included in Streamlnfo 0 in Fig. 12 including StaticInfoO.
• StaticInfoO is picture-size (4 ), Frame—rate (4 bits), cc—flag (1 bit), and “reserved—for one word” alingment to take a single door line.
• picture_size represents the size of the image displayed by the video display corresponding to the video stream.
• frame_rate represents the frame frequency of the video data corresponding to the video stream.
• cc_flag indicates whether or not a closed caption is included in the video stream. That is, for example, if the video stream contains closed caption data, cc ”flag is set to 1, and if the video stream does not contain closed caption data, cc_flag is 0.
• Stat iclnfo 0 is an audio one languag e—code (16 hits), channel—conf igurat ion (8 hits) ), Lfe—exis tence (1 bit), and sampl ing—f requency (4 bits), and reserved—for—word_al i ent
• audio language—codfe
• the channel configuration shows the attributes of the audio stream included in the audio stream, such as mono / stereo / multi-channel.
• lfe_existence indicates whether the low-frequency emphasis channel is included in the audio stream. If it is included, it is 1; otherwise, it is 0.
• Sampling—frequency is information indicating the audio sampling frequency included in the audio stream.
• Stat iclnfo 0 takes sub Darling with subt it le_langiiag e-code (16 bits) and conf igurable_flag (1 bit)
• the configurable_nag is information indicating whether or not to allow the change of the display method of the subtitles included in the caption stream to the default display method.For example, the change of the display method is permitted. 1 is written in the case, and 0 is written if not allowed.
• the display format of subtitle data includes the display size, display position, display color, display pattern (for example, blinking display), display direction (for example, vertical or horizontal direction), etc. .
• Figure 15 shows the DynamicInfoO syntax.
• Dynamic Info 0 At the beginning of Dynamic Info 0, reserved-for-word-alignment (8 bits) for word alignment is placed, and the elements that follow are based on the attributes of the elementary stream corresponding to DynamicInfoO. Are different.
• the attributes of the elementary list corresponding to DynamicInfoO are determined by the stream-id and private_stream_id included in Seamfofo in Fig. 12 including DynamicInfoO, as in StaticInfoO described in Fig. 14.
• DynamicInfoO As explained in Figure 12 Dynamic information that changes during the reproduction of the stream is described. This dynamic information is not particularly limited, but in the embodiment shown in FIG. 15, the data corresponding to the element stream corresponding to Dynamic Info 0, that is, the element stream is selected. Output attributes of data output by processing are described in DynamicInfoO.
• Dynami c Info 0 is di splay—aspect—rat.io (4 bits) and the word It consists of reserved d_for_word_ lingment and '.
• the aspect ratio of the video data as the output method of the video data corresponding to the video stream is described.
• information indicating whether the aspect ratio is 16: 9 or 4: 3 is described in the display—a spec ratio.
• the video stream DynamicInfoO can describe, for example, the size of the image displayed by the video display (X pixel XY pixel) in addition to the aspect ratio.
• Dynamiclnfo 0 uses channel_as signment (4 bits) and reserved—for—word—al Composed of ingment.
• the channel—assignment describes the output method of two channels when audio data of two channels is included in the audio stream. In other words, information indicating whether the audio data has been assigned to a stereo or dual (Nike language) channel is described in the channel assignment.
• Dynamiclnfo is composed of reserved_for_word_alingment for taking a single door line. Immediately, in the embodiment of FIG. 15, the output attribute as dynamic information is not defined for the subtitle stream. .
• Figure 16 shows the syntax of EPjnapO.
• EP_map for each element list stream multiplexed in the program stream stored in the clip stream file corresponding to the clip information file Clip 0 in Fig. 12 including the EP-map 0. Describes information about the start point (entry point) of decoding that can start decoding of each elementary stream.
• the decoding start point can be calculated, but for each video access unit, such as variable-rate streams or video streams encoded according to the MPEG standard.
• the decoding start point cannot be obtained by calculation, and cannot be found without actually analyzing the stream. Recognizing the point where decoding can start quickly is important for random access, and EPjnapO can quickly recognize the point where decoding can start.
• Sequencejieader 0 sequence header
• EPjnapO has reserved_for_word_alignment (8 bits) for word alignment at the beginning, followed by number_o and s tream_i d— Entries (8 bits) are placed.
• number_of_stream_id_entries represents the number of stream streams for which decoding start point information is described in EPjnapO.
• the information for identifying the elementary stream and the information about the decoding start point of the elementary stream are 111111 ⁇ 6 and 0 and 51 & 111_1 (1 —611 Repeated as many times as 165 represents.
• Number_o and EP_entries represent the number of possible decoding start points of the element list stream specified by the immediately preceding stream_id and private-stream-id.
• index_N—minusl and N-th_Re and picture_copy are placed, followed by PTS_EP_start (32 bits) and RPN_EP_start ( 32 bits) are placed, and these are placed repeatedly.
• index— N— minus 1 and N-th—Ref— picture— copy will be described later.
• N-th—Re and picture—copy are recorded in the private_streani_2 indicated by RPN 1 EP—star t, which will be described later, Is tRe picture, 2ndRe pic tii're, 3rdRe picture, 4thRe picture One of these is copied.
• index_Njninusl information on which field was copied is recorded using the values shown in Fig. 17. That is, as shown in Fig. 17, index_Njninusl has IstRe and picture copied 0, 2ndRef_picture copied 1 and 3rdRe and picture copied 2 If 4thRe and picture are copied; 4 will be recorded.
• PTS_EP_start which is one of the decode start point information, is the clip stream file that stores the program stream in which the elementary list specified by stream_id and private_stream_id is multiplexed. Indicates the time (playback time) at which decoding can start.
• RPN_EP—start which is another piece of decoding start point information, is determined by stream_id and private_stream_id, as described above.
• the class stream that stores the program stream in which the elementary stream is multiplexed is stored. Describes the value when the position of the decode startable point in the lip stream file is counted in packO units of the program stream. In this embodiment, it is assumed that the size of packO is fixed at 2048 bytes. Further, in the present embodiment, it is assumed that one section of the disk 10 1 (FIG. 1) is 2048 bytes.
• a private_stream_2 packet (PES-packet 0 with the attribute private_stream-2), which will be described later, is placed immediately before the decoding start possible point (entry point).
• privat e stream 2 packets are sent from the private—s eam_2 packet to the next pr ivate_stream_2 Stores information used to decode the video stream placed between the buckets.
• RPN_EP_start which is the information about the decode startable point, is not the actual decode startable point itself, but the head of the private_stream_2 bucket ⁇ placed immediately before the actual decode startable point The position of is described.
• the set of PTS first-s tar t and RPN-EP-s tar t as information of the decoding start possible point is an element specified by stream-id and private two-stream-id. Each stream is sorted in ascending order. As a result, binary search is possible for the set of PTS-EP_start and RPN_EP_start as information on the decoding startable point.
• a random access method for a variable rate stream or a stream having a different size for each video access unit is described in, for example, Japanese Patent Application Laid-Open No. 2000-341640 (Japanese Patent Application No. 11-317738) '. It is.
• the clip stream file is configured based on MPEG2_Program—StreamO defined in the MPEG-2 System (IS0 / IEC 13818-1). That is, Fig. 18A and Fig. 18B show Table 2-31, Table 2-32, Tables described in the MPEG-2 System (IS0 / IEC 13 818-1: 2000) standard. 2-33 is shown.
• the program stream stored in the clip stream file is , MPEG2_Program — StreamO defined in Table 2-31 of the MPEG-2 System standard. It consists of one or more packO and one MPEG—program—endico de.
• MPEG2_Program_Stream () is also described in Japanese Patent No. 27 85220.
• One packO is composed of one PackJieaderO and an arbitrary number of PES_packet 0, as defined in Table 2-32 of the MPEG-2 System standard. Details of PackJieaderO are defined in Table 2-33 of the MPEG-2 System standard.
• the size of packO is defined as a variable length, but here it is assumed to be fixed at 2048 bytes as described in FIG. Furthermore, here, the number of PES_packetO of one packO is one, two, or three.
• PES-packet 0 When PackO starts with a private-stream—2 bucket, which will be described later, there is always a PES-packet 0 of the corresponding video stream immediately after that.
• padding_packet can be placed as the third PES—packet 0.
• the private_stream_2 packet is always placed at the beginning of PackO.
• PES_packet 0 containing content data such as video, audio, and subtitles is placed at the beginning of PackO.
• padding_packet can be placed as the second PES—packet 0.
• FIG. 19A and FIG. 19B to FIG. 21A and FIG. 21B show PES-packet 0 defined in Table 2-17 of the MPEG-2 System standard.
• PES—packet 0 is packet—s tar t—code—prefix, stream—id, and P ES—packet length ( Figure 19A and 19B), stream_id, etc.
• the header part whose structure changes (including one byte of stuf fing) (Fig. 19 A and Fig. 19 B to Fig. 21 A and Fig. 21 B) and PEs packet_data_byte (Fig. 21 A And Figure 21 B).
• PES-packet is replaced with data-byte, adding_byte (OxFF) (Fig. 21 A and Fig. 21 B ) Is repeated as many times as necessary.
• the header part of PES_packet () includes PTS (Presentation Time) as shown in Fig. 19 A and Fig. 19 B, and Fig. 20 A, Fig. 20 B and Fig. 20 'C.
• Information indicating the display timing called Stamp) and information indicating the decoding timing called DTS (Decoding Time Stamp) can be arranged.
• PTS is added to all access units (decode units constituting the elementary list defined in MPEG2-System), and DTS is added to MPEG2-System. Let's say.
• the elementary stream multiplexed into the program stream is stored in PES_packet 0 data_byte (FIG. 21A and FIG. 21B) of PES_packet 0.
• PES_packet 0 data_byte FIG. 21A and FIG. 21B
• a value corresponding to the attribute of the elementary stream is described in order to identify the elementary stream stored in the PES_packet and data-byte.
• FIG. 22A and FIG. 22B show a table 2-18 of the MPEG-2 System standard.
• the stream_id defined in the MPEG-2 System standard shown in FIGS. 22A and 22B, for example, in FIG. Use the indicated value.
• the stream_id of PES_packet () of the elementary list with an attribute called private_stream_l is set to 10111101B according to Figure 23.
• the stream-id of PES-packet 0 of padding_packet is set to 10111110B according to Fig. 23.
• the stream_id of the PES packet 0 of the elementary stream with the attribute called private_stream_2 is 1011U11B according to Fig. 23.
• the stream_id of PES_packet 0 of an audio stream (audio element stream) defined in MPEG is ⁇ .
• the lower 5 bits xxxxx of ⁇ are audio stream pickers that distinguish audio streams.
• the stream_id of the PES packetO of the video stream (video elementary stream) defined in MPEG is 11 ⁇ .
• Multiple video streams (video streams defined by MPEG) can be multiplexed.
• PES packet 0 with stream id 11 ⁇ is defined by MPEG.
• PES—packetO with stream—id “llOxx xxxB” is used to store an audio stream defined in MPEG.
• the stream_id of PES—packet 0 used to store an element list stream of an encoding method not defined in MPEG (for example, ATRAC method) is not defined in MPEG.
• PES_packet 0 of PES_packet 0 of private_stream_l is extended and data_byte is extended to store an elementary stream of an encoding method not defined in MPEG.
• PES_packet 0 of PES_packet 0 of private—stream— 1 is described as private—streaml—PES—payloadO.
• Figure 24 shows the private_stream and PES_payload () syntax.
• Private—streaml—PES_payload 0 is composed of private_header 0 and private_payloadO.
• Private_payload () stores an elementary stream of an encoding method not defined in MPEG, such as an ATRAC audio stream, LPCM audio stream, or subtitle stream.
• private—stream—id is identification information that identifies the elementary stream stored in private—payloadO.
• the value is as follows according to the attribute. That is, Fig. 25 shows the relationship between the value of private_stream_id and the attribute of the elementary stream stored in private_payload 0. In Fig. 25, three patterns of OOOOxxxxB, OOOlxxxxB, and ⁇ Is adopted as the value of. “X” represents an arbitrary value of 0 or 1 as in the case of FIG. According to FIG.
• the private—st reaml—PES—payload 0 private—st ream—id in which the ATRAC audio stream is stored in private_payload 0 is OOOOxxxxB.
• the private stream identifier stored in private_payload () is stored in private_payload ().
• FIG. 23 the relationship between FIG. 23 and FIG. 25 is summarized as described above in FIG.
• a reserved—for_future_use (8 bits) for future expansion is placed, and then AU_locator ( 16 bits) is placed.
• Allocator indicates the start position of the audio access unit of the ATRAC audio stream stored in private—payloadO, based on the position immediately after the AU_locator. If there is no audio access unit in private_payload (), for example, OxFFFF is described in AU_locator.
• fs_f lag (1 bit
• Ch_flag bits re erved— for— future one use
• AU_locator (16 bits).
• fs_flag indicates the sampling frequency of the LPCM audio stream stored in private_payload (). That is, for example, when the sampling frequency is 48 KHz, fs_flag is 0, and when the sampling frequency is 44. 44 ⁇ , fs_flag is 1.
• c flag indicates the number of LPCM audio stream channels stored in private_payload (). For example, if the LPCM audio stream is mono If the LPCM audio stream is stereo, ch_flag is 2. i
• AU_locator indicates the start position of the audio access unit of the LPCM audio stream stored in priVa- te_payload () with the position immediately after the AU-locator as a reference. If there is no audio access unit in private_payload (), for example, OxFFFF is described in AUJocator.
• Allocator indicates the start position of the caption access unit of the caption stream stored in private_payload () with the position immediately after AU_loc at or as the reference.
• Fig. 26 shows the syntax of private-stream2_PES_payload ().
• pr i vat e_str eam2_PES_pay load is the private_stream—2 PES—packet () PES—packed and expanded data—byte (Fig. 2 1 A and Fig. 2 1 B), ie private_stream_2 This is an extended PES_packet data_byte of PES_packet 0, which describes information used for decoding the video stream.
• PES-packet () of private-stream_2 is arranged immediately before the decoding start possible point in the video stream. Therefore, in this embodiment, the PE of private stream 2 from the program stream If S_packet () is found, decoding can be started from the video stream immediately after that.
• the RPN_EP one start of EPjnapO in Fig. 16 mentioned above indicates the start position of PES-packet 0 of private_stfeam_2 for the bidet stream.
• PES_payload is preceded by reser ved_for_future_use (8 bits) for future expansion, followed by video_s tream_ id (8 bits), IstRef— picture (16 bits), 2ndRe and picture ( 16 bits), 3rdRef—picture (16 bits), 4thRef_picture (16 bits), au_information (), and VBI0 are arranged in sequence.
• video—stream—id field, private—stream_2 PES—packet 0 immediately after stream 0 The same value as the stream—id field of PES_packet () of the video stream to be arranged is described.
• This video_stream_id identifies PES-packet 0 in which a video stream to be decoded using information stored in private_stream2-PES-payloadO of PES_packet 0 of private-stream-2 is specified.
• IstRe picture, 2ndRef—picture, 3rdRef_picture, 4thRef_pic tu re is a private stream in the video stream identified by video_streaffl_id, private_stream—20PES_packe tO
• the position of the last packO including the 2nd, 3rd and 4th reference images is expressed as a relative value.
• For IstRe picture, 2ndRef_picture, 3rdRe picture, 4thRe picture see, for example, JP-A 09-46712 (Japanese Patent Application No. 07-211420), bytes one to_f irs and P pic by tes to_second_P— The details are disclosed as pk.
• au—informationO contains a private stream stream 2 PES—packet 0 to the next 01 ” ⁇ & 16_5 6 & 111—2 video stream from £ 3_03 ⁇ 10 Information about the deaccess unit is described. Details of au-informationO will be described later with reference to Fig. 27. 5 VBI0 is used to describe Closed Caption information.
• PES_packet () of private_stream_2 having 73 ⁇ 4private_stream2-PES-payloa ⁇ 10 is arranged for each decoding start possible point for each video stream.
• Fig. 27 shows the au_information () syntax of Fig. 26.
• length (16 bits) is placed at the beginning of au_information (). length represents the size of au_informat ionO including it. Following length, reserved—for—word—alignment (8 bits) and number—of—access—unit (8 bits) are arranged in sequence. reserved—for—word—al ignment is used to take a door line.
• number—0 and access—unit represent the number of video access units included between PES—packet 0 of the private—stream—2 that includes it and PES_packet 0 of the next private_stream_2.
• ⁇ ber— 0 and access unit are private_stream2—PES—pay load 0 in Figure 26 in PES—packet 0 of private—stream—2 with the same video—stream—id.
• PES pay load 0 in Figure 26 in PES—packet 0 of private—stream—2 with the same video—stream—id.
• the video Indicates the number of access units (pictures) included in the video stream ⁇ indicated by stream_id.
• the content of the for loop is allocated as many as the number—o and access—unit. That is, PES of private stream 2 including number—0 and including access_unit—packet 0 force, the next private stream 2 Information about each of one or more video access units included up to PES_packet () is arranged.
• the information placed in the i! for loop (information related to the video access unit) is as follows.
• pic_struc and copy (4 pits), au_re and fl ag (1 bit), AU_length (21 bits) and reserved are arranged in the for loop.
• pic_struct_copy is defined in IS0 / IEC 14496-10, D.2.2, which is set for the corresponding video access unit when the video stream is MPEG4-AVC (IS0 / IEC 14 496-10). A copy of 'pic_struct () is described. Note that pic_struct 0 is information such as displaying a picture as a frame, or displaying a top field of a picture and then displaying a bottom field.
• a struct is used as display method instruction information for instructing a display method for displaying a picture.
• the pic_struct table in Fig. 28 when a picture is instructed to display one frame, the pic_struct of that picture is shown in the leftmost Value column in Fig. 28. 0 is set as shown. Similarly, when a picture indicates that a top field or a bottom field is to be displayed, 1 or 2 is set in the pic_struct of the picture. In addition, when the picture is instructed to display the top field and the pottom field in that order, the pic_struct of that picture is set to 3, and the bottom field and the top field are displayed in that order. To indicate that the pic struct is set to 4. Ma If the picture indicates that the top field, bottom field, and repeated top field are displayed in that order, the pic_struct for that picture is set to 5, bottom field, top field, and repeat. The pic-struct is set to 6 to indicate that the bottom field should be displayed in that order. Furthermore, when a picture is instructed to be displayed twice or three times, 7 or 8 is set in the pic_suct of the picture.
• the au flag indicates whether or not the corresponding access unit is a reference image that is referenced when decoding other access units. If it is a reference image, the flag is set to 1. Is set to 0.
• AU-length indicates the size of the corresponding access unit in bytes.
• FIG. 29 to FIG. 32 show specific examples of the format data recorded on the disc 10 1 of FIG. 1 as described above. Therefore, in FIGS. 29 to 32, MPEG2-Video is adopted as the video stream, and ATRAC audio stream is adopted as the audio stream.
• the video stream and the audio stream are not limited to this. That is, for example, MPEG4-Visual or MPEG4-AVC can be employed as the video stream.
• MPEG1 / 2/4 audio or LPCM audio stream can be adopted as the audio stream.
• the subtitle stream is a video stream or audio stream. Unlike video, continuous decoding and display are not always performed at the same interval. That is, the subtitle stream is occasionally transmitted from the buffer control module 2 1 5 of FIG. 2A and FIG. 2B to the subtitle decoder control module '2
• FIG. 29 shows a specific example of the “PLAYLIST.DAT” file described in FIG.
• number_o and PlayLists are 2, so that the number of PlayListO included in the “P LAYtiST.DAT” file is 2.
• the first of the two PlayListOs is described as PlayList # 0 and the second is PlayList # 1.
• PlayList # 0 which is the first PlayList 0
• capture_enabl e_flag_PlayList is 1, and therefore secondary use of video data to be played back according to PlayList # 0 is permitted.
• number_o and Playstems are 2, so that the number of Playstem () included in PlayList # 0 is 2.
• Playl tem # 0l which is the first Playl temO included in PlayList # 0 is the Clip-Information1 file_name described in Fig. 8 "00001. CLP", In_time is 180,090, 0UT_Ume is 27, 180 and 090 respectively. Therefore, the clip reproduced by PI ayl temitO of PlayList # 0 is from the time 180,090 to 27,180,090 of the clip stream file “00001.PS” corresponding to the clip information file “00001.CLP”.
• Playlt'em # l which is the second PlayltemO included in PlayList # 0
• the Clip— Information_nie one name explained in Figure 8 is “00002.CLP”
• I 11 — 1116 is 90,000
• OUT—time Are 27, 090, 000, respectively. Therefore, the clip played by PI ayltem # l of PlayList # 0 is from the time 90,000 to 27,090, 000 of the clip stream file “00002.PS” corresponding to the clip information file “00002 CLP”.
• PlayList # 1 which is the second PlayListO
• capture_enable_flag_PlayList is 0, so secondary use of video data played back in accordance with PlayList # 1 is permitted. It has not been.
• number-o and Play Items are 1, so that the number of Play systems () included in PlayList # 1 is 1.
• Play Item # 0 that is one Play Item 0 is described below the “PlayList # l” column.
• FIG. 30A and FIG. 30B show specific examples of the clip information file ClipO described in FIG. That is, FIG. 30 and FIG. 30 show specific examples of the clip information files “00001. CLP”, “0000 2. CLP”, “00003. CLP” in FIG.
• the presentation star is 90,000
• the present_ion_end_time is 27,990,000. Therefore, according to the program stream stored in the clip stream file “00001.PS” corresponding to the clip information file “00001. CLP”, 310 seconds ((27, 990, 000-90, 000) / 90kHz) content is available.
• capture_enable_flag_Clip is 1, so that the program stored in the clip stream file “00001.PS” corresponding to the clip information file “00 001.CLP” Secondary use of the video stream multiplexed in the stream is permitted.
• the number_o stream in the clip information file “00001.CLP” is 4, and is therefore stored in the corresponding clip stream file “00001.PS”.
• four elementary streams are multiplexed in the product stream.
• this video stream stream # 0 is a video data that has a frame period of 29.97 Hz and includes a closed caption data that is 720 ⁇ 480 pixels.
• stream_id is OxBD and private_stream_id is 0x00. Therefore, the elementary stream stream # l is an ATRAC audio stream as described in FIGS. 23 and 25.
• the audio_language code power of StaticInfoO (Fig. 14) included in the StreamlnfoO ' ⁇ ⁇ , channel—conf igurat ion power STEREO' ⁇ 1 fe— existence power NO 't, sampling — frequency power' 48 kHz '(This is, respectively. Therefore, this ATRAC audio stream streaffl # U is in Japanese and stereo audio.
• the low-frequency emphasis channel is not included, and the sampling frequency is 48 kHz Furthermore, the ATRAC audio stream, which is the second element list stream of the clip stream file “00001.PS” For #l, the numbe of—SemilnfoO (Fig. 12) of— Dynami clnfo is 0, and there is no set of pts_change—point and DynamicInioO.
• this elementary stream streamn is a subtitle stream, as described in FIG. 23 and FIG.
• subtitle stream stream # 2 which is the third elementary stream of clip stream file “00001.PS”
• the subt it le_language_code of StaticlnfoO (Fig. 14) included in the StreamlnfoO is “Japanese”.
• configurable_nag is 0, respectively. Therefore, the subtitle stream streani # 2 is Japanese subtitle data, and it is not permitted to change the display method.
• the number_ofJ) ynainicInfo in Stream InfoO (Fig. 12) is 0, and pts There is no set of _change_point and Dynamic.
• this element stream stream # 3 is a subtitle stream as described in FIGS. 23 and 25.
• private_stream_id is 0x80 and 0x81.
• this subtitle stream stream # 3 is Japanese subtitle data, and it is permitted to change its display method.
• the number_o and Dynamiclnfo in Stream InfoO are 0, and pts —change A set of one point and Dynamic In ⁇ 0 f.
• the presentation_star time is 90,000, r 6361 ⁇ & 011-611 (1_ “1116 is 27 Therefore, according to the program stream stored in the clip stream file “00002.PS” corresponding to the clip information file “00002 CLP”, 300 seconds (( 27, 090, 000-90, 000) / 90kHz) is available. Also, in the clip information file “00002 CLP”, the capture-ena flag flag_Clip is 0, so the clip information file "00 002. Secondary use is not permitted for video streams multiplexed in the program stream stored in the clip stream file “00002.PS” corresponding to “002. CLP”.
• the clip information file “00002” CLP has a number — 0 and streams is 4, and therefore, the corresponding clip stream file “00002.PS” As in the case of the clip stream file “00001.PS” described above, four elementary streams are multiplexed in the stored product stream. .
• the contents of the 5 6 amlnfoO of each of the first to fourth element list streams 5 6 & 111 # 0 to # 3 of the clip stream file “00002.PS” are the clip stream file “00001.PS”.
• the first elementary stream stream # 0 of the clip stream file "00002.PS” is the same as the contents of Streamlnfo () of each of the first to fourth elementary streams stream # 0 to # 3.
• the second elementary stream streamifl is an ATRAC audio stream.
• the third elementary list sream # 2 and the fourth elementary stream stream # 3 are both subtitle streams.
• the clip information file “00003. CLP” has a presentation_star time of 90,000 and a presentation_end_time of 81,090,000. Therefore, according to the program stream stored in the clip stream file “00003.PS” corresponding to the clip information file “00003. CLP”, it is 90 seconds ((81, 090, 000-90, 000) / 90kHz) In the clip information file “00003. CLP”, the capture_enable—flag—Clip is set to 1. Therefore, the clip stream file corresponding to the clip information file “00 003. CLP” Secondary use of the video stream multiplexed with the program stream stored in “00003.PS” is permitted.
• the number_o stream in the clip information file “00003.CLP” is 3, and is therefore stored in the corresponding clip stream file “00003.PS”.
• three elementary streams are multiplexed in the program stream.
• the three elementary streams are stream # 0, stream # l, and stream # 2, in Fig. 30A and Fig. 30B, the three elementary streams streamitO, stream # l, Specific examples of streamlnfoO (Fig. 12) for each of s tream # 2 are listed below the "00003. CLP" column.
• the stream_id is OxEO
• the elementary stream stream # 0 is 2 "As described in Fig. 5 (or Fig. 1 3), it is a video stream. Note that, like the first stream stream # 0 of clip stream 'file" 00001.PS ", pr ivate One s tream—id is 0x00.
• the pict3 ⁇ 4re_size of StaticInfoO (Fig. 14) included in the streamlnfoO is '7 20X480'.
• frame_rate is '29 .97Hz 'and cc——ag is' No'. Therefore, this video stream stream # 0 is video data of 720X480 pixels with a frame period of 29.97 Hz, and does not include a closed caption.
• stream stream # 0 which is the first element list stream of clip stream file “00003.PS”
• the number_o and Dynamiclnfo of Stre amlnfoO (Fig. 12) are set to 2.
• StreamlnfoO two sets of pts—change—point and Dynamiclnfo 0 are described.
• this elementary stream stream # l is the second stream stream #l. As described in Fig. 3 and Fig. 25 (or Fig. 13), it is a video stream. Note that the video stream stream # 0, which is the first elementary stream of the clip stream file “00003.PS”, is distinguished from the video stream stream # l, which is the second elementary stream. For this reason, each stream id is OxEO and OxEl. Similarly to the first elementary stream stream # 0 of the clip stream file “00001.PS”, private_stream-id is 0x00 '.
• the video stream streamitl which is the second element list stream of the clip stream file “00003.PS”
• this elementary stream stream # 2 is an ATRAC audio stream as described in FIGS. 23 and 25.
• the frequency is the same as that of the ATRAC audio stream stream # l, which is the second elementary stream of the clip stream file “00001. PS”. Therefore, the ATRAC audio stream, which is the third element list of the clip stream file “000 03. PS”, is Japanese and stereo audio data. Also, the low frequency emphasis channel is not included and the sampling frequency is 48kHz.
• the ATRAC audio stream st'ream # 2 which is the third element stream of the clip stream file “00003.PS”, is set to the number 1 of StreamlnfoO (Fig. 1 2) and Dynamiclnfo 3 Therefore, three sets of pts—change—point and DynamicInfoO are described in the StreamlnfoO.
• FIG. 31 shows a specific example of EPjnapO in the clip information file Clip 0 described in FIG. That is, FIG. 31 shows a specific example of EPjnapO of FIG. 16 in the clip information file “00001.CLP” of FIG.
• EPjnapO's number_o and stream-id- entries are 1, so this EPjnapO describes the information of the decoding start possible point for one element list stream.
• EP_map () in Fig. 31 stream_id is OxEO. Therefore, as explained in FIG. 23 and FIG. 25, EPjnapO contains RAPI (Random Access Point Information), which is the decoding start point for the video stream specified by stream_id which is OxEO.
• RAPI Random Access Point Information
• FIG. 31 shows the EP map () of the clip information file “00001.CLP”, which corresponds to the clip information file “00001.CLP”.
• the elementary stream whose stream_id is OxEO is the first stream of the clip stream file “00001. CLP” as explained in Fig. 30A and Fig. 30B. Since the video stream is stream # 0, the information described in EP_map () in Fig. 31 is the PTS—EP—start and RPN—EP of the video stream stream # 0 that can be decoded. — St ar t.
• RPN_EP_start, PTS_EP_start, IstRef—Picture, 2ndRe, Picture, 3rdRe, Picture, 4thRe, and Picture are in-line structures that are placed immediately after RAPI, in addition to the start position of all RAPIs multiplexed in the multiplexed stream. And the end positions of the second, third, and fourth reference images are shown.
• the position of the first RAPI is 0 (sector), and the PTS of the immediately following intra picture is 90,000.
• the end positions of the corresponding intra picture and the second, third, and fourth reference images are 28, 37, 48, and 58, respectively, in terms of the relative number of sectors from the top of the RAPI.
• the position of the second RAPI is 244 (sectors), and the PTS of the immediately following intrastructure is 135,045.
• the end positions of the corresponding intra picture and the second, third, and fourth reference images are 10, 18, 25, and 31, respectively, in terms of the relative number of sectors from the top of the RAPI.
• the third RAPI is located at 305 (sectors), and the immediately following infrastructure PTS is 180,090.
• the end position of the corresponding intra picture and the second, third, and fourth reference images are the start of RAPI. These relative sectors are 25, 44, 50, and 54, respectively.
• the fourth RAPI position is 427 (sectors), and the PTS of the immediately following picture is 225,135.
• the end positions of the corresponding intra-picture and the second, third, and fourth ⁇ reference images are 8, 15, 22, and 29, respectively, in terms of the relative number of sectors from the top of the RAPI.
• the position of the fifth RAPI is 701 (sector), and the PTS of the immediately following intra picture is 270, 180.
• the end positions of the corresponding intra picture and the second, third, and fourth reference images are 26, 32, 41, and 48, respectively, in terms of the relative number of sectors from the top of the RAPI. '
• N-th 1 Re-picture_copy is a specified number of sectors out of the four reference picture end positions (IstRe, Picture, 2ndRe, Picture, 3rdRe, Picture, 4thRe, Picture). A value close to the number of sections is stored. In Fig. 31, the sector closest to "30" is selected.
• N-th_Re and picture_copy are selected from 28, 37, 48, and 58, which is closest to “30”.
• index—Njninusl stores the value “0” indicating IstR e and picture. Yes.
• PTS_EP_start 135,045
• RPN_E P_start 244.
• N-th—Re and picture_copy 31 closest to “30” is selected from 10, 18, 25, and 31.
• index_N— minusl stores the value “3” indicating 4thRe and picture. ing.
• the index_N— minus J and N-th one Re_picture_copy for the five entries in the example in Fig. 3 1 are (0, 28), (3, 31), (0, 25), (3, 29 ), (1, 32) are stored.
• This selection algorithm is comprehensive, including playback quality on playback equipment. Determined by taking into account. Therefore, in this embodiment, the closest one to the relatively small number of sectors “30” is selected, but other numbers of sectors may be used. Also, when the value of index—Njninusl is small, the number of reference images included in the data is the same as the number of picture_copy when N-th_Re is read from the position of RAP I. When the value of --minusl is large, it means that there are many reference images included. In addition, in the example, the end positions of 4 reference images are described in all 5 points of data. Depending on the video encoding method or intra-picture interval, there may be less than 4 reference images.
• Fig. 32 shows a specific example of PlayListMarkO in PlayList # 0 and PlayList # 1 (PlayList 0 in Fig. 7) explained in Fig. 29.
• the upper side of Fig. 32 shows the P of PlayList # 0. 1 ayL is tMark 0 (Fig. 9).
• num ber_o and PlayLis and marks in PlayListMarkO of PlayList # 0 are 7, and therefore, the number of MarkO included in PlayListMarkO of PlayList # 0 is 7.
• Mark # 0 which is the first MarkO of 7 Mark () included in PlayList # 0 has mark_type (9th ⁇ ) as 'Chapter'. Chappu evening mark.
• Mark # 0 Re_to_P lay It em— id (Fig. 9) is 0, so PlayItem # 0 of PlayItem # 0 and # 1 in Fig. 29 included in PlayList # 0 Belongs.
• Mark_0 since Mark_0 has mark_time_sta immediately 180, 090, the time of the clip stream file played by PI ayl temifO included in PlayList # 0 (play time) is a mark on 180, 090. is there.
• Mark # 0 is not associated with any elementary list because entry-ES-stream-id and entry-ES_private-stream-id are both 0. Mark # 0 represents a chapter with the number 1 because mark_data is 1. '
• the clip stream file that is played back by Play ## 0 included in PlayList # 0 is described in (: 110-11 ⁇ 0111 & 11011_16_11 & 1116) of P1 3 116111 # 0 described in FIG.
• This is the clip stream file “00001.PS” identified from “00001. (: 1 ⁇ ”, and therefore the above-described times 180 and 090 represented by mark_time_stamp of Mark # 0 are the clip stream. It is the time of file "00001.PS”.
• Mark # 4 which is the fifth MarkO of the seven MarkOs included in PlayList # 0 is the same chapter mark as the first Mark # 0.
• Mark # 4 the fifth MarkO, is a chapter mark because mark_type (Fig. 9) is 'Chapter'. Furthermore, since Mark_4 has re_to_PlayItem_id (Fig. 9) set to 1, PlayList # l of PlayItem # 0 and # 1 in Fig. 29 included in PlayList # 0 Belongs. Mark # 4 has a mark_time_stamp of 90,000, so the clip stream file played by P 1 ay 11 em # l included in PlayList # 0 is marked with a mark on time 90,000. is there. Furthermore, Mark # 4 has entry ES_stream—id and entrv ES—private—stream—id, and the deviation is 0. Therefore, it is not associated with any elementary stream. In Mark # 4, since mark_data is 2, ⁇ indicates a chapter whose number is 2.
• the clip stream file played by Playltem # l included in PlayList # 0 is described in (110_11 ⁇ 0111311011_1 ⁇ 16_11 & 1116) of P1 & 116111 # 1 described in Fig. 29.
• This is the clip stream file “00002.PS” specified from the “00002. CLP”. Therefore, the time 90, 000 described by the mark_time_stamp of Mark # 4 is the clip stream file “00002”. .PS "time.
• Mark # l which is the second MarkO among the seven Marks () included in PlayList # 0 has a mark_type (Fig. 9) of 'Index'. It is an index mark. Furthermore, since Mark_l has re_to_PlayItem_id (Fig. 9) set to 0, PlayList # 0 contains two PlayItem # 0 and # 1 included in PlayList # 0. Belongs. Mark # l is a mark on time 5,580,090 of the clip stream file played by Playltem # 0 included in PlayList # 0 because mark_time_sta is immediately 5,580,090. .
• Mark #l is 0 for both entry—ES—stream—id and en try—ES—private—stream—id force s, it is associated with any elementary stream. Not attached. Mark # l is an index with the number 1 because mark-data is 1.
• the clip stream file that is played back by Play ## 0 included in PlayList # 0 is clip stream file “00001.PS”. Therefore, mark_time_st a of Mark # l
• the above-mentioned times 5, 580, and 090, which are expressed immediately, are the times of the clip stream file “00001.PS”.
• Mark, Mark # 5, Mark '# 6, which are the third, sixth, and seventh MarkO of the seven MarkOs included in PlayList # 0 are also the second Mark # l. It is a similar index mark.
• Mark # 3 the fourth MarkO of the 7 Mark () included in PlayList # 0 has a mark_type (Fig. 9) of 'E vent' The event mark.
• Mark # 3 has re_to_Play It em—id (Fig. 9) is 0, so PlayList # 0 includes two PlayItems # 0 and # 1 in Fig. 29. Belongs to PlayltemifO.
• Mark # 3 is a mark on the time 16,380,090 of the clip stream file that is played back by Pyltem # 0 included in PlayList # 0 because mark_time_stamp is 16, 380, 0'90.
• Mark # 3 is not associated with any elementary stream because entry-ES-stream-id and entry-ES-private-stream_id are both 0.
• Mark # 3 generates an event with 0 as an argument because mark_data is 0.
• the clip stream file reproduced by PI ayltem # 0 included in PlayList # 0 is clip stream file “00001.PS”, and therefore mark # 3 mark — Time—
• the time 16, 380, and 090 described above are the time of the clip stream file “00001.PS”.
• Fig. 32 shows PlayListMarkO (Fig. 9) of PlayListftl.
• the number_PlayList mark in PlayListMarkO of PyList # l is 3, and therefore, the number of MarkO included in PlayListMarkO of PlayList # l is 3.
• Mark # 0 which is the first MarkO of the three MarkOs included in PlayList # l, has mark_type (Fig. 9) set to' Chapter '. It is a chapter mark.
• Mark # 0 belongs to one PlayItem # 0 of FIG. 29 included in PlayListitl because ref_to_PlayItem_id (FIG. 9) is 0.
• Ma_rk # 0 since Ma_rk # 0 has mark_time_stamp of 90,000, it is a mark on the time 90,000 of the crib stream file reproduced by Platform # 0 included in PUyList1. Further, Mark # 0 is not associated with any elementary stream because en y—ES—stream_id and entry_ES_private—stream_id are both 0. Mark # 0 represents a chapter with the number 0 because mark_data is 0.
• the clip stream file played back by PlayItem # 0 included in PlayList # l is described in CI ip_Infomation_file_name of Play System # 0 described in FIG. 29. Therefore, the above-mentioned time 90, 000 represented by mark_time_sta of Mark # 0 is the time of the clip stream file “00003.PS”. .
• Mark # l which is the second MarkO of the three MarkOs included in PlayList # l, is an event mark because mark_type (Fig. 9) is 'Event'. . Further, since Mark_l has re_to_PlayItem_id (FIG. 9) set to 0, it belongs to one PlayItem # 0 of FIG. 29 included in PlayList # l. Also, since Mark # l has mark_tim_sta immediately 27, 090, 000, P yl included in PlayList # l This is a mark on the time 27,090,000 of the clip stream file played by tem # 0.
• Mark_l since Mark_l has entry_ES—stream_id ⁇ ) ′ and entry_ES—private—stream—id force 0, the stream—id force 0x Element stream specified by EO, that is, the second As described in Fig. 3 and Fig. 25, it is associated with a video stream. Mark # l also generates an event with 1 as an argument because mark-data is 1.
• the clip stream file played by PlayItem # 0 included in PlayList # l is “clip stream file“ 00003.PS ”. Therefore, mark_time_stam p of Mark # l The times 27, 090, and 000 described above are the times of the clip stream file “00003.PS”.
• the video stream associated with Mark # l and stream_id of OxEO is described in CI ip_Infomation-file_name of Playltem # 0 included in PlayList # l in Fig. 29 to which Mark # l belongs.
• Mark # 2 which is the third MarkO of the three MarkOs included in PlayList # l, has the mark_type (Fig. 9) set to 'Ev ent'. The event mark. Furthermore, Mark # 2 belongs to one PlayItem # 0 of FIG. 29 included in PlayList # l because ref_to_PlayItem_id (FIG. 9) is 0. Mark # i is included in PlayList # l because ma rk "11 ⁇ _51311 ⁇ is 27, 540,000. This is a mark on time 27, 540, 000 of the clip stream file played by PlayItem # 0.
• Mark_2 since Mark_2 has entry_ES_stream_id of OxEl and entry_ES_private—stream_id force of 0, the elementary stream specified by stream—id is OxEl, ie, FIGS. 23 and 25. As described in, it is associated with a video stream. In Mark # 2, since mark_data is 2, an event with 2 as an argument is generated.
• the clip stream file that is played back by PlayItem # 0 included in PlayList # l is “clip stream file“ 00003.PS ”, and is therefore represented by Mark # 2.
• the time 27, 540, 000 described above is the time of the clip stream file “00003.PS”.
• the video stream associated with Mark # 2 and whose stream_id is OxEl is included in the PlayListlfl of Fig. 29 to which that Mark # 2 belongs.? 1 & 116111 # 0 (: 110_11 ⁇ 01 ⁇ 11011_ ⁇ 16-1 ⁇ 1116 Describes the video stream whose stream_id is OxEl described in "00003. CLP", that is, the clip information file of Fig. 30 A and Fig. 30 B "00003.
• the time from the beginning of PlayltemO to which MarkO belongs is shown on the right side of the list of PlayListMarkO of PlayList # l.
• Fig. 32 the number of the chapter index represented by the chapter mark or index mark is described in mark_data, but the number of the chapter index represented by the chapter mark mark index is shown.
• the number can be recognized by counting the number of chapter marks in PlayListMarkO without being described in mark-data.
• a time stamp is always added to the access unit of the video stream at the decoding start position. That is, as described later in “Preparation for playback”, the decoding start position is searched using EP_map () for the maximum PTS_EP_start that satisfies the expression PTS_EP_start ⁇ IN_time using a binary search or the like. ing. A time stamp is always added to the access unit immediately after the playback start position of the video registered in EPjnapO.
• pic_struct 7 and 8 are not generated.
• i-Nen Playback Program 2 1 0 receives the message from the operating system 2 0 1 that the disc 1 0 1 has been inserted into the disc drive 1 0 2 and performs the pre-play processing shown in Fig. 3 3 Start.
• FIG. 33 is a flowchart for explaining pre-reproduction processing performed by the video content reproduction program 2 10.
• the operation or processing of the disc playback apparatus described below with reference to the flowcharts does not necessarily have to be performed in chronological order in the order described in the flowcharts, and may be performed in parallel or individually.
• the operation or processing of the disc playback apparatus will be described with reference to a flowchart.
• the video content playback program 2 1 0 checks the disc 1 0 1 using the file system function of the operating system 2 0 1 in step S 1 0 1 and It is determined whether 0 1 is a normal disc for the video content playback program 2 10.
• step S 1 0 1 access to the disk 10 1 (reading of the file) is performed using the file system function of the operating system 2 0 1, but the description thereof will be omitted as appropriate below. If it is determined in step S 1 0 1 that the disk 1 0 1 is not a normal disk, for example, the file system used for the disk 1 0 1 is not supported by the operating system 2 0 1 Type, or the “VIDEO” directory in the root directory. If the video content is not placed, it is determined that the video content playback program 2 1 0 is not compatible with the disc 1 0 1, and the process proceeds to step S 1 0 * 2, where the graphics processing module 2 1 9 Execute 'and finish the pre-play processing.
• the graphics processing module 2 19 generates an error message indicating that the disc 100 is not normal as an error process, and outputs it from the video output module 2 20, thereby displaying the error message.
• error processing for example, it is possible to output warning sound from the audio output module 2 2 1, eject the disk 1 0 1 from the disk drive 1 0 2, etc. It is.
• step S 1 0 1 determines whether the disc 1 0 1 is a normal disc. If it is determined in step S 1 0 1 that the disc 1 0 1 is a normal disc, the process proceeds to step S 1 0 3, where the video content playback program 2 1 0 is the content data supply module 2 1. 3 for the operating system 2 0 1, the “SCRIPT. DAT” file located in the “VIDEO” directory on disk 1 0 1 (Fig. 6) and the “PLAYL I ST. DAT” file. Request and read one data file and go to step S 1 0 4. In step S 1 0 4, the “S CRIPT. DAT” file is supplied to the script control module 2 11, and the “PLAYL I ST. DAT” file is supplied to the player control module 2 1 2.
• step S 1 0 4 to S 1 0 5 to S 1 0 7, and the player control module 2 1 2 performs initialization processing.
• the script control module 2 1 1 waits until the initialization process of the player control module 2 1 2 is completed.
• step S 1 0 5 the player control module 2 1 2 analyzes the “PLAYLIST.DAT” file and uses the clip information file used in the “PLAYLIST.DAT” file. Investigate the number of files and their file names.
• the “PLAYLIST.DAT” file is as shown in FIG. 29, and the player control module 2 1 2 performs number_o in the “P LAYLIST.DAT” file of FIG. Since ists is 2, it recognizes that there are two Play ListOs, the first PlayLis 0 and the second PlayList # l. Furthermore, the player control module 2 1 2 has a Playltems force of 2 for the first Play List # 0 in the “PLAYLIST.DAT” file in FIG. 29, so that ⁇ ayL is In 0, it is recognized that there are two PlayltemOs, a first Playltem # 0 and a second Playltain # l.
• the player control module 2 1 2 has the CI of the first PlayItem # 0 and the second PyItem # l included in P1 ayList # 0 in the “PLAYLIST.DAT” file of FIG. ip—
• the clip information file of the first PlayltemitO included in PlayList # 0 is “00001, CLP”
• the clip information file of the second Play It em # l is “00002” CLP ".
• the player control module 2 1 2 also has the same Punilist_l and Playltems 1 for the second PyList # l, so there is one P1 ayltemO (PlayItem # 0), and that PlayItem # 1 CI ip_InformaUon in 0— ⁇ le_name force, etc. Recognizes that the clip information file of the Pyl temifO is “00003. CLP”.
• step S 1 0 5 the player control module 2 1 2 recognizes from the disk 1 0 1 in step S 1 0 5.
• the clip information files that is, three clip information files “ooooi.c LP”, “00002 CLP”, “00003 CLP” are read from the “CLIP” directory in the “VIDEO” directory of the disc 1001.
• step S 1 06 the process proceeds to step S 1 0 7, where the player control module 2 1 2 determines whether or not the clip information file recognized in step S 1 0 5 has been successfully read. It is determined whether or not a clip stream file corresponding to the read clip information file exists on the disc 1001. That is, in step S 1 0 7, the clip information files “00001. CLP”, “00002. CLP”, “000 03. CLP” are successfully read, and the clip information files “00 001. CLP”, “ 00002. CLP ",” 00003: CLP "is a clip stream file” 00001.PS ",” 00002.PS ",” 00003.PS "that differs only in the file name extension. Determine if it exists in the "ST REAM" directory under the directory.
• step S 1 0 7 it is determined that reading of the clip information file recognized in step S 1 0 5 has failed, or the clip stream file corresponding to the clip information file does not exist on the disc 1 0 1 In other words, for example, if the clip information file required for playback according to the “PLAYLIST.DAT” file is not recorded on the disc 1 0 1, the video content playback program 2 1 0 corresponds to disk 1 0 1 If not, the process proceeds to step SI 02, where the error handling described above is performed, and the pre-reproduction process is terminated.
• step S 1 07 it is determined that the clip information file recognized in step S 1 0 5 has been successfully read and that the clip stream file corresponding to the clip information file exists on the disc 1 0 1. If it is determined, the player control module 2 1 2 ends the initialization process, and proceeds to step S 1 08.
• step S 1 08 the script control module 2 1 1 starts to interpret and execute the “SCR IPT.DAT” file.
• the script control module 2 1 1 executes the “SCRIPT.DAT” file
• the player control module 2 1 2 is instructed to play the first PlayList 0 (PyList # 0). Then, the reproduction process shown in FIG. 34 is performed.
• FIG. 34 is a flowchart for explaining the reproduction process performed by the video content reproduction program 2 10.
• the player control module 2 1 2 first plays the PlayListO in which the playback is instructed in steps S 1 2 1 and S 1 2 2, that is, the first PlayList 0 ( P yList # 0) playback preparation processing is performed.
• the player control module 2 1 2 confirms the IN—Ume (FIG. 8) of the first PlayItem # 0 included in the first PlayList # 0 in step S 1 2 1, and the step S 1 2 Proceed to 2 and correspond to the IN time of the PlayItem # 0 on the clip stream file “00001.PS” played by the first PlayItem # 0 included in the first PlayList # 0.
• IN_time of PlayltemO ( Figure 8) is, when pointing to the beginning of the clip string J arm file, from the beginning of the clip stream file I le, but may be read the program stream
• IN_tim e is, When pointing to a position other than the beginning of the clip stream file, it is necessary to detect the position corresponding to IN-time and read the program stream from there.
• IN_time of the first PlayItem # 0 included in the first PyList # 0 is 180,090.
• the layer control module 2 1 2 is the EP_map shown in Fig. 31 of the clip stream file “00001. CLP” played by the first Playltem # 0 included in the first PlayList # 0. From (), the playback start position suitable for 180,090, which is the IN_time of PI ay 11 em # 0, is found.
• the player control module 2 1 2 performs, for example, a binary search (binary search) of the maximum PTS—EP_start that satisfies the expression PTS—EP_sart ⁇ IN_time, among the PTS_EP_starts representing the decoding start possible points described in EPjnapO. ) Search using etc.
• PTS_EP_start below IN_time is searched because the position represented by IN-time is not necessarily the point where decoding can start.
• IN-time is 180, 090 as described above.
• the expression PTS—EP_start 180,090 are described as the maximum PTS that satisfies ⁇ IN_time, EP, and s tart. Therefore, in the player control module 2 1 2, the PTS—EP start corresponding to 180,090 is searched from the EPjnapO shown in FIG.
• the player control module 2 1 2 determines the playback start position as described above, it proceeds from step S 1 2 2 to S 1 2 3 and controls the graphics processing module 2 1 9 to display the time code. .
• the graphics processing module 2 1 9 generates a time code and outputs it to the video output module 2 2 0 according to the control of the player control module 2 1 2. Thereby, the display of the time code is started.
• the time code whose display is started in step S 1 2 3 is, for example, a value obtained by converting the top of PlayListO to 00:00:00 (hour: minute: second).
• the number of the chapter index may be displayed together with the time code or not the time code.
• step S 1 2 4 After the time code display is started in step S 1 2 3, the process proceeds to step S 1 2 4, where the player control module 2 1 2 plays PlayList () instructed to play from the script control module 2 1 1. That is, an analysis process for analyzing PlayListMarkO (FIG. 9) described in the first PlayList 0 (PlayListitO) is performed.
• the player control module 2 1 2 uses the number — o and PlayLis mark in the PlayListMarkO shown in the upper part of FIG. 3 2 of the first PlayListtO in the “PLAYLIST.DAT” file that has already been read. Since it is 7, it is recognized that the number of MarkO included in the PlayListltO is 7.
• the player control module 2 1 2 is included in PlayList # 0 Fig. 32 Analyzing the 7 MarkOs on the upper side, re-to_PlayItem_id, 4 MarkO from 1st to 4th of 7 Mark (), 1st P of PyList # 0 Recognize that he is ashamed of yltemO (PlayltemlO).
• the player control module 2 1 2 extracts the mark_Ume_stamp of four Mark 0 belonging to the first Play ## 0 of PlayList # 0, and sets it as an array of 4 elements to the decode control module 2 1 4 hand over. That is, as a result, the mark_time_stamp of each of the four MarkOs from the first to the fourth of the seven MarkOs on the upper side of FIG. 32 is ⁇ 180, 09 0 ⁇ , ⁇ 5,580,090 ⁇ , ⁇ 10,980,090 ⁇ , ⁇ 16, 380 , 090 ⁇ are passed from the player control module 2 1 2 to the decode control module 2 14.
• the fact that the attribute of these times is “mark processing” is also transmitted from the player control module 2 1 2 to the decode control module 2 14.
• the decode control module 2 14 matches the time of the “mark processing” attribute message. Tell the player control module 2 1 2 of the time and the “mark processing” attribute.
• step S 1 24 proceeds from step S 1 24 to S 1 25 and the player control module 2 1 2 determines the elementary stream to be reproduced.
• the player control module 2 1 2 sets the CI ip_Informat ion_fime-name of the first PlayltemifO (Fig. 29) in the first PlayListitO that is PlayListO that is instructed to be played from the script control module 2 1 1 In the clip information file "00001. CLP" in Fig. 30A and Fig. 30B where the file name is described, number_o and streams is 4 Therefore, it is recognized that four elementary streams are multiplexed in the corresponding clip stream file “00001.PS”.
• the player control module 2 1 2 performs the stream— of the static information 0 of the clip information file “00001. CLP” of FIG. 30 A and FIG. 30 B for the four elementary lists.
• the number of elementary streams of each attribute multiplexed in the clip stream file is used for switching the elementary stream during playback (audio switching, subtitle switching, etc.).
• the subtitle stream may not exist in the clip stream file (the subtitle is not included in the content), and the subtitle stream attribute element can be used to determine whether a subtitle stream exists. Information on the number of restreams is used.
• the player control module 2 1 2 selects and determines the element list to be played back based on the results of the StaticInfoO survey as described above.
• the player control module 2 1 2 is multiplexed with the clip stream file “00001.PS”. Since there is only one elementary stream with the attributes of “video stream” and “audio stream” among the four elementary streams that have been created, “video stream J” and “audio stream” For an elementary stream with the attribute of, there is no choice, and that single video stream and audio stream (ATRAC audio stream) is the elementary stream to play. As determined.
• the elementary stream with the attribute “subtitle stream” there are two of the four elementary streams multiplexed in the clip stream file “00001.PS”.
• One of the two subtitle streams is selected and determined as the elementary stream to be played.
• the first subtitle stream is selected from the two subtitle streams in the order of appearance in the clip information file “00001. CLP”.
• the player control module 2 1 2 specifies the four elementary streams multiplexed in the clip stream file “00001.PS” by specifying the stream—id and the required pri vat e_st ream. — Do by id.
• the player control module 2 1 2 is an elementary stream having an attribute of “video stream” out of four elementary streams multiplexed in the clip stream file “00001.PS”.
• the video stream is identified by the str earn-id which is OxEO, as described for the clip information file “00001. CLP” in FIGS. 30A and 30B.
• the player control module 2 1 2 is an elementary stream having an attribute of “audio stream” out of the four elementary list streams multiplexed in the clip stream file “00001.PS”.
• the ATRAC audio stream is represented by OxBD as described for clip information file "00001. CLP" in FIGS. 30A and 30B. It is specified by the stream—id that is and the private—stream_id that is 0x00.
• the player control module 2 1 2 includes two elementary streams having the attribute “subtitle stream” in the four elementary streams multiplexed in the clip stream file “00001.PS”.
• Each subtitle stream is divided into stream_id, which is OxBD, private_stream_id, which is 0x80, OxBD, Specified by stream_id and private—strea m_id which is 0x81.
• the clip information file corresponding to the clip stream file is multiplexed into the clip stream file by the combination of stream_id and private_strea m-id described as the main stream of the clip information file.
• the elementary stream can be identified.
• the combination of strea.m_id and private_stream_id is a mechanism provided to extend the multiplexing of MPEG2-System.
• this st ream — id and private_stream_id combination in metadata to identify an elementary list, it is possible to reliably identify an elementary stream.
• the meaning of private_stream_id will be expanded, and even if the number and attributes of the corresponding elementary streams are increased, the current mechanism can be used as it is.
• the MPEG2 standard transport stream PID Packet ID
• the DVD-Video standard defines a sub stream id similar to private_stream—id.
• sub-stream_id is not designed to be described on the database for stream identification, and is fixed for describing 8 or 32 stream information. Because it can only be described in the area (see VI4-49, Table 4.2. ⁇ 2 (VTS-AST_A TRT), VI4-52, Table 4.2. ⁇ 3 (VTS_SPST_ATRT), etc.), it has poor expandability . .
• the combination of stream_id and private-stream_id describes the metadata.
• the clip information file C1 ip () in Fig. 12 describe as many as number_o and the number that can be represented by streams. Therefore, the elementary streams multiplexed in the clip stream file can be described in the clip information file CI ip () regardless of the number (however, the number can be represented by number_o and streams). It is possible to specify from the combination of stream_id and private-stream-id as the generated metadata.
• the combination of stream_id and private_stream id identifies the element list stream multiplexed in the corresponding clip stream file in the clip information file in FIG.
• the combination of stream-id and private_seam_id is also used to specify the elementary stream that describes the information of the start point that can be decoded in EP_map () in Fig. 16, for example.
• step S 1 2 5 the player control module 2 1 2 is the elementary stream to be played back, ie, Control processing of the output attribute of the elementary stream determined to be played in step S 1 2 5.
• the player control module 2 1 2 first outputs the elementary stream to be played, that is, the video stream, ATRAC audio stream, and subtitle stream determined to be played in step S 1 2 5.
• Number_o which represents the number of DynamicInfoO (Fig. 15) in which the attribute is described, and Dynamiclnfo (Fig. 12) are examined.
• the video stream, ATRAC audio stream, and subtitle stream to be played are elementary streams multiplexed in the clip stream file “0 0001.
• PS and their number_o and Dynamiclnfo are As described in “00001. CLP” in FIG. 30 and FIG. 30B, both are 0.
• the player control module 2 1 2 particularly performs the processing for controlling the output attribute of the playback target elementary stream. Not performed.
• step S 1 2 6 After the processing of step S 1 2 6, the process proceeds to step S 1 2 7, and the player control module 2 1 2 performs preparation processing for starting playback of the elementary stream to be played back.
• the player control module 2 1 2 supplies the program stream stored in the clip stream file "00001.PS" in which the elementary stream to be played back is multiplexed to the buffer control module 2 1 5 Initialize buffer control module 2 1 5 before starting.
• the data head pointer stored in the data head pointer storage section 2 3 1 is stored in the data write pointer memory section 2 3 2.
• Data write pointer, video read pointer storage unit 24 1 Video read pointer, audio read pointer storage unit 2 51 1 audio read pointer store, subtitle read pointer storage unit 2 6 2 The same value is assigned to the subtitle read pointer.
• the data head pointer stored in the data start pointer storage unit 2 3 1 and the data write pointer stored in the data write boyer storage unit 2 3 2 are the buffers of the buffer control module 2 1 5.
• 2 1 5 Refers to the same position on A. This means that valid data is not stored in buffer 2 15 A.
• the player control module 2 1 2 supplies stream-id as identification information for specifying the elementary stream to be played back, and private_stream_id to the buffer control module 2 1 5 as necessary. .
• the video stream having the attribute “video stream” of the elementary stream to be reproduced is identified by the stream id that is OxEO, and belongs to the “audio stream” attribute.
• a specific ATRAC audio stream is identified by a stream id that is OxBD, and a private_stream—id that is 0x00, and a subtitle stream with the attribute “subtitle stream” is stream_id that is OxBD, and Private_stream that is 0x80—identified by id.
• the player control module 2 1 2 supplies these stream_id and private_stream_id to the buffer control module 2 1 5.
• the video read function 2 3 3 receives the stream_id from the player control module 2 1 2 as the OxEO for the video stream, s trean ⁇ id Store in register 2 42. Also, the audio read function unit 2 34 converts the stream-id that is OxBD and the private-stream-id that is 0 xOO from the player control module 2 1 2 into the stream-id register 2 5 2 and private_stream_id register 2 5 3 respectively.
• the subtitle reading function unit 2 3 5 converts the stream_id that is OxBD and the private_stream—id that is 0x80 from the player control module 2 1 2 into the “stream—id register 2 6 3 and private_stream_id Remember each of the Regis evenings 2 64.
• the player control module 2 1 2 stores the stream_id and private_stream_id of the element list stream to be played supplied to the buffer control module 2 1 5 for future processing.
• the player control module 2 1 2 uses these stream_id and private-stream_id when a message for requesting stream switching to be described later occurs or for identifying a stream that is currently being reproduced in mark processing to be described later.
• the player control module 2 1 2 initializes the buffer control module 2 1 5 (FIG. 5), and further replays the element list to be played back. W
• the subtitle read function flag storage unit 2 6 1 set “5—sets the subtitle read function flag of the value corresponding to the clip stream file in which the video is multiplexed.
• the subtitle stream is included in the clip stream file “00001.PS” in which the elementary streams to be played back are multiplexed.
• a subtitle read function flag having a value of 1 is set in the subtitle read function flag storage unit 2 61. If the clip stream file in which the elementary stream to be played back is multiplexed does not contain a subtitle stream, the subtitle read function flag storage unit 26 1 has a subtitle read function with a value of 0. A flag is set. In this case, the subtitle reading function unit 2 35 does not perform any particular processing.
• the player control module 2 1 2 is the IN_time of the 15th PlayItem # 0 (FIG. 29) included in the first PlayListSO instructed to be played by the script control module 2 1 1 180, 090 And OUT-time 27, 180, 090 are given to the decoding control module 2'1 4.
• IN—time is used to control the decoding start of a clip that is played by P 1 ay 11 em
• 0UT_time is the decoding end of that clip, and more later. Used to control Pyltem transfer 20.
• the player control module 2 1 2 initializes the instruction of the subtitle stream display method to the graphics processing module 2 19. In other words, the player control module 2 1 2 controls the graphics processing module 2 1 9 so that the subtitle stream display method is, for example, the default display method.
• step S 1 2 7 the player control module 2 1 2 controls the content data supply module 2 1 3, whereby the content data supply module 2 1 3 operates.
• the clip stream file that stores the program stream in which the elementary stream to be played back is multiplexed is read.
• the content data supply module 2 1 3 designates the clip stream file “0 0001. PS” in the “STREAM” directory under the “VIDEO” directory on the disc 1 0 1 (FIG. 6).
• the 305 sector which is the reproduction start position determined in step S 1 2 2 is specified, and the operating system 2 0 1 is requested to read the file.
• the content data supply module 2 1 3 specifies that the data read from the disk 1 0 1 is supplied to the buffer control module 2 15.
• the buffer control module 2 1 5 (Fig. 5) reads the program stream read and supplied from the disk 1 0 1 into the data write bus memory unit 2 3 2 of the buffer 2 1 5 A Write to the position indicated, and increment the data write pointer by the size of the written data.
• the content data supply module 2 1 3 reads the data from the disk 1 0 1 if the buffer 2 1 5 A of the nota control module 2 15 is free, and the buffer Supply to buffer 2 1 5 A of control module 2 1 5 and store it . Therefore, it is assumed that sufficient data is always stored in the buffer 2 15 A.
• step S 1 28 the decode control module 2 1 4 controls the video decoder control module 2 1 6, the audio decoder control module 2 1 7, the subtitle decoder control module 2 1 8, and the buffer 2 1 as the previous stage of the decoding operation. 5 Start reading data from A.
• the video decoder control module 2 1 6 requests data from the video read function unit 2 3 3 of the buffer control module 2 15 (FIG. 5), and the buffer control module 2 1 in response to the request. 5 Passed from buffer 2 1 5
• One video access unit stored in A, PTS and DTS attached to the video access unit (hereinafter referred to as time stamp as appropriate), and right before decoding start point Obtain the pic 1 struc and copy, au re flag, and AU_length which are the information (hereinafter also referred to as additional information) described in PES_packet 0 of the allocated private_stream_2.
• the time stamp is passed from the video decoder control module 2 16 to the decode control module 2 14 every time the video decoder control module 2 16 obtains a video access unit.
• the pic_struc and copy used to update the time below are those passed from the video read function unit 2 33. It can also be used.
• the audio decoder control module 2 1 7 also requests the audio readout function part 2 3 4 of the buffer control module 2 1 5 (Fig. 5), and in response to the request, the buffer control module 2 1 5 Passed, one (ATRAC) audio access unit stored in buffer 2 15 A and the time stamp (PTS, DTS) attached to the audio access unit is obtained.
• the time stamp is passed from the audio decoder control module 2 17 to the decode control module 2 14 every time the audio decoder control module 2 17 obtains an audio access unit.
• the subtitle decoder control module 2 1 8 requests data from the subtitle read function section 2 3 5 of the buffer control module 2 1 5 (Fig. 5), and from the buffer control module 2 1 5 in response to the request.
• One subtitle access unit stored in buffer 2 1 5 A and the time stamp attached to the subtitle access unit are obtained.
• the time stamp is passed from the subtitle decoder control module 2 18 to the decoding control module 2 14 every time the subtitle decoder control module 2 18 obtains a subtitle access unit.
• the buffer control module 2 1 5 to the subtitle decoder control module 2 1 to 8 is not passed. '
• the video decoder control module 2 1 6, the audio decoder control module 2 1 7, and the subtitle decoder control module 2 1 8 each time the buffer control module 2 1 5 is requested to display data.
• the result for the data request is passed to the decode control module 2 1 4.
• the video decoder control module 2 1 6, the audio decoder control module 2 1 7, and the subtitle decoder control module 2 1 8 start reading data from the buffer 2 1 5 A of the buffer control module 2 1 5, The process proceeds from step S 1 2 9 to S 1 3 0 and decoding of the data is started.
• the decode control module 2 1 4 receives the IN_t of the first P layI t em # 0 included in P layList # 0 given from the player control module 2 1 2 in step S 1 2 7. ime 180, 090, video decoder control module 2 1 6, audio decoder control module 2 1 7, subtitle decoder control module 2 1 8, time stamp passed as described in step S 1 29 Based on the above, the video decoder control module 2 1 6, audio decoder control module 2 1.7, and subtitle decoder control module 2 1 8 are instructed to shift the timing if necessary to ensure synchronization.
• the method of instructing the start of decoding by shifting the timing to ensure synchronization is described in, for example, Japanese Patent No. 3496725.
• the video decoder control module 2 1 6, the audio decoder control module 2 1 7 and subtitle decoder control module 2 1 8 Set the minimum value of the time stamps passed from each as the initial value of the time measured by the clock unit 2 1 4 A And start timing Part 2 1 4
• the video decoder control module 2 1 6 receives an instruction to start decoding from the decode control module 2 1 4, and in response to the instruction, the video read function part 2 3 of the buffer control module 2 1 5 (Fig.
• Video decoder 1 1 6 (Fig. 1) for decoding. Further, the video decoder control module 2 1 6 supplies video data obtained as a result of decoding by the video decoder 1 1 6 to the graphics processing module 2 1 9. Thereafter, the video decoder control module 2 1 6 sequentially decodes one video access unit obtained from the video read function unit 2 3 3 of the buffer control module 2 1 5 by the video decoder 1 1 6, and The video data obtained as a result of decoding is supplied to the graphics processing module 2 19.
• the ordering (reordering) of the video is happening for decoding and output.
• the decoding order is I I, BO, P3, B2, P5, B4, but the display order may be B0, U, B2, P3, B4, P5.
• the video decoder 1 1 6 is provided with a decoded picture buffer for storing the decoded image.
• In indicates the nth I picture
• Bn indicates the nth B picture
• Pn indicates the nth P picture.
• the audio decoder control module 2 1 7 also receives an instruction to start decoding from the decode control module 2 1 4, and in response to the instruction, the audio read function unit 2 3 of the buffer control module 2 1 5 (Fig. 5) 1 audio access unit obtained from 4 Decoder 1 1 7 '(Fig. 1) Further, the audio decoder control module 2 17 supplies the audio data obtained as a result of decoding by the audio decoder 1 17 to the audio output module 2 2 1.
• the audio decoder control module 2 1 7 sequentially decodes one audio access unit obtained from the audio read function unit 2 3 4 of the buffer control module 2 1 5 by the audio decoder 1 1 7, and the decoding result.
• the audio output obtained will be supplied to the audio output module 2 2 1. .
• the subtitle decoder control module 2 1 8 also receives an instruction to start decoding from the decode control module 2 1 4, and in response to the instruction, the subtitle read function of the buffer control module 2 1 5 (Fig. 5) Part 2 3 5 Decodes one subtitle access unit obtained from the internal subtitle decoding software, and supplies the subtitle data (subtitle image data) obtained as a result of the decoding to the graphics processing module 2 1 9 .
• the subtitle decoder control module 2 1 8 sequentially decodes one subtitle access module obtained from the subtitle read function part 2 3 5 of the buffer control module 2 1 5 using the internal subtitle decode software.
• the subtitles obtained as a result of the decoding are supplied to the graphics processing module 2 19.
• step S 1 3 0 to S 1 3 1 the graphics processing module 2 1 9 performs the video data supplied from the video decoder control module 2 1 6 as described above, and further if necessary.
• Subtitle data supplied from subtitle decoder control module 2 1 8 Perform graphics processing on the elephant.
• the graphics processing module 2 19 first performs subtitle processing such as enlarging or reducing the subtitle data from the subtitle decoder control module 2 18 according to the display method instruction from the player control module 2 1 2. If there is no display format instruction from the player control module 2 1 2 or if there is an instruction for the default display format, the graphics processing module 2 1 9 receives the caption data from the subtitle decoder control module 2 1 8 Save as is.
• the graphics processing module 2 19 adds the video data from the video decoder control module 2 16 and the caption data from the caption decoder control module 2 1 8 or the caption data after caption processing. Then, output video data in which the video data is overlaid from the video decoder control module 2 16 is obtained and supplied to the video output module 2 20.
• the graphics processing module 2 1 9 can display information such as menus, messages, time codes, chapter numbers, and index numbers from the script control module 2 1 1 and the player control module 2 1 2 '. When an instruction is received, the information is generated, overlaid on the output video data, and supplied to the video output module 220.
• step S 1 3 2 After processing step S 1 3 1, proceed to step S 1 3 2, where the video output module 2 2 0 is powered by the graphics processing module 2 1 9 as described in step S 1 3 1
• the video images are stored in sequence in F IF0 2 2 0 A, and the output videos stored in F IFO 2 2 0 A are sequentially output at a predetermined output rate.
• the video output module 2 2 0 will accept the video output from the graphics processing module 2 1 9 as long as there is room in the F IFO 2 2 OA storage capacity (remaining capacity).
• the graphics processing module 2 19 stops processing and requests the video decoder control module 2 1 6 and subtitle decoder control module 2 1 8 to stop processing.
• the video decoder control module 2 16 and the subtitle decoder control module 2 1 8 stop processing. .
• the video output module 2 2 0 requests the graphics processing module 2 1 9 to stop accepting the output video data, and then the output of the output video data from the F IF0 2 2 0 A advances, and the F IF0 2 2 OA When there is enough time, the graphics processing module 2 1 9 is requested to accept the output video data.
• This request is transmitted from the graphics processing module 2 19 to the video decoder control module 2 16 and the subtitle decoder control module 2 1.8 in the same manner as the request to stop accepting output video data.
• the graphics processing module 2 19, and further, the video decoder control module 2 16 and the subtitle decoder control module 2 18 resume processing that has been stopped.
• the audio output module 2 2 1 also sequentially stores the audio data supplied from the audio decoder control module 2 1 7 in the FIF0 2 2 1 A as described in step S 1 3 0, and the F IFO 2 2 1 Audio data stored in A are output sequentially at a predetermined output rate (sampling frequency).
• the audio decoder control module 2 1 7 While accepting et audio data, if there is no margin, a stop receiving Eau Iodeta, audio O decoder control Mojiyu 1 Le
• the audio output module 2 2 1 requests the audio decoder control module 2 1 7 to stop accepting audio data, and then the audio data output from the F IF0 2 2 1 A advances, and the F IFO 2 2 1 A When there is enough time, the audio decoder control module 2 1 7 is requested to accept the audio data. As a result, the audio decoder control module 2 17 resumes the stopped processing. As described above, the elementary stream is decoded as data is output from the video output module 2 20 and the audio output module 2 2 1.
• FIG. 36 shows the internal structure of the video decoder 1 1 6.
• the inside of the video decoder 1 1 6 is composed of a video decoding engine 1 1 6 A and a DPB (decoded picture buffer) 1 1 6 B.
• the interior of DPB 1 1 6 B is further subdivided, and DPB 1 1 6 B— 1 to DPB 1 1 6 B-n (hereinafter referred to as DB P 1 1 6 B It shall consist of Further, as shown in FIG. 37, the interior of DPB 1 16 B is divided into a video buffer 3 0 1 and an additional information buffer 3 0 2.
• the video decode engine 1 1 6 A uses the DPB for the purpose of temporarily storing the video data being decoded or holding it for use as a reference image in the future.
• 1 1 6 B video buffer 3 0 1 is used.
• the additional information buffer In the W 302 additional information obtained from the video reading function unit 2 3 3 corresponding to the video data stored in the video buffer 301 and parameters obtained by parsing the i-process unit are displayed. Evening (eg pic_struct) is recorded.
• the video decoder control module 2 1 6 instructs the video decoder 1 1 6 to decode the input video access unit. After decoding and reordering processing by the video decoder 1 1 6, the video data for 1 frame (2 fields) is output to the graphics processing module 2 1 9 and at the same time the time stamp ( PTS / DTS) and pic_struct information are passed from the video decoder control module 2 16 to the decode control module 2 14.
• the access unit's pic_struct is 1 or 2
• the preceding field does not have a time stamp, information that there is no time stamp is passed.
• isolated fields are allowed. Because of this, a field with pic-struct 2 or 1 is placed immediately after the field with pic_struct 1 or 2. When handling these two fields together, use the time stamp of the preceding field as a representative value.
• the pic_struct of 1 and the corresponding access unit have a time stamp
• the time stamp is passed from the video decoder control module 2 1 6 to the decode control module 2 1 4. For access units that do not have a time stamp, information that there is no time stamp is passed.
• the decode control module 2 14 updates the time measuring unit 2 14A using the received time stamp and the information of pic_struct.
• the decode control module 2 14 determines whether or not the received access unit has a time stamp added (step S 14 1). For example, when a time stamp is added to the access unit, the decode control module 2 14 sets the value of the time stamp (PTS) in the time measuring unit 2 14 A (step S 142). As described above, there is always a time stamp immediately after the start of decoding, so no problem occurs even the first time. If no time stamp is added to the access unit, the value determined by the previous pic_struct is added to the current time (step S 144). After that, the current pic_struct is saved for the next processing and the process is terminated (step S143).
• PTS time stamp
• pic_struct The value determined by pic_struct is as shown in Fig. 39. If the saved pic-struct is 0, 3 or 4, the timer 2 14 A is 2 Add time for field time. If pic_struct is 5 or 6, the timekeeping section 2 14 A adds time for 3 field hours. In addition, if the stored pic_struct is 1 or 2, the timer 2 14 A adds the time for 2 field hours.
• the output of the time value indicated by the clock unit 2 14 A from the video decoder control module 2 16 to the graphics processing module 2 19 is completed (for one frame). Indicates the display start time. In other words, if the video data has a time stamp, PTS is substituted. If there is no time stamp, the display interval of the previous video display is added in the display order.
• AVC is used as the video encoding method. For example, even in MPEG-2 Video, the display duration of the success unit can be known by using repeat_first_field.
• the video data output from the video decoder control module 2616 is stopped.
• the update of the timekeeping unit 214A automatically stops.
• the update of the timing unit 214 A automatically resumes.
• the video decoder control module 2 1 6 stops in conjunction with the update of the video output module 220, and further links to it. This means that the watch (timer 2 14 A) is also stopped.
• the video output module update is permitted, and the operation of the video decoder control module 2 1 6 and the output of video data are resumed and linked to it.
• Clock Timekeeping section 2 1 4 A
• the update is resumed in conjunction.
• slow playback is a state in which pause and normal playback are alternately repeated in a short cycle, and the clock (timer 2 14 A) is also updated in synchronization with the video output.
• the timing unit 2 14 A is updated in synchronization with the video data output from the video decoder control module 2 16.
• the delay after video decoder control module 2 1 6, here the delay caused by graphics processing module 2 1 9 and video output module 2 2 0 is large, it is actually provided to the user.
• the relationship between the video data and the clock (timer 2 1 4 A) may shift.
• the clock clock unit 2 14 A
• Additional information buffer 3 0 2 described with reference to Fig. 7 is added, and video data and additional information are always handled as a set until output. Further, when video data is output from the video output module 2 20, the corresponding additional information is passed to the decode control module 2 14.
• the decode control module uses the algorithm described above to make a clock (timer 2 1
• the device that plays the stream data counts independently. Therefore, even if the clock is not equipped, the stream data can be accurately reproduced, and the processing load on the CPU 112 and the like can be reduced.
• the first Playlist # 0 of the first PlayList # 0 in FIG. 29 starts to be played.
• PlayList # 0 When playback of the second PlayItem # 0 ends, playback of the second Playltem # l starts. That is, Playltem transfer is performed in which Playltem # 0 is changed to Playltem #l. .
• the decode control module 2 14 (FIG. 2A And FIG. 2B) continues to check the time being measured by the built-in timing unit 214 A while the first PlayItem # 0 is being played back.
• the decode control module 2 14 has the time measured by the clock unit 2 14 A of the first PlayItem # 0 given from the player control module 2 1 2 in step 1 2 7 of FIG. When it becomes equal to 0, UT_time 27, 180, 090 (Fig. 29), decode interruption control is performed in step S1 51 and playback of PlayItem # 0 is terminated.
• the time measuring unit 2 14A does not change at 90 kHz, that is, when the time is updated according to the video data output, the time measured by the time measuring unit 2 14 A is strictly May not be equal to 0UT_time of Play ltem # 0.
• P1 At the timing when the time of 0UT_time of ayltem # 0 and the time measured by the timekeeping unit 2 1 4 A become a nearby value, the decoding interruption control is performed and the playback of PlayItem # 0 is terminated. Details of this process will be described later with reference to FIGS. 51 and 52.
• the decode control module 2 14 operates the video decoder control module 2 1 6, the audio decoder control module 2 1 7, and the caption decoder control module 2 1 8 to stop the decoding operation. Further, the decode control module 2 1 4 controls the video output module 2 20 to continuously output the output video data currently being output.
• the decode control module 214 transmits a message to the player control module 2 112 that the first PlayltemifO has been played back.
• the player control module 2 1 2 includes the first PlayList # 0 and the second PlayList # 1 in the first PlayList # 0 in Step S 1 0 5 of FIG. If the message that the playback of the first Play # 1 is finished is transmitted from the decode control module 2 14 and the decoding control module 2 14 recognizes that it exists, the process proceeds from step S 1 5 1 to S 1 52, and 2 The playback of the first Pyltemifl is started in the same manner as in the case of the first Play Item # 0 described above.
• the player control module 2 1 2 performs the second Playltem # l in the same manner as in step S 1 22 of FIG.
• One of RPN_EP_start described in EPjnapO is determined as the playback start position.
• the steps in FIG. 34 are performed. Recognize Mark () belonging to the second PI ay It em # l as described in S 1 24, and play it using Play Item # l as described in step S 1 25 in FIG. Recognition of the number of elementary streams of each attribute multiplexed in the clip stream file “00002.PS” to be played, and determination of the elementary stream to be played back are performed.
• the player control module 2 1 2 performs the same processing as in step S 1 2 7 in FIG.
• the player control module 2 1 2 is the file name of the clip stream file in which the RPN—EP_start of EPjnapO determined as the playback start position and the element stream to be played back are multiplexed, that is, in this case, Supply content data to the file name of clip stream file “00002.PS” corresponding to “00002. (: 1 ⁇ ” described in CI ip_Information_16_11311 ⁇ of the second Playltem # l (Fig. 29) Give to module 2 1 3.
• the player control module 2 1 2 transfers the program stream stored in the clip stream file “00002 .PS” in which the elementary stream to be reproduced is multiplexed to the buffer control module 2 1 5.
• the buffer control module 2 1 5 is initialized before the supply of is started.
• the buffer control module 2 15 (FIG. 5) the data head pointer stored in the data head pointer storage unit 2 3 1 and the data write key storage unit 2 32 are stored.
• the player control module 2 1 2 supplies stream-id as identification information for identifying the elementary stream to be played back, and further private_stream_id to the buffer control module 2 1 5 as necessary. .
• the video readout function section 2 3 3 performs the st stream for the video stream in the elementary stream to be played back from the player control module 2 1 2.
• the audio reading function unit 2 34 sends the st stream_id and the private stream_id of the audio stream of the elementary streams to be reproduced from the player control module 2 1 2, Store in st.ream—id register 2 5 2 and private—str eam_id register 2 5 3 respectively.
• the subtitle reading function unit 2 from the player control module 2 1 2 3 5 includes 5 63111_1 (1 and 151 " ⁇ 316_5 6 & 111—1 (1) of the subtitle stream of the elementary stream to be played, and the subtitle reading function unit 2 3 5 st ream—id and pri vat e_st ream—id are stored in the stre am—id register 2 63 and pr_vate_s t ream_id register 2 64, respectively.
• the player control module 2 1 2 then initializes the buffer control module 2 1 5 (Fig. 5) and further sets a value corresponding to the clip stream file in which the elementary stream to be reproduced is multiplexed.
• the subtitle read function flag is set in the subtitle read function flag storage unit 2 61. That is, in this case, since the subtitle stream is included in the clip stream file “00002.PS” in which the elementary streams to be reproduced are multiplexed, the subtitle reading function unit 23 5 is made to function.
• the subtitle read function flag having a value of 1 is set in the subtitle read function flag storage unit 261.
• the player control module 2 1 2 decodes the second Playltem # l (Fig. 29) that is going to be played, the IN_time of 90,000 and the OUT-time of 27,090,000. Give to module 2 1 4. .
• the player control module 2 1 2 initializes the instruction of the subtitle stream display method to the graphics processing module 2 19. That is, the player control module 2 1 2 controls the graphics processing module 2 19 so that the subtitle stream display method is the default display method.
• the subtitle stream display method instruction may remain the current display method.
• the playback of the second Playltem # l is performed in the same manner as the playback of the first P 1 ay Item # 0.
• the decode control module 2 1 4 continues to check the time being measured by the built-in clock unit 2 14 A while the second Playltem # l is being played back.
• the time that A is measuring is the OUTJime of the second Playltem # l given by the player control module 2 1 2 in step S 1 52 (Fig. 40) 27, 090, 000 (Fig. 29) )
• step S 1 5 1 The same decoding interruption control as in the case of recording is performed, and Playltemm playback ends.
• the time measured by the clock unit 2 14 A may not be exactly equal to 0UT_time of PlayltemltO.
• the decoding interruption control is performed and the playback of PlayItem # 0 is terminated. Become. Details of this process will be described later with reference to FIGS. 51 and 52.
• step S123 of FIG. 34 the display of the evening code is started, and the display of the time code is sequentially updated.
• step S 1 71 When the decode control module 2 14 (Fig. 2 A and Fig. 2 B) counts 1 second by its built-in timer 2 14 A, it indicates that 1 second has passed in step S 1 71.
• the current time measured by the timing unit 2 14 A is supplied to the player control module 2 1 2, and the process proceeds to step S 1 7 2.
• step S 1 72 the player control module 2 1 2 receives the message from the decode control module 2 1 4 and the current time, converts the current time to a time code, and proceeds to step S 1 73. .
• step S 1 7 3 the player control module 2 1 2 controls the graphics processing module 2 1 9 so as to display the time code obtained in step S 1 72, and returns to step S 1 7 1.
• the time code is updated every second.
• the time code update interval is not limited to one second.
• the clip stream file “000.02. PS” played by l has two subtitle streams multiplexed as described in Fig. 30 A and Fig. 30 B. .
• the elementary stream to be reproduced is converted to the plurality of elementary streams having the same attribute. You can switch streams from one of the streams to the other.
• the script control module 2 1 1 It is given to the player control module 2 112 by executing or by the user operating the remote control.
• step S 1 91 the number of character streams recognized at the time of determining the elementary stream to be played back in step S 1 25 in FIG. 34 is checked.
• the player control module 2 1 2 ignores the subtitle stream switching message if the number of subtitle streams is less than one as a result of checking the number of subtitle streams. Therefore, the subsequent steps S 1.9 2 to S 1 94 Is not performed.
• the process proceeds to steps S 1 9 2 to S 1 94 in order, and the subtitle stream to be played is switched from the currently played subtitle stream to another subtitle stream. It is possible.
• the player control module 2 1 2 specifies the currently reproduced subtitle stream on the clip information file. More specifically, for example, the stream_id multiplexed with the clip stream file “00002.PS” by the second Playltem # l constituting the first PlayList # 0 described in FIG. Assuming that a subtitle stream with private—s tream_id of 0x80 is being played in OxBD, in step S 1 9 2, the currently playing subtitle stream is multiplexed into the clip stream file “00002.PS” Of these two subtitle streams, the stream information must be stream # 2, which is the third subtitle stream on the clip information file "00002 CLP" in Fig. 30A and Fig. 30B. Identified.
• step S 1 9 3 the player control module 2 1 2 Specifies the next subtitle stream on the clip information file of the subtitle stream specified in step S 1 92 as the subtitle stream to be played next.
• the subtitle stream next to the third subtitle stream stream # 2 on the clip information file “00002 CLP” is the fourth subtitle stream stream # Therefore, in step S 1 93, this fourth subtitle stream stream # 3 is recognized as a subtitle stream to be reproduced next.
• the currently playing subtitle stream is a clip information file shown in Fig. 3 0 'and Fig. 30 B of the two subtitle streams multiplexed in clip stream file "00002 .PS".
• the stream # 3 is the fourth subtitle stream, for example, the third subtitle stream stream # 2 is recognized as the subtitle stream to be played next.
• step S 1 94 the player control module 2 1 2 determines that the next subtitle stream stre 111_1 (1 and 01 > ⁇ 316—5 6 & 111_1 (1 is buffered) recognized in step S 1 93 Give it to the subtitle reading function part 2 3 5 of the control module 2 1 5 (Fig. 5), and use the stream_id and private_stream_id from the next reading from the subtitle access unit buffer 2 1 5 A To instruct.
• the st ream—id and private—stream—id given from the player control module 2 1 2 in step S 1 94 are changed to stream— id register 2 6 3 and private—stream_id register 2 64 are newly set, and the next read from buffer 2 1 5 A will be read from stream_id register 2 6 3 and private—stream_id register 2 6 4 Subtitles identified by the newly set stream—id and private stream id This is done for the access unit.
• the subtitle stream to be reproduced is currently reproduced by; the stomach Ru subtitle stream is switched to another subtitle stream.
• the processing of the buffer control module 2 15 (FIG. 5), that is, the overnight writing to the buffer 2 15 A and the buffer 2 15 As explained in Fig. 5, the buffer control module 2 15 that explains the reading of data from A has 5 pointers for reading and writing data to the buffer 2 1 5 A. Yes.
• the buffer control module 2 15 is stored in the data start pointer storage section 23 1 and the data write pointer storage section 2 3 2.
• the video read pointer stored in the video read pointer storage unit 24 1, the audio read pointer storage unit stored in the audio read pointer storage unit 2 51, and the subtitle read pointer storage unit 262 It has a stored subtitle read pointer.
• the illustration of is omitted.
• the data header data stored in the data header data storage unit 2 3 1 is the oldest data that remains in the buffer 2 1 5 A (the data that needs to be read It represents the location of the oldest of them.
• the data write pointer stored in the data write pointer storage unit 2 3 2 indicates the position of the overnight write to the buffer 2 15 A, which is the newest data in the buffer 2 15 A. This is the position where evening is written.
• the video readout message stored in the video readout message storage unit 2 4 1 represents the position of the video stream to be read from the buffer 2 15 A.
• the audio read pointer stored in the audio read pointer storage unit 2 51 represents the position of the audio stream read from the buffer 2 15 A
• the subtitle read stored in the subtitle read pointer storage unit 26 2 Boyne evening indicates the position of the subtitle stream read from buffer 2 15 A.
• the data start pointer, data write pointer, video read pointer, audio read pointer, and subtitle read pointer all move clockwise in the buffer 2 15 A.
• the data head pointer indicates the position of the oldest data among the video read pointer, audio read pointer, or caption read pointer. It shall be constantly updated to point to the same location.
• the audio read pointer of the video read pointer, audio read pointer, or caption read pointer points to the position of the oldest data. It matches the audio read pointer.
• the data write pointer is newly added from the disk 1 0 1. When new data is read and written to buffer 2 15 A, it is updated clockwise to point to the position immediately after the new data written.
• the video read pointer, audio read pointer, or subtitle read pointer is read from the buffer 2 15 A when a video stream, audio stream, or subtitle stream is read.
• Each is updated clockwise.
• the amount corresponding to the read amount is included between the portion corresponding to the actually read video, audio, and subtitle data and the read data, and skipping is performed at the time of reading.
• it is a combination of the parts of other streams.
• the data head pointer indicates the position of the oldest data in the video read pointer, audio read pointer, or caption read pointer. It will be updated to point to the same location.
• the buffer control module 2 1 5 sends the buffer 2 1 5 A to the buffer 2 1 5 A so that the data write pointer does not pass the data start pointer. Control the writing of data.
• the buffer control module 2 15 has the data read from the disk 1 0 1 the data pointed to by the data write pointer. Buffer 2 1 5 Data is written to position A and the data write-in message is updated. On the other hand, if overtaking of the first data point by the data write pointer is likely to occur, the buffer control module 2 1 '5 stops reading data from the disk 1 0 1 to the content data supply module 2 1 3 In addition, writing data to buffer 2 1 5 A is stopped. As a result, the overflow of the buffer 2 15 A can be prevented.
• writing of data read from the disk 1 0 1 to the buffer 2 15 A is controlled only by the positional relationship between the data head pointer and the data write pointer.
• the noffa control module 2 1 5 has the data read pointer, audio read pointer, subtitle read pointer, and data start pointer overtaking the data write pointer for reading data from the buffer 2 15 A. Control reading of data from buffer 2 1 5 A.
• the buffer control module 2 1 5 has the video decoder control module 2 1 6 and the audio decoder control module 2 1 7, or subtitle decoder control module 2 1 8 Depending on the request from the video read pointer, audio read pointer, or buffer pointed to by the subtitle read pointer 2 1 5 Data is read from the position of A, and the video read pointer, The audio read pointer or caption read pointer is updated, and the data start pointer is updated as necessary.
• the buffer control module 2 1 5 uses the video decoder control module 2 1 6, the ⁇ video decoder control module 2 1 7, or the subtitle decoder control module 2 1 8. For example, the request will be frozen until sufficient data is available. This prevents underflow of buffer 2 15 A.
• the range from the position pointed to by the data head pointer to the position pointed to by the data write pointer in the buffer 2 1 5 A (the part shaded in Figs. 4 3 and 4 4)
• the video decoder control module 2 1 6, the audio decoder control module 2 1 7, and the caption decoder control module 2 1 8 are stored, and within that range, the video read out is stored.
• the data head pointer is updated to point to the position of the oldest data among the positions pointed to by the video readout pointer, audio readout pointer, or subtitle readout pointer.
• the video read pointer, audio read pointer, or video read pointer of the video read pointer, audio read pointer, or caption read pointer often points to the oldest data position.
• the data start pointer is moved from the position of the oldest decoder pointed to by the video read pointer or the video read pointer. If the data is updated so that it points to the past data position by 1 second, as shown in Fig. 4 3, as shown in Fig. 4 3 Can be stored in the buffer 2 1 5 A.
• the audio read pointer points to the position of the oldest data
• the data head pointer points to the position of the past data for one second from that position.
• the responsiveness of the disc playback device can be improved by updating the data start heading so that it points to the position of the past data for one second.
• the data start point is set so that it points to the position of past data for one second from the position of the oldest data pointed to by the audio read pointer. Even when updating the printer, the data required to start special playback
• step S 1 2 7 of FIG. 34 the clip stream file is played back.
• the data start pointer, data write pointer, video read pointer, audio read pointer, subtitle read pointer are all in the same position on the buffer 2 1 5 A Initialized to point to.
• the video reading function section 2 3 3 analyzes the syntax of the program stream stored in the buffer 2 1 5 A, and the video decoder control module In response to a request from 2 1 6, the video access unit is extracted from the program stream stored in the buffer 2 1 5 A and read out and supplied to the video decoder control module 2 1 6.
• the audio read function part 2 3 4 is also connected to the buffer 2 1 5 A. Parses the stored program stream and
• the audio access unit is extracted from the program stream stored in the buffer 2 1 5 A ′, read out, and supplied to the audio decoder control module 2 1 7.
• the subtitle reading function section 2 3 5 also parses the program stream stored in the buffer 2 15 A and stores it in the buffer 2 15 A in response to a request from the subtitle decoder control module 2 18
• the subtitle access unit is extracted from the program stream and read out and supplied to the subtitle decoder control module 2 18.
• the elementary list stream multiplexed in the program stream stored in the clip stream file “00001.PS” is the elementary list stream to be played back.
• the program stream is read from disk 1 0 1 and stored in buffer 2 1 5 A
• the EP map (0) of clip stream file “00001.PS” ( From the decoding start point information described in Fig. 31), 305 sectors are determined as the playback start position.
• the playback start position of 305 sectors is specified and the operation is started.
• 'Ting system 2 0 1 is requested to read the program stream stored in clip stream file "00001 .PS”.
• “decoding start possible point information” described in EPjnapO represents the position of PES_packet 0 of private-stream-2 located immediately before the actual decoding start possible point.
• step S 2 1 When the private read stream—2 PES—packet 0 is found in step S 2 1 1, the video readout function unit 2 3 3 proceeds to step S 2 1 2, and the private—stream— 2 PES—packet 0 PES — Packet— data—byte private_stream2_PES_payload () (Fig. 26) Describes the vid eo—stream— id, and its video_stream_id is the stream_id register in step S 1 27 of Fig. 34 2 4 2 Determine whether it matches the stream id of the playback target video stream stored in Fig. 5 (Fig. 5).
• step S 2 1 2 If it is determined in step S 2 1 2 that the video_stream—id described in private_stream2_PES_payload () does not match the stream—id stored in the stream_id register 24 2, that is, the immediately preceding step S 2 1 PES_packet 0 of private_stream_2 found in 1 is not located at the decoding start point of the video stream to be played , Return to step S 2 1 1 to perform another 01 " ⁇ 316_5 6 & 111-2?
• step S 2 1 2 determines whether video_streaffl_id described in private_stream2_PES_payload () matches the stream_id stored in the stream-id register 2 4 2, that is, If PES_packet 0 of private_stream_2 found in the immediately preceding step S 2 1 1 is located at the decoding start point of the video stream to be played, proceed to step S 2 1 3 2 3 3 reads the au_in format ion 0 described in the private one stream2—PES—payloadO of the private—stream—2 from the buffer 2 1 5 A, and the au—informationO register 24 3 (first (See Fig. 5) Proceed to step S 2 1 4.
• step S 2 1 4 the video readout function unit 2 3 3 determines that PES_packet 0 (video_stream_id (Fig. 26) of private_stream_2 found in the previous step S 2 1 1 is stream_id register 2 42 (5th The video read pointer stored in the data head pointer storage unit 2 3 1 is updated by the size of PES_packet 0) of the private stream 2 that matches the stream — id stored in the figure.
• a video stream (PES_packetO) of stream_id that matches the video stream_id is arranged.
• the pointer is updated to point to the actual decoding start point of the video stream.
• step S 2 1 4 the process proceeds from step S 2 1 4 to S 2 1 5, and the video readout function unit 2 3 3 receives data from the video coder control module 2 1 6. 00 Judges whether or not a request has been made. If not, returns to step S 2 1 5 and repeats the same process.
• step S 2 1 6 If the video decoder control module 2 1 6 determines that there is a data request in step S 2 1 5, the process proceeds to step S 2 1 6, where the video readout function unit 2 3 3 Buffer pointed to by the evening 2 1 5 While parsing the program stream from position A, the data of the number of bytes described in AU_length of au_information () stored in au_information () register 24 3 One video access unit is read from buffer 2 1 5.A, supplied to video decoder control module 2 1 6 and a video read pointer is read from buffer 2 1 5 A. Update only the size of the unit.
• au-informationO includes the video included between the PES_packet 0 force of the private-stream-2 that includes it and the PES_packet () of the next private-stream-2.
• Numbe 0 representing the number of access units (pictures) and access_unit are described.
• au-information () contains pic_struc as information about each of the video access units corresponding to the number of access_units, copy, au_ref_f lag, and AU_len gth. Is described.
• the program stream stored in the clip stream file recorded on disk 1 0 1 is one or more actual decodes in the video stream per video access unit.
• PES of private_stream_2 in which AUJength representing the size of the video access unit is described—packet () is included, so the video read function part 2 3 3 Based on the AUJength described in packet 0, the video stream is parsed from buffer 2 1 5 A without parsing the video stream.
• the access unit (unit video stream) can be read out and supplied to the video decoder control module 2 1 6.
• step S 2 16 the video read function unit 2 3 3 sets the au_information 0 as information on the video access unit when supplying the video access unit to the video decoder control module 2 1 6.
• the pic-struct one copy, au_ref_f lag, and AU-length described in el and the time stamp (PTS, DTS) added to the video access unit are also supplied to the video decoder control module 2 16.
• step S 2 1 6 after one video access unit is read from the reference 2 1 5 A and supplied to the video decoder control module 2 1 6, the process proceeds to step S 2 1 7, where the video read function unit 2 3 3 is the number of accesses indicated by the number of access units in au_informa tionO (Fig. 27) stored in au_information () register 243. Determine if the unit has been processed.
• step S 2 1 7 if it is determined that the number of access units represented by number_o and access—unit has not yet been processed, that is, the number of access units represented by nuraber_o and access—unit has not yet been processed. If the data is not read from the buffer 2 15 A and supplied to the video decoder control module 2 16, the process returns to step S 2 15, and the same processing is repeated thereafter.
• step S 2 1 7 If it is determined in step S 2 1 7 that the number_o and the number of access units represented by access_unit have been processed, that is, the number of access units represented by the number_o and access_unit is read from buffer 2 1 5 A. If the video data is supplied to the video decoder control module 2 1 6, the process returns to step S 2 1 1, the next private-stream_2 PES packet () is retrieved, and the same processing is repeated thereafter.
• the audio reading function unit 2 34 determines the audio stream to be played back stored in the stream_id register 2 5 2 (FIG. 5) in step S 1 27 of FIG. Determine whether stream_id represents pri vat e_s tream—1 PES—packet 0.
• step S 2 3 if it is determined that streamjd stored in stream_id register 2 52 does not represent PES—packet 0 of private—s earn—1, that is, stream—id register 2 5
• the streara_id stored in 2 is encoded according to the MPEG standard as explained in Fig. 23. ⁇ assigned to the audio stream, the process proceeds to step S 2 3 1, where the audio reading function unit 2 34 is determined by MPEG Audio from the program stream stored in the buffer 2 1 5 A. Look for a sync code that represents the beginning of the audio frame.
• the audio read function unit 2 34 updates the audio read pointer to indicate the position of the head of the audio frame, and proceeds from step S 2 3 1 to S 2 3 2.
• the audio read function unit 2 34 matches the stream_id stored in the stream_id stored in the program stream stored in the notor 2 15 A. Search for packet 0 from the position indicated by the audio read-out message, and go to step S 2 33.
• step S 2 3 the audio read function unit 2 34 obtains the audio read pointer stored in the audio read boyer storage unit 2 51 and the PES_packet () found in the previous step S 2 3 2. PES—packed and cut to indicate the beginning of the data byte (FIG. 19A and FIG. 19B to FIG. 21A and FIG. 21B), and proceeds to step S237.
• step S 2 3 7 the audio read-out function unit 2 34 determines whether or not there is a data request from the audio decoder control module 2 1 7, and if not, returns to step S 2 3 7, Repeat the same process.
• step S 2 3 7 If the audio decoder control module 2 1 7 determines that there is a data request in step S 2 3 7, the process proceeds to step S 2 3 8, where the audio reading function unit 2 34 The buffer pointed to by the output pointer 2 1 5 The time stamp (PTS, DTS) attached to the audio access unit is read from the buffer 2 15 A while reading the audio stream. At the same time, it is supplied to the audio decoder control module 2 1 7. Then, the audio read function unit 2 34 updates the audio read pointer by the size of one audio access unit read from the buffer 2 15 A, and returns to step S 2 37 to Below, the same processing is repeated.
• PTS time stamp
• step S 2 34 When the PES_packet 0 of private_stream_l is found in step S 2 34, the audio read function unit 2 34 proceeds to step S 2 3 5, and PES_packet—data—by te of private_stream_ 1 is private_streamed.
• the private—stream—id described in PES_payIoad () ( Figure 24) is extracted, and the private—streamjd force is stored in the private_stream_id register 2 5 3 ( Figure 5) in step S1 2 7 of Figure 34. Also, determine whether it matches the private_stream_id of the audio stream to be played.
• step S 2 3 5 if it is determined that the private stream stream described in PES_payload () is not the same as the private stream stream id stored in the private stream_id register 2 5 3, that is, immediately before If PES_packet () of private_stream_l found in step S 2 34 is not the audio stream to be played back, return to step S 2 34 and in the program stream stored in buffer 2 1 5 A The search for PES_packet 0 of other private—stream_l is performed, and the same processing is repeated thereafter.
• step S 2 3 5 if it is determined in step S 2 3 5 that the private_stream_id force and private_stream_id register stored in private_streaml_PES_payload () match the private_stream_id stored in E 2 3 5, that is, the immediately preceding If the private_stream —1 PES found in step S 2 34 — packet 0 is the audio stream to be played, proceed to step S 2 3 6, and the audio read function unit 2 34 PES of stream_l packet 0 COpr i va te_streaml_PES_pay load 0 Read A locator described in 'buffer 2 1 5 A, position immediately after AU_locator, and value represented by AU-locator Is added to find the beginning of the audio access unit.
• AU_locator is based on the position immediately after the AU-locator, 1 > 316-5 6 111? 55_ 3 10 & (01 (1 () 01 1 ⁇ & te_payload ())
• the audio access unit or subtitle access unit stored in the AU_locator is stored at the position immediately after AU_locator. By adding, the head position of the audio access unit can be obtained.
• the audio readout function unit 2 34 further performs steps S 2 3 6 to Then, the audio read pointer stored in the audio read pointer storage unit 25 1 is updated so as to point to the start position of the audio access unit obtained as described above, and the process proceeds to step S 2 37. Mu
• step S 2 3 7 the audio readout function unit 2 3 4 determines whether or not there is a data request from the audio decoder control module 2 1 7. Return and repeat the same process.
• step S 2 3 7 determines in step S 2 3 7 that there is a data request
• the process proceeds to step S 2 3 8, where the audio readout function unit 2 3 4 Reads the audio stream from the buffer 2 1 5 A while parsing the program stream from the position of the audio 2 1 5 A, while reading the audio stream.
• the audio decoder control module 2 17 is supplied with the time stamp added to the audio access unit.
• the audio read function unit 2 3 4 then updates the audio read pointer by the size of one audio access unit read from the buffer 2 15 A, and returns to step S 2 3 7 Thereafter, the same processing is repeated.
• the subtitle reading function unit 2 3 5 is the subtitle reading function flag storage unit in step S 1 2 7 in FIG. 2 6 Determine the subtitle reading function flag stored in 1. If it is determined in step S 2 5 1 that the subtitle reading function flag is 0, that is, for example, the subtitle stream is included in the clip stream file in which the elementary stream to be played back is multiplexed. If the subtitle read function flag storage unit 2 61 is set to 0 in step S 1 27 of FIG. 34, the subtitle read function unit 2 35 does not perform any particular processing.
• step S 2 51 if it is determined in step S 2 51 that the subtitle read function flag is 1, for example, the subtitle stream is included in the clip stream file in which the elementary list to be played back is multiplexed. If 1 is set in the subtitle read function flag storage unit 2 61 in step S 1 2 7 of FIG. 34, the process proceeds to step S 2 5 2, and the subtitle read function unit 2 3 5 PES_packet () that matches the stream_i (l) of the subtitle stream to be played back stored in register 2 63 (Fig. 5) is retrieved from the program stream stored in buffer 2 15 A.
• stream_id register 2 6 3 (FIG. 5) stores the stream_id of the subtitle stream to be played back.
• step S 2 52 1 ⁇ 5_0 & 1 ⁇ 10 of log 1 ”& 16_5 6 & 111_1 in the program stream stored in the buffer 2 15 A is searched.
• step S 2 52 a search for PES_packet 0 for private_stream_l is performed and if PES_packet 0 for private stream 1 is found,
• the subtitle reading function unit 2 3 5 moves to the private_stream-1 PES—packet 0 PES—packet—data—byte pri vat e_streaml—PES_payload () (Fig. 24).
• the private_stream_id described is extracted, and the private_stream_id matches the private_stream_id of the subtitle stream to be played back stored in the private_stream_id register 2 64 (Fig. 5) in step S1 27 of Fig. 34 Determine whether or not.
• step S 2 5 3 it is determined that the private stream stream id described in private_streaml—PES—payloadO does not match the private stream stream id stored in the private stream stream id 2 6 4.
• PES_packet 0 of private_stream_l found in the immediately preceding step S 2 52 is not the subtitle stream to be played back, the process returns to step S 2 52 and the program stream stored in the buffer 2 1 5 A The other private_stream_l PES_packet 0 is searched, and the same processing is repeated thereafter.
• step S 2 53 the privat e_s tre am_id force r iva te_s tream—id regis- ter 2 is matched with the private stream_id stored in private_streaml_PES_payload (). If it is determined, that is, if PES_packet () of private-stream_l found in the immediately preceding step S 2 5 2 is a subtitle stream to be played back, the process proceeds to step S 2 54 and the subtitle reading function unit 2 3 5 Reads the AU- locator described in PES-packet 0 private_streaml- PES_payload () (Fig. 24) of the private_stream_l from buffer 2 15 A, and the position immediately after the AU _locator By adding the value represented by AU_locator, the head position of the caption access unit is obtained.
• the AU locator has its Allocator as explained in Fig. 24. It represents the start position of the subtitle access unit (or audio access unit) stored in pr iva te — payl oad O of pr i va t e_s t reaml—PES_pay l oad () with reference to the position immediately after
• the head position of the subtitle access unit can be obtained by adding the value represented by the All ocator to the position immediately after the All oca tor.
• the subtitle reading function unit 2 3 5 further reads out the subtitles stored in the subtitle read keyboard storage unit 2 62 so as to indicate the head position of the subtitle access unit obtained as described above in step S 2 5 4. Update the pointer and go to step S 2 5 5. '
• step S 2 5 the caption reading function unit 2 3 5 determines whether or not a request for decoding has been received from the caption decoder control module 2 1 8, and if not, step S 2 5 5 Return to and repeat the same process.
• step S 2 5 5 If it is determined in step S 2 5 5 that the data request is received from the subtitle decoder control module 2 1 8, the process proceeds to step S 2 5 6, where the subtitle read function unit 2 3 5 Buffer 2 pointed to by pointer 2 1 5 While analyzing the syntax of the program stream from position A, one subtitle access unit for the size described at the beginning of the subtitle access unit is buffer 2 1 5 Read from A and supply to subtitle decoder control module 2 1 8 together with the time stamp added to the subtitle access unit. In other words, as described in Fig. 2A and Fig. 2B, the size of the subtitle access unit is described at the top of the subtitle access unit.
• the subtitle reading function unit 2 3 5 then updates the subtitle reading pointer by the size of one subtitle access unit read from the buffer 2 1 5 A. Return to step S 2 5 5, and below The same process is repeated.
• the decode control module 2 1 4 shifts the timing if necessary to ensure synchronization, and starts the decoding by the video decoder control module 2 1 6, audio decoder control module 2 1 7, and subtitle decoder control module 2 1 8, for example, depending on the degree of decoding processing of video decoder 1 1 6 and audio decoder 1 1 7
• the output of data may be out of sync with the audio output as output data that should be output in synchronization with the video data. Therefore, the decode control module 2 1 4 corrects a difference between the output of the video data and the output of the audio data that should be output in synchronization with the video data, and the video data and the audio data are synchronized. Resynchronization processing is performed so that the data is output.
• step S 2 7 1 the decoding control module 2 1 4 is the video decoder control module 2 1 6. Judge whether the difference between the time stamp of the video access unit and the time stamp of the audio access unit from the audio decoder control module 2 17 is large.
• step S 1 29 of FIG. 34 every time the video decoder control module 2 16 obtains a video access unit from the buffer control module 2 15, the video access control module 2 16 The nickel time stamp is supplied to the decode control module 2 1 4. Similarly, the audio decoder control module 2 1 7 obtains the audio access unit from the buffer control module 2 1 5, and the time stamp of the audio access unit is sent to the decode control module 2 1 4. Supply.
• step S 2 7 the decode control module 2 1 4 is supplied from the video decoder control module 2 1 6 and the audio decoder control module 2 1 7 within a certain time which can be regarded as the same timing. Compare the time stamps that are used, and determine whether the time stamps are misaligned.
• step S 2 7 the difference between the time stamp of the video access unit from the video decoder control module 2 1 6 and the time stamp of the audio access unit from the audio decoder control module 2 1 7 should not be large. If it is determined, that is, the difference between the time stamp of the video access unit and the time stamp of the audio access unit is within a range in which it can be considered that a predetermined synchronization is established, for example, 2 videos If it is a frame (approx. 66 ms), the process returns to step S 2 7 1 and the determination of the time stamp deviation is continued.
• step S 2 7 the video decoder control module 2
• the time difference between the video access unit from 1 6 and the audio access unit from the audio decoder control module 2 17 is determined to be large, that is, the video access unit If the difference between the time stamp of the unit and the time stamp of the audio access unit is outside the range where it can be considered that the predetermined synchronization is established, the process proceeds to step S 2 72 and the decoding control is performed.
• Module 2 1 4 compares the video access unit time stamp from video decoder control module 2 1 6 with the audio access unit time stamp from audio decoder control module 2 1 7 Either data output or audio data output is delayed. Determine the dolphin.
• step S 2 7 2 If it is determined in step S 2 7 2 that the output of the video data is behind the output of the audio data, the process proceeds to step S 2 7 3, where the decode control module 2 1 4 In order to proceed only with the video access unit, the video decoder control module 2 16 is instructed not to display and display the video access unit, that is, the video access unit processing. Is output, and the process proceeds to step S 2 74.
• step S 2 74 the video decoder control module 2 1 6 receives the skip instruction from the decode control module 2 1 4 and responds to the skip instruction with the video access unit from the buffer control module 2 1 5. Check the supplied au_re flag (Fig. 27).
• step S 2 7 the access unit's au and f lag supplied with the access unit are thus examined.
• step S 2 7 4 the video decoder control module 2 1 6 is based on the result of the au_re and fl ag check of the video access unit supplied from the buffer control module 2 1 5 ′. Determine whether the video access unit is a non-reference image that is not referenced in the decoding of other pictures.
• au -re and fl ag of the video access unit indicates whether or not the access unit is a reference image. If it is not a reference image, that is, if it is a non-reference image, 0 is set.
• step S 2 75 If it is determined in step S 2 75 that the video access unit supplied from the buffer control module 2 15 is not a non-reference image video access unit, that is, from the buffer control module 2 15 If the supplied video access unit is a reference image, proceed to step S 2 76 and the video decoder control module 2 1 6 processes the video access unit to the video decoder 1 1 6 as usual. And wait for the next video access unit to be supplied from the buffer control module 2 1 5, and return to step S 2 7 4.
• step S 2 75 the video access unit supplied from the buffer control module 2 15 is determined to be a non-reference image. If so, the process proceeds to step S 2 7 7, and the video decoder control module 2 1 6 skips the processing by the video decoder 1 1 6 3 ⁇ 4 of the video access unit, and the next video access unit moves to the buffer control module. Wait for the supply from 2 1 5 to return to step S 2 7 1.
• the processing of the video access unit is advanced by approximately one video access unit by skipping the processing of the video access unit.
• the output of video data that was delayed from the output of audio data is accelerated.
• step S 2 72 determines whether the video data output is not delayed from the audio data output, that is, the audio data output is delayed from the video data output.
• the decode control module 2 1 4 sends the video access control module being decoded to the video decoder control module 2 1 6 in order to wait for the video access module to be processed. Outputs the repeat output instruction to output the video data corresponding to ⁇ repeatedly, and proceeds to step S 2 79.
• step S 2 7 9 the video decoder control module 2 1 6 receives the repeat output instruction from the decode control module 2 1 4, and in response to the repeat output instruction, the video decoder 1 1 6 deco The video data corresponding to the selected video access unit is repeatedly output to the graphics processing module 2 1 9 and waits for the next video access unit to be supplied from the buffer control module 2 1 5 Return to step S 2 7 1.
• the decode control module 2 1 4 determines whether or not the video data output is delayed from the audio output. If the video data output is behind the audio data output, the video decoder control module 2 16 is instructed to skip the processing of one access unit. Then, the video decoder control module 2 1 6 determines whether the access unit is a reference image or a non-reference image based on au-re and fl ag of the access unit instructed to be skipped. If the image is a non-reference image, the video decoder 1 1 6 is made to skip the processing of the access unit instructed to skip. Therefore, it is possible to easily synchronize the output of the video data and the output of the audio data. '
• the access unit whose processing is skipped is a reference image
• the video data corresponding to the access unit needs to be decoded for reference when decoding other access units to be decoded thereafter. Therefore, in the synchronization control to synchronize the video data output and the audio data output, if the processing of the reference image access unit is skipped, other access units that refer to the reference image As a result, the synchronization control appears as noise in the video display. For this reason, it is desirable to skip the processing for an access unit that is not a reference image, that is, an access unit for a non-reference image.
• the program stream stored in the clip stream file recorded on the disc 1 0 1 has no video access unit.
• PES_packet-data by te is extended separately from PES_packet 0 (Fig. 19 A and Fig. 19 B to Fig. 21 A and Fig. 21).
• Private_ s tream2 PES— pay load 0 (Fig. 26) is multiplexed and private_stream_2 PES packet 0 is multiplexed.
• the au-re flag is supplied from the buffer control module 2 15 to the video decoder control module 2 16 together with the corresponding video access unit. Therefore, the video decoder control module 2 1 6 checks the au_re flag of the video access unit supplied with the video access unit, so that the video access unit can refer to the reference image with little cost. Or non-reference image.
• the decode control module 2 1 4 constantly checks the current time measured by the built-in timer 2 1 4 A.
• the current time is PyListMarkO (9th Judgment is made on whether or not it matches the mark_time_stamp of any MarkO described in the figure.
• the player control module 2 1 2 plays the first PlayItem # 0 of the first PlayList # 0 shown in FIG. P1 shown on the upper side of Fig. 3 2 Recognizing that 4 Mark 0 from 1st to 4th of 7 Mark 0 included in ayListMarkO belongs to 1st PI ayl tem # 0 of PlayList # 0. MarkO's mark_time_stainp ⁇ 180, 090 ⁇ , ⁇ 5,580,090 ⁇ , ⁇ 10,980,090 ⁇ , ⁇ 16, 380, 090 ⁇ is decoded with the fact that the time attribute indicated by its mark_time—s mp is “mark processing”. It passes to control module 2 1 4.
• step S 3 0 1 in the decode control module 2 1 4, the current time is one of the “mark processing” attribute time (mark_time_staiiip) supplied from the player control module 2 1 2 as described above. It is determined whether or not it matches the deviation.
• step S 3 0 1 If it is determined in step S 3 0 1 that the current time does not match any of the “mark processing” attribute times, the process returns to step S 3 0 1 and the same processing is repeated.
• step S 3 0 1 the decode control module 2 1 4 determines whether or not the current time and the maik_time-stamp match.
• the time indicated by the time measuring unit 2 14 A shows a discrete value, and thus there may be a problem with simple matching determination.
• FIG. 50 10 PI, P2 and P3 are video access units. All of these pic_struct are 3, that is, the display duration is 1 frame (3003 in terms of 90 kHz).
• the decoding order and the display order are the same, and reordering does not occur.
• the clock of the clock unit 214A is updated as shown in the lower part of FIG. That is, at the time of 10 outputs, 10 PTSs and 10 pic_structs are passed, and since PTS exists, PTS is substituted into the timekeeping part 2 14 A and becomes 180,090. At the time of output of P1, PTS does not exist, P1's pic_struct is passed, and 10's pic_struct is 3, so the time for one frame (3003 at 90kHz) is added to the timing unit 2 14A, and 183,093 become. Similarly, since P1's pic_struct is 3 when P2 is output, 3003 is added to 186, 096, and when P3 is output, 3003 is added to 189,099.
• mark_time_stamp 186,000 is included in the display duplication of the image P1. For this reason, this event occurs at the display start time of P1, that is, at 183,093.
• step S 3 0 ; 1 in FIG. 49 is performed only when the time is updated.
• Reproduction equipment composed of software is advantageous because it significantly reduces processing.
• step S 3 0 the decode control module 2 1 4 checks whether or not there is an event determined to match at the current time. In other words, it is checked whether there is an event included in the display duration of the currently displayed image from the current time and the display duration of the currently displayed image. The process returns to step S 3 0 1. If there is an event determined to match, the process proceeds to step S 3 0 2. If there is no event, the process may be terminated.
• the time is 180, 090, and the pic_s true t of I 0 is 3, so that the display duration of 10 is 3003. Therefore, a mark_time_stamp satisfying 180, 090 ⁇ mark_time_stamp ⁇ 180, 090 + 30 03 is searched.
• the event time 186, 000 illustrated here does not satisfy this formula, so it is not determined to match.
• time coincidence determination is shown, but other definitions can be applied. For example, if an event's mark_time_stamp TJP2005 / 021500
• the occurrence time of an event occurs, for example, at “the display start time of the corresponding image”, for example, without changing the determination criteria.
• step S 3 0 1 If it is determined in step S 3 0 1 that the current time matches one of the times of the “mark processing” attribute, the decode control module 2 14 determines that the current time is the “mark processing” attribute. The message indicating that the current time is reached and the time of the attribute of the “mark processing” that matches the current time are supplied to the player control module 2 12, and the process proceeds to step S 302.
• step S 302 the player control module 2 1 2 sends a message that the current time is the time of the “mark processing” attribute, and the time of the “mark processing” attribute that matches the current time (mark_Urae_stamp ) Is received from the decode control module 214, and MarkO in which mark_time_sta immediately matches the current time is recognized as MarkO to be processed for mark processing (hereinafter referred to as processing target mark as appropriate).
• the player control module 2 1 2 recognizes PyliemO of the currently played Play Lis), the PI ayList 0 and Play It em 0, and the current time from the decode control module 2 14 "PlayList.DAT" file (Fig. 7) 'PlayList from the time of the matching "mark processing" attribute (mark—time one sta) (hereinafter referred to as the mark time as appropriate)
• the target mark is recognized by referring to MarkO (Fig. 9). Specifically, for example, if the first PlayItem # 0 of the first PlayLisso shown in FIG. 29 is being played, the player control module 2 1 2 Recognizes that the mark_time_stamp is one of the four MarkOs from the first to the fourth among the seven MarkOs included in the PIayListMarkO shown in the upper side of FIG.
• the mark time supplied from the decode control module 2 1 4 to the player control module 2 1 2 is 16,380,090, for example, the player control module 2 1 2 Among the 4th MarkO from 1st to 4th included in ayListMarkO, the 4th MarkO whose mark_time_stamp matches the mark time 16, 380, 090 is recognized as the processing target mark.
• step S 3 0 2 the process advances from step S 3 0 2 to S 3 0 3 to identify the element list stream in the processing target ma rk entry_ES Check whether stream_id and entry_ES—private—stream_id (Fig. 9) are described.
• step S 3 0 3 If it is determined in step S 3 0 3 that entry-ES-stream-id and entry-ES_private-stream-id (Fig. 9) are not described in the processing target mark , Ie, entry— ES_str
• step S 3 0 the elementary stream is identified as the processing target mark entry_ES stream_idi: entry_ES_private_strea If it is determined that m 1 id (FIG. 9) is described, the process proceeds to step S 3 0 4, and the player control module 2 1 2 adds the entry_ES 1 streamjd, If necessary, determine whether the element list stream specified by 'en try_ES_private_stream_id is included.
• step S 3 04 it is determined that the elementary stream being identified by the entry_ES_stream_id and entry_ES-private-stream-id of the processing target mark is not included in the elementary stream being played back If so, return to step S 3 0 1. That is, if the elementary stream specified by 'entry_ES-str eam_id and en y-ES-private-stream-id of the processing target mark is not played back, the processing target mark is ignored while step S3 04 If the element stream list being played back contains the element stream identified by the entry-ES_streani-id and entry_ES-private_stream-id of the processing target mark, that is, processing If the elementary stream specified by the entry_ES_stream_id and entry_ES_private_streaffl_id of the target mark is being played back, the processing target mark is considered valid, and the process proceeds to step S 3 0 5. Done.
• step S 3 0 5 the player control module 2 1 2 determines the processing target mark by referring to the mark_type (FIG. 9) of the processing target mark.
• step S 3 0 5 If it is determined in step S 3 0 5 that the processing target mark is a cap mark or index mark, that is, if the mark_type of the processing target mark is 'Chapter' or 'Index', step S 3 0 Proceed to step 6, and the player control module 2 1 2 Command 2 1 9 to update the display of the chapter or index number to the chapter or index number represented by the chapter mark or index mark that is the processing target mark, and return to step S 3 0 1
• the processing target mark is a cap mark or index mark, that is, if the mark_type of the processing target mark is 'Chapter' or 'Index'
• step S 3 0 5 If it is determined in step S 3 0 5 that the processing target mark is an event mark, that is, if the mark-type of the processing target mark is 'Ev ent', step S 3 0 7 Then, the player control module 2 1 2 supplies the event message indicating the occurrence of the event and the mark_data of the processing target mark to the script control module 2 1 1, and proceeds to step S 3 0 8.
• step S 3 0 8 the script control module 2 1 1 receives the event message and mark_data from the player control module 2 1 2, and the event message is written in the CRIPT.DAT "file in advance as an interrupt request. The series of processing is performed with mark 1 data as an argument, and the process returns to step S 3 0 1.
• processing corresponding to mark 1 data is performed.
• PlayList # 1 PlayList # 1 shown at the bottom of Fig. 32
• the second MarkO (Mark # l) and the third MarkO (Mark # 2) are both marked_type Is 'Event', but mark_data is different for 1 (Mark # l) and 2 (Mark # 2), respectively.
• the script control module 2 1 1 receives the event message corresponding to the second MarkO and the event message corresponding to the third MarkO in both cases. Depending on the event handler, the same event handler (interrupt processing routine) is used to process the event message. By checking the mark_data supplied with the message, the event message is processed differently for each mark_data.
• the scribble control module 2 11 1 controls the graphics processing module 2 19 to display the first type icon.
• the script control module 2 11 controls the graphic processing module 2 19 to display the second type of icon.
• mark_data is not limited to 1 or 2
• the processing performed in response to mark 1 data is not limited to simple icon display as described above.
• the script control module 2 1 1 controls the graphics processing module 2 1 9 to change the display of the first type icon from mark_data.
• the brightness is set to a value corresponding to the value obtained by subtracting 2 (a value between 1 and 16).
• the script control module 2 1 1 controls the graphics processing module 2 1 9 to display the second type icon as mark_data Is performed at the brightness corresponding to the value obtained by subtracting 18 from 1 to 16.
• the input interface 1 1 5 (Fig. 1) is connected to a controller operated by the user, and the controller has attached a weight that is eccentric to the axis of the DC (Direct Current) motor.
• a vibration motor that generates vibration when DC motor is operated is incorporated, when mark_data is in the range of 35 to 42, the vibration mode is subtracted from mark-data. It can be operated only for the operation time according to the value (numerical value of 1 to 8).
• mark_data is a numeric value, their uses and algorithm can be serial 3 ⁇ 4 predicates by script control module 2 1 script program 1 executes. Therefore, mark_data is a rule set independently by the manufacturer of the disc 1 0 1 or the content provider that provides the data recorded on the disc 1 0 1 in addition to using the rule determined in advance. It is possible to use.
• the target mark is recognized from the mark time that is the time of the “mark processing” attribute.
• entry_ES_stream_id and entry_ES—private—stream—id that identify the elementary stream are not described in the processing target mark, processing corresponding to the mark type of the processing target mark is performed.
• entry_ES_stream_id and entry_ES_private_stream_id that identify the elementary list are described in the processing target mark, the element specified by the entry_ES — stream— id and entry—ES — private_stream_id If the evening stream is being played, processing according to the mark_type of the processing target mark is performed.
• the first mark_time_sta is specified as 90, 000, 27,090,00 0, 27, 540,000 respectively.
• MarkO (Mark # 0), second MarkO (Mark # l), and third MarkO (Mark # 2) are described.
• the clip stream file “00003.PS” includes the clip information file “00003. CLP ′ ′” in FIGS. 30A and 30B corresponding to the clip stream file “00003.PS”.
• the video stream stream # 0 identified by the stream id that is OxEO the video stream stream # l identified by the stream_id that is ⁇
• the s eam_i (l and l Three elementary streams of audio stream stream # 2 specified by private_stream_id which is 0x00 are multiplexed.
• the video stream stream # 0 multiplexed in the clip stream file "00003.PS” and stream_id is 0 XE 0
• the third MarkO is associated with the video stream s tream # l that is multiplexed with the clip stream file “00003. PS” and whose stream id is OxEl.
• the player control module 2 1 2 When playback of PyItem # 0 in the second PyList # l in Fig. 29 is started, the player control module 2 1 2 is set as described in step S 1 24 in Fig. 34. 3 Recognize that three MarkOs included in PlayListMarkO shown in the lower part of Fig. 2 belong to PlayItem # 0 of PlayUst # l, and ⁇ 90, 000 ⁇ , which are mark_time_stamp of the three MarkOs, Pass ⁇ 27, 090 000 ⁇ , ⁇ 27, 540, 000 ⁇ to the decode control module 2 1 4 along with the fact that the time attribute indicated by the mark_time_s tamp is “mark processing” is doing.
• the decoding control module 2 1 4 is playing the PlayItem # 0 in the PlayList, and the current time measured by the clock unit 2 1 4 A is the time ⁇ 90, 000 ⁇ with the attribute “mark processing”, It always checks whether it matches any of ⁇ 27, 090, 000 ⁇ , ⁇ 27, 540, 000 ⁇ (step S 3 0 1), the current time is the attribute “mark processing” When the time matches, the mark time that is the time of the “mark processing” attribute that matches the current time, and a message that the current time is the time of the “mark processing” attribute, the player control module 2 1 Supply to 2. '
• the decode control module 2 1 4 indicates that the mark time 27,090, 000, which is the time of the “mark processing” attribute that coincides with the current time, and that the current time is the time of the “mark processing” attribute. Message to the player control module 2 1 2.
• the player control module 2 1 2 recognizes that PlayItem # 0 of PyL.ist '# l is currently being played, and is described in PlayListMarkO shown in the lower side of Fig. 3 2 of that PlayList # l.
• three MarkO belonging to Playltem # 0 are marked as mark—time_stamp 90, 000, 27, 090, 000, 2 7, 540, 000, and the mark time from decode control module 2 1 4
• mark-time_stamp matches that mark time 27,0 90, 000, that is, 2 described in PlayListMarkO at the bottom of Fig. 3 2
• the th MarkO (Mark # l) is recognized as a processing target mark (step S 3 0 2).
• OxEO is specified as entry ES_stream id in the second MarkO described in PlayListMarkO on the lower side of Figure 3 2 that is the processing target mark Has been.
• Entry_ES_stream_id which is this OxEO, since the above, the clip stream file "00003.PS" Ru have 3 ⁇ 4 are multiplexed, a video stream streamitO whose stream_id is in the OxEO (the '3 0 Figure A and the The player control module 2 1 2 determines whether or not the video stream streamitO is included in the elementary stream being played (step S 3 0 3). , S 3 0 4).
• step S 3 0 4 If the stream of the elementary stream being reproduced does not include the video stream stream # 0, the processing target mark is ignored (step S 3 0 4).
• the processing target mark is considered to be valid and processing corresponding to the processing target mark is performed (step S 3 0 5 to S 3 0 8).
• the second MarkO described in the PlayList MarkO on the lower side of Fig. 32 which is the processing target mark, is an event mark because its mark_type is 'Event'.
• the control module 2 1 2 supplies an event message indicating the occurrence of the event and mark_data of the processing target mark to the script control module 2 1 1 (steps S 3 0 5 and S 3 0 7).
• the event message from the player control module 2 1 2 is used as an interrupt request, and a series of processes described in advance in the “SCRIPT.DAT” file are supplied together with the event message.
• Mark —data is used as an argument (step S 3 0 8).
• mark_time stamp representing one playback time on the time axis of PlayListO and mark ty representing the type of MarkO PyListO containing PlayListMarkO (Fig. 9) with zero or more Mark () containing pe and mark_data that is an event mark argument.
• the playback time of the clip stream file being played according to Fig. It is determined whether or not a certain current time coincides with mark_time_sta immediately. If the mark-type of the processing target mark represents a type that generates an event, that is, if the processing target mark is an event mark, the processing target mark The mark_data and event message that are included in the message are notified, and the processing corresponding to the mark_data is executed.
• the process according to mark_data can be executed.
• the decoding control module 2 1 4 stops the decoding when the time measured by the clock unit 2 1 4 A becomes equal to 0UT_time of Playltem given from the player control module 2 1 2. Control is performed and Playltem playback is terminated.
• the end of PlayItem # 0 is described in step S 1 51 in the flowchart of FIG.
• PlayListEnd event (OUT_time equivalent to l time is displayed in du ⁇ ation Display start time of FoCFP, including can and PlayListEnd event (PTS) is generated, that is, when a PTS F o CFP [3] ⁇ OUT_time rather than PET F0CFP [3], FoCFP [ 3] of the display start time PTS F () In CFPm , PlayListEnd event occurs.
• PET F0 ⁇ ] indicates “the display time determined by pic-struct on PTS FP [k] durat 1 on Karo”.
• the time coincidence determination is limited to the video output, so the processing becomes light.
• the independence of video stream preparation and evening base preparation increases.
• the script Generate a PlayListEnd event for control module 2 1 1.
• the script control module 211 Upon receiving the PlayListEnd event, the script control module 211 knows that the PlayList that has been instructed to play has ended, and then continues the programmed operation. That is, another playList is played, a menu is displayed, the operation is terminated, and so on.
• the display start time of the last image + pic— durati on 0UT_time determined by struct, so the display start time of the last image + pic 5 11 ( ⁇ is determined (111 "011 ⁇ 01 ⁇ _" 11 ⁇ is not satisfied.
• the subtitle decoder control module 2 1 8 receives one subtitle access unit stored in the buffer 2 1 5 A from the subtitle read function section 23 5 of the buffer control module 2 15 (Fig. 5) and its subtitle access unit. Every time the time stamp added to is obtained, decoding starts with the internal caption decoding software, and at the same time, the time stamp and duration are passed to the decode control module 214.
• the decode control module 2 14 receives the PTS of the subtitle access unit passed from the subtitle decoder control module 2 1 8 when the time of the clock (time measuring unit 2 14 A) is changed according to the information from the video decoder control module 2 1 6. Examine. In other words, if the PTS of the subtitle access unit and the time are determined to match in accordance with the above-described match determination criteria, the decoding control module 2 14 instructs the graphics processing module 2 19 to input subtitles. At the same time, it instructs the subtitle decoder control module 2 1 8 to output.
• the subtitle decoder control module 2 1 8 supplies the decoded subtitle image data to the graphics processing module 2 19.
• the graphics processing module 2 19 stores the input subtitle data and synthesizes it for the video data to be input thereafter.
• the decode control module 2 1 4 further checks the subtitle display duration. In other words, if the current time of “display start time of relevant caption + display duration” and the current time are determined to match in accordance with the above-described match determination criteria, the decode control module 2 14 is transferred to the graphics processing module 2 1 9. For subtitles to be erased.
• the graphics processing module 2 1 9 deletes the stored input subtitle data, and does not synthesize the input video data.
• a certain range of time is quantized into a single time. In other words, all t times satisfying the display start time ⁇ t ⁇ display end time of certain video data are rounded at the display start time of the corresponding video data.
• FIG. 53 shows an example of the above conditions. That is, in Figure 53, Case A has a frame rate of 5005/24000 0 (progressive 23.976 Hz), and in this case, the minimum event interval expressed in 90 kHz is 7507 Case B has a frame rate of 4004/240000 (interlaced 59.94Hz) and In the case of, it is shown that the minimum event interval expressed in 90kHz is 6006.
• Video encoding methods such as AVC and MPEG2 Video have the function of displaying one frame signal for only three fields in order to efficiently encode 2-3 pull-down images. For this reason, the maximum duration of a signal in one frame is 3 fields. In other words, it is possible to prevent two adjacent events from being determined to occur at the display start time of a single video data by separating the intervals between adjacent events by a time of 3 fields or more. is there.
• intervals exceeding 3 fields can be defined as two or more frames.
• step S 1 26 of FIG. 34 the player control module 2 1 2 starts with one or more elementary list streams to be played back, that is, one or more elementary streams determined to be played back in step S 1 25 in FIG.
• the number_o that represents the number of DynamicInfoO (Fig. 15) in which the output attribute is described is examined and Dynamiclnfo (Fig. 12) is investigated.
• the player control module 2 1 2 performs output attribute control processing according to the flowchart of FIG.
• FIG. 30A and FIG. 30B the three clip information files “00001. CLP”, “00002. CLP”, “00003. CLP” recorded on the disc 1001, for example, are shown in FIG. 30A and FIG. 30B.
• the clip stream file “00001.PS” corresponding to the clip information file “00001. CLP” is played.
• the first Play It em # 0 of the first PlayList # 0 is played back.
• the four element list lists multiplexed in the clip stream file “00001.PS” are displayed. Since all of stream # 0 to stream # 3 are number_o and Dynamiclnfo is 0, output attribute control processing is not performed.
• 00002. CLP "(Fig. 30 A and Fig. 30 B) contains four element list streams stre am # 0 to stream # 3 multiplexed in the clip stream file" 00002PS ". For all, number—o and Dynamic Info is 0, so output attribute control processing is not performed.
• step S 320 the player control module 2 1 2 converts the pts_change_point described in the clip information file ClipO (Fig.
• step S 32 The attribute control time is passed to the decode control module 2 14, and the decode control module 2 14 receives the “DynamicInfo ()” from the player control module 2 1 2. It receives pts_change_point is the time of the attribute of the physical ", the flow proceeds to step S 32 1.
• step S 32 the decode control module 2 14 determines whether or not the current time measured by the time measuring unit 2 14 A matches the pts_change_point which is the time of the attribute of “DynamicInfo () processing”. If it is determined that they do not match, the process returns to step S 32 1.
• step S 3 2 1 If it is determined in step S 3 2 1 that the current time matches the time of the attribute of “DynamicInfo () processing”, the decoding control module 2 1 4 ”And the time of the attribute of“ DynamicInfo () processing ”that matches the current time (hereinafter referred to as“ Dynamiclnfo time ”as appropriate) is supplied to the player control module 2 1 2 Then, the process proceeds to step S322.
• the player control module 2 1 2 sends a message indicating that the current time is the time of the attribute “DynamicInfo () processing” and the Dynamiclnfo time from the decode control module 2 1 4. Receive Then, the DynamicInfoO that is set to the pts_change_point (Fig. 12) matching the Dynamiclnfo time is recognized as the processing target DynamicInfoO that is the processing target Dynamiclnfo (, and the process proceeds to Step S 3 2 3.
• step S323 the player control module 2 1 2 supplies the output attribute described in DynamicInfoO (FIG. 15), which is the target DynamicInfoO, to the graphics processing module 2 1 9 or the audio output module 22 1 Then, the process proceeds to step S324.
• DynamicInfoO (FIG. 15)
• step S 324 the graphics processing module '2 1 9 or the audio output module 22 1 determines whether the video data or audio data is changed according to the output attribute supplied from the player control module 2 1 2 in the previous step S 323. Each control of output is started, and the process returns to step S 32 1.
• video data to be output as an output method, for example, according to the aspect ratio, or audio data to be described as an output method, for example, stereo or dual (Nike). Is output.
• Fig. 55 shows 15-(& 1 ⁇ 6_0011 ⁇ and 1 ⁇ 11 & 1 ⁇ (; 11 ⁇ 0 described in the clip information file "00003. CLP" in Fig. 30A and Fig. 30B. A set with 0 (Fig. 12) is shown.
• the first elementary list of the three elementary list streams 5 63111 # 0 to 5 6 am # 2 multiplexed in the clip stream file “00003.PS” is used.
• number_o and dynamiclnfo are 2 and 3, respectively, in the clip information file “00003. CLP” in FIG. 30A and FIG. 30B. Therefore, in the clip information file “00003.GLP”, two sets of pts—change_point and Dynamic Info 0 are described for the first video stream stream # 0 of the clip stream file “00003.PS”.
• the third audio stream s tream # 2 three sets of pts-change-point and Dynamiclnfo 0 are described.
• Fig. 55 shows the two sets of pts-change-point and DynamicInfoO described for the first video stream stream # 0 of the clip stream file '00003.PS'.
• the lower part of Fig. 5 shows three sets of pts-change_point and DynamicInfoO that describe the third audio stream stream # 2 of the clip stream file "00003.PS".
• step S 1 25 of FIG. 34 the first video stream stream # 0 specified by stream_id which is OxEO of the clip stream file “00003.PS” is OxBD. It is assumed that the third audio stream stream # 2 specified by stream_id and private_stream_id which is 0x00 is determined as the playback target stream.
• the player control module 2 1 2 has two sets of pts_change-point and DynamicInfo () on the upper side of FIG. 55 describing the video stream stream # 0 identified by stream_id which is OxEO, Describes the audio stream specified by stream_id which is OxBD and private_stream_id which is 0x00.
• pts_change_point in 3 sets of pts_change—point and Dynamic nfoO at the bottom of Fig. 55 and recognize the initial value. 3 ⁇ 4 That is, the video stream s tream # 0 specified by stream_id which is OxEO is described in the upper set of Fig. 5-5.
• the time of 90,000 is the clip information file of FIG. 30 A and FIG. 30 B corresponding to the clip stream file “00003.PS” in which the video stream stream # 0 is multiplexed. 00003.
• the presentation time that represents the start time of clip stream file" 00003. PS is the same as 90,000 described in time.
• pts_change_point is 90,000.
• the time of 90,000 is the clip information shown in FIGS. 30A and 30B corresponding to the clip stream file “00003.PS” in which the audio stream stream # 2 is multiplexed.
• the present time that represents the beginning time of the clip stream file “00003.PS” matches the time 90, 000 described in time.
• the player control module 2 1 2 matches the time 90,000 described in present time—star and time, which represents the beginning time of the clip stream file “0 0003.
• PS” 15 _ (: 11 & 1 ⁇ 6_01111 is recognized as an initial value, so the two sets of pts_change_point on the upper side of Fig. 55 and the pts-chang point of the first set of DynamicInfoO, and the lower side of Fig. 55 Of the three sets of pts_change—point and Dynamic Info 0, the first set of pts_change_point is recognized as the initial value.
• the player control module 2 1 2 sets the pts_change_point recognized as the initial value in step S 1 2 6 in FIG. 3 4 before the reproduction of the clip stream file “00003.PS” is started.
• the output attribute of the corresponding element evening stream is indicated.
• the stream_id that is OxBD and the private stream stream # 2 that is specified by private — stream_id is 90,000, which is the initial value on the lower side of Figure 55.
• the channel-assignment is set to 'Dual'.
• the player control module 2 1 2 Information about the output attribute indicating that the channel assignment is “Dual”, that is, the audio stream stream # 2 is dual audio data is supplied to the audio output module 2 2 1 .
• step S 1 26 of FIG. 34 the output attribute control process for pts_change_point as the initial value as described above is performed.
• the player control module 2 1 2 determines the two pts_change—points 90, 000 and 54, 090, 000 on the upper side of FIG. 5 5 for the video stream stream # 0, and the audio stream stream # 2.
• the player control module 2 1 2 determines the two pts_change—points 90, 000 and 54, 090, 000 on the upper side of FIG. 5 5 for the video stream stream # 0, and the audio stream stream # 2.
• the player control module 2 1 2 determines the two pts_change—points 90, 000 and 54, 090, 000 on the upper side of FIG. 5 5 for the video stream stream # 0, and the audio stream stream # 2.
• the three pts_change_points 90 000, 27,090,000 and 32, 490, 000 at the bottom of Fig.
• the decode control module 2 1 4 receives the time ⁇ 27, 090, 000 ⁇ , ⁇ 32, 490 000 ⁇ , ⁇ 54, 090, 000 ⁇ of the attribute of “DynamicInfo () processing” from the player control module 2 1 2 In addition, after the reproduction of the video stream s tream # 0 and the audio stream stream # 2 is started, monitoring of the current time measured by the timer unit 2 1 4 A is started.
• the decoding control module 2 14 When the current time matches any of the times ⁇ 27,090,000 ⁇ , ⁇ 32,490,000 ⁇ , ⁇ 54,090,00 00 ⁇ of the attribute “Dynami clnfoO processing”, the decoding control module 2 14 The Dynamiclnfo time that is the time of the attribute of “Dynamic InfoO processing” that matches the time is supplied to the player control module 2 1 2 (step S 3 2 1).
• the decode control module 2 14 will match the current time of the “DynamicInfo () process” attribute time 27,090. , 000 is supplied to the player control module 2 1 2 as the Dynamiclnfo time.
• Player control module 2 1 2 receives Dynamiclnfo time 27, 090, 000 from decor control module 2 1 4, and receives two pts_change_points on the upper side of Fig. 55 for video stream stream # 0. 3 pts ch on the lower side of Fig. 5 5 for stream # 2 pts_change_point that matches Dynamic Info time 27,090,000 is investigated from ange_point, and DynamicInfoO that is paired with pts_change — point that matches 27,090,000, that is, audio stream The second Dynamic Info 0 on the lower side of FIG. 55 for the stream stream # 2 is recognized as the processing target DynamicInfoO (step S322).
• the player control module 2 1 2 supplies the output attribute described in the processing target Dynami clnfoO to the graphics processing module 2 1 9 (Ste S 32 3). If the processing target Dynamiclnf ⁇ is DynamicInfoO for the audio stream, the player control module 2 1 2 supplies the output attribute described in the processing target DynamicInfoO to the audio output module 22 1 (step S 323 )
• the graphics processing module 2 19 starts control of video output according to the output attribute (step S 3 24).
• the graphics processing module 2 1 9 displays, for example, the display ratio of the video data represented by the output attribute from the player control module 2 1 2 (Fig. 15).
• the aspect ratio of the video output device connected to the video output terminal 120 in FIG. 1 the conversion of the aspect ratio of the video output to the video output module 220 is performed.
• graphics The processing module 2 1 9 is the video module that outputs to the video output module 220. Squeeze the evening in the horizontal direction and input and output data that displays black on the left and right. Also, for example, when the aspect ratio of the video output device is: 3, and the indication of the aspect ratio of the video data as the output attribute indicates the aspect ratio of 16: 9, the graphics processing The video module 2 1 9 squeezes the video to be output to the video output module 2 2 0 in the vertical direction and outputs the data that displays black on the top and bottom.
• the aspect ratio of the video output device and the aspect ratio indicated by the aspect ratio of the video data as the output attribute are both the same at 4: 3 or 16: 9.
• the graphics processing module 2 19 outputs the video data output to the video output module 2 20 without any squeeze processing.
• the video stream stream # 0 Video data having an aspect ratio of 4: 3 is obtained from the video stream stream # 0 until the time 90,000 at the start of playback or immediately before the time 54,090,000. After the time 54, 090, 000, video data having an aspect ratio of 16: 9 is obtained from the video stream stream # 0.
• the graphics processing module 2 19 has a time ratio of 90,000. Until just before time 54,090,000, the 4: 3 aspect ratio video obtained from the video stream stream # 0 is supplied to the 4: 3 aspect ratio video output device and displayed as it is. The After the time 54, 090, 000, the video data with the aspect ratio of 16: 9 obtained from the video stream stream # 0 is squeezed in the vertical direction, and black is added vertically. It is converted to a 4: 3 'aspect ratio video signal that contains the data to be displayed and supplied to a 4: 3 aspect ratio video output device for display.
• the audio output module 2 2 1 starts controlling the output of audio data in accordance with the output attribute (step S 3 2 4).
• the audio output module 2 2 1 is, for example, an audio data channel assignment instruction (channel assigment (Fig. 15)) represented by the output attribute from the breaker control module 2 1 2 and the user.
• the audio decoder control module 2 1 7 based on the audio output mode supplied from the player control module 2 1 2 through the input interface 1 1 5 (Fig. 1) by operating the remote control.
• the audio data from is processed and output to the audio output terminal 1 2 1 (Fig. 1).
• the channel assignment instruction for the audio data indicated by the output attribute is dual (Dual) where the left channel is “main audio” audio data and the right channel is “sub audio” audio data.
• the audio output module 2 2 1 processes the audio data from the audio decoder control module 2 1 7 according to the audio output mode supplied from the player control module 2 1 2 And output to the audio output terminal 1 2 1. That is, for example, when “main audio” is designated as the audio output mode, the audio output module 2 2 1 is connected to the left channel of the audio data from the audio decoder control module 2 1 7.
• Audio data of the right channel is copied as audio data of the right channel, and the audio data of the left channel and right channel (audio data of “main audio” 1 ) is output to the audio output terminal 1 2 1.
• the audio output module 2 2 1 is the audio data of the right channel of the audio data from the audio decoder control module 2 1 7. Is copied as audio data for the left channel, and the audio data for the left and right channels (“sub audio” audio data) is output to the audio output terminal 1 2 1.
• “Main / Sub” is specified as the audio output mode
• the audio output module 2 2 1 uses the audio data from the audio decoder control module 2 1 7 as it is. Output to 1.
• the audio output module 2 2 1 when the channel assignment instruction of the audio data represented by the output attribute indicates the stereo mode, the audio output module 2 2 1 outputs the audio output supplied from the player control module 2 1 2 Regardless of the mode, audio data from the audio decoder control module 2 1 7 is output to the audio output terminal 1 2 1 as it is.
• the audio output module 22 1 has the audio stream stream # 2 from time 90,000 to just before time 27,090,000.
• the audio channel for the left channel is copied as the audio data for the right channel, and the audio channel for the left channel and the right channel is the audio output port 1 2 Output to 1.
• the stereo audio data obtained from the audio stream stream # 2 is output to the audio output terminal 1 2 1 as it is.
• the audio data of the left channel of the dual audio overnight obtained from the audio stream stream # 2 is copied as the audio data of the right channel, and the left channel and the right channel Audio data is output to the audio output terminal 1 2 1.
• pts_change_point indicating the playback time of the elementary stream and the output attribute of the elementary stream are displayed.
• clip information file ClipO Fig. 12
• the playback time of the elementary stream being played matches pts_change—point It is determined whether or not to do so. If the playback time of the currently playing element stream matches the pts change_point, the pts. change—DynamicInfoO set as a point is recognized, and the output of the elementary stream being replayed is controlled according to the output attribute included in the recognized Dynamic Info0. Therefore, the output of the elementary stream can be controlled according to the playback time and output attribute of the elementary stream.
• the player control module 2 1 2 When the playback of PlayListO is started, the player control module 2 1 2 initializes the subtitle data display method instruction to the graphics processing module 2 1 9 in step S 341. That is, the player control module 2 1 2 controls the graphics processing module 2 19 so that the display method of the caption data is the default display method.
• the initialization of the display method instruction performed in step S 341 corresponds to the initial display method instruction described in 127 of FIG.
• step S 34 the process proceeds to step S 342, and the player control module 2 1 2 controls the display of the subtitle data from the input interface 1 1 5 by the user operating the remote control. Determine if an instruction has been given.
• step S 342 If it is determined in step S 342 that an instruction for a new display method has been received, the process proceeds to step S 343, and the player control module 2 1 2 determines whether the subtitle stream is currently being reproduced. If it is determined in step S343 that the subtitle stream is not played back, the process returns to step S342.
• step S343 the subtitle stream is not played back. If it is determined, the process proceeds to step S 345, where the player control module 2 1 2 determines whether or not the instruction of the new display method is the default display method ( ⁇ instruction. Step S 343 If it is determined that the instruction of the new display method is the instruction of the default display method, the process returns to step S 341 and, as described above, the player control module 2 1 2 The graphics processing module 2 1 9 is controlled so that the default display method is used.
• step S345 if it is determined in step S345 that the instruction for the new display method is not the instruction for the default display method, the instruction for the new display method is immediately applied, for example, by enlarging or reducing the caption data. If it is a non-default display instruction such as displaying or changing brightness to make it easier to see, the process proceeds to step S 346 and the player control module 2 1 2 multiplexes the currently playing subtitle stream. Get the StaticInfoO for the currently playing subtitle stream from the StaticInfoO (Fig. 14) of the clip information file Clip 0 (Fig. 1 2) corresponding to the clip stream file created, and go to Step S347 .
• step S347 the player control module 2 1 2 determines the configurable_flag of StaticInfoO acquired in step S346.In step S347, configurable_flag is set to 0 indicating that the subtitle data display method is not allowed to be changed. If it is determined, the process proceeds to step S 348, and the player control module 2 1 2 controls the graphics processing module 2 1 9 to change the display method of the caption display to the output video data. Overlay the error message to the effect that it cannot be performed, and return to step S342. This will display an error message.
• step S 347 if it is determined in step S 347 that configurable_flag is set to 1 indicating that subtitle display is allowed to be changed, the process proceeds to step S 349 and the player control module 2 1 2 The instruction of the new display method supplied from the input interface 1 1 5 by the user operating the remote controller is supplied to the graphics processing module 2 1 9, and the process proceeds to step S 3 50.
• step S 350 the graphics processing module 2 1 9 displays the caption data supplied from the picture decoder control module 2 1 8, and the display method instruction supplied from the player control module 2 1 2 in the immediately preceding step S 349.
• processing such as enlarging or reducing or changing brightness is started, and the process returns to step S342.
• the caption display is displayed in the display size, display position, display color, etc. according to the display method instructed by the user operating the remote control.
• step S 342 determines whether there is no instruction for a new display method. If it is determined in step S 342 that there is no instruction for a new display method, the process proceeds to step S 3 51, and the player control module 2 1 2 performs the transfer of PlayltemO described in FIG. If it is determined that it has not been performed, the process returns to step S342.
• Step S 3 51 If it is determined in Step S 3 51 that PlayltemO has been changed, the process returns to Step S 341 and, as described above, the player control module 2 1 2 sets the display method of subtitle data to the default.
• the graphics processing module 2 19 is controlled so as to use the display method. In other words, in this case, when PlayltemO is switched, the subtitle data display method is returned to the default display method.
• the cofnig igurable_flag of the subtitle stream is set to 1 indicating that the change of the display method is permitted. Only when the subtitle data display method corresponding to the subtitle stream is changed in accordance with, for example, a display: ⁇ expression input by the user operating the remote control. Therefore, for example, according to the clip information file “00001.CLP” shown in FIG. 30A and FIG. 30B, it is multiplexed into the corresponding clip stream file “00001.PS”.
• the conf igurable_flag for the subtitle stream st ream # 2 that is the third elementary stream out of the four elementary streams is 0, indicating that the display format change is not allowed.
• the subtitle stream stream # 2 is displayed, even if the user operates the remote control to change the subtitle display, the display does not change.
• the subtitle stream stream # 3 which is the fourth elementary list stream, is configurable — The flag is set to 1 to allow the display mode to be changed.
• the remote control can be used so that the user can change the subtitle display.
• the subtitle display size etc. is changed according to the operation.
• the clip stream file “00001.PS” is being played back according to the first P1 ayltemitO of the first PyList # 0 in FIG.
• the four element list lists multiplexed in clip stream file '00001.PS ” —
• the third and fourth subtitle streams are subtitle streams, but the third subtitle stream stream # 2 and the fourth subtitle stream stream # 3, for example, the third subtitle stream stream Is currently playing Suppose that
• step S 34 2 When the user inputs the indication of the subtitle display method by operating the remote control (step S 34 2), the display method is instructed by the player control from the entrance screen 1 1 5 (Fig. 1). Supplied to modules 2 1 2 When the display control instruction is supplied, the player control module 2 1 2 searches the clip information file for StaticInfoO (FIG. 1 2) corresponding to the subtitle stream being played back (step S 346).
• the subtitle stream being played back is the third subtitle stream stream # 2 multiplexed in the clip stream file “00001.PS”, and the player control module 2 1 2 From the clip information file “00001. CLP” to be searched, find Static Info 0 for the third subtitle stream stream # 2.
• the player control module 2 1 2 is set to 0 in the Static Info () for the third subtitle stream stream # 2 in FIGS. 30A and 30B. igiirable_flag is determined (step S 3 4 7), thereby recognizing that change of the display method is not permitted for the third subtitle stream stream # 2. In this case, the player control module 2 1 2 determines that the subtitle stream being played does not support enlargement / reduction, etc., and controls the graphics processing module 2 1 9 to give an error message to that effect. Generate (Step S34 8) and overlay the video data for output.
• the third subtitle stream of the fourth subtitle stream stream # 2 and the fourth subtitle stream stream # 3 of the four elementary streams multiplexed in the clip stream file “00001.PS” story If the fourth subtitle stream streamit3 is currently being played instead of the stream # 2, the player control module 2 1 2 that has been supplied with the indication instructions by operating the remote control Find Static Info 0 for the fourth subtitle stream stream # 3 from the clip information file “00001. CLP”.
• the player control module 2 1 2 sets configurable_flag which is 1 described in Staticlnfo () for the fourth subtitle stream sam # 3 in FIG. 30A and FIG. 30B. This makes a determination (step S 347), thereby recognizing that the change of the display method is permitted for the fourth subtitle stream stream # 3.
• the player control module 2 1 2 determines that the subtitle stream being played back corresponds to enlargement / reduction, etc., and displays the instruction of the display method supplied by the user operating the remote control. Supply to module 2 1 9 (step S349).
• the graphics processing module 2 19 then enlarges or reduces the subtitle data from the subtitle decoder control module 2 1 8 in accordance with the display method instruction from the player control module 2 1 2, and the video.
• Decoder control module 2 1 Overlays video data from 6 and outputs.
• the player control module 2 1 2 initializes the subtitle data display method instruction to the graphics processing module 2 1 9 at the start of playback of the first Play ItemO of PlayListO (step S 341). That is, the player control module 2 1 2 controls the graphics processing module 2 1 9 so that the subtitle data display method is the default display method.
• the player control module 2 1 2 will change PlayltemO
• the instruction of the display method of the caption display to the graphics processing module 2 19 is initialized (steps S 341 and S 35 1).
• the configurable_flag for the new subtitle stream that is played back in accordance with PlayltemO that is played back after that is checked. If configurable_flag is 0, the graphics processing module 2 1 9 Initialize the subtitle display method, and if the configurable flag is 1, keep the display method for the graphics processing module 2 1 9 as it was before switching to Playltem 0. It is possible.
• the new display method instruction is sent to the graphics processing module 2 1 9 (Step S349), however, the indication of the display method is stored in, for example, the non-volatile memory constituting the memory 1 1 3 (Fig. 1) and stored in the non-volatile memory. It is possible to supply a display processing instruction to the graphics processing module 2 19.
• an instruction of a user-set display method is stored in a nonvolatile memory, and a new display method is operated by the user operating the remote control.
• the display instruction is input, the display method instruction stored in the nonvolatile memory is updated to a new display method instruction, while the display method instruction stored in the nonvolatile memory is updated to the graphics. It is possible to supply to the processing module 2 1 9.
• the user can operate the remote control during the next PlayList () playback to Even if you do not enter the display method instruction in , Subtitle data display starts.
• 1 to the display mode instruction is stored in the nonvolatile memory, for example, is intended to include enlargement ratio or reduction ratio and the like at the time of enlarging or. Reducing the Isseki subtitle de.
• subtitle display control processing for each elementary stream included in the clip information file ClipO (Fig. 12), it does not change during playback of the elementary stream 31 & 1 ⁇ 111 [0 () subtitle data StaticInfoO is acquired and included in the static information 0 is a configurable_nag that indicates whether to allow changing the subtitle data display from the default display format. Based on this, it is determined whether or not the subtitle display during playback is allowed to be changed from the default display format. If the display of the subtitle data being played is allowed to be changed from the default display method, the subtitle data display process, That is, for example, processing for displaying subtitle data by enlarging or reducing or changing the display color is performed. Therefore, it is possible to control the change of the subtitle display method.
• FIG. 57 shows a flowchart explaining the capture control process and a flowchart explaining the background Z screen saver process as an example of a process of secondary use of the video data captured by the capture control process. Is also illustrated.
• the capture control process can be performed by the user operating the remote control.
• a capture instruction for instructing the capture of video data is supplied to the player control module 2 1 2 via the input interface 1 15 (FIG. 1). 'That is, in the capture control process, first, in step S 3 7 1, if the player control module 2 1 2 determines whether or not the video stream is being played back, The capture control process ends.
• step S 37 1 determines whether the video stream is being played back. If it is determined in step S 37 1 that the video stream is being played back, the process proceeds to step S 372, where the player control module 2 1 2 plays PlayListO (the first list corresponding to the video stream being played back). Capture_enable_flag_PlayList is acquired from (Fig. 7), and capture_enable_flag_Clip is acquired from the clip information file ClipO (Fig. 12) corresponding to the video stream being played.
• PlayListO the first list corresponding to the video stream being played back.
• capture_enable_flag_PlayList in PlayList 0 indicates whether or not secondary use of a video stream corresponding to a video stream played back by PlayListO is permitted as described in FIG.
• the capture_enable_flag_ Clip in the clip information file ClipO is used for secondary use of the video data corresponding to the video stream stored in the clip stream file corresponding to the clip information file Clip 0, as described in FIG. Indication of whether to allow or not
• the process proceeds to step S 3 73, and the player control module 2 1 2 acquires the capture—enable—flag—PI acquired in the immediately preceding step S 37 3.
• Based on ayLis ture_enable_f lag_Cl ip it is possible to capture the picture of the video data being played when the capture instruction is input from the input interface 1 1 5 (Fig. 1). Determine no.
• step S3 7 3 If it is determined in step S3 7 3 that the capture of the picture of the video data being played when the capture instruction is input from the input interface 1 1 5 is impossible, that is, the previous step If at least one of capture_enable_flag_PlayList or capture_enable_flag_Clip acquired in step S 37 3 is 0 indicating that secondary use of video data is not permitted, the process proceeds to step S 3 74 and the player control module 2 1 2 controls the graphics processing module 2 19 to overlay an error message indicating that the video data cannot be captured, and ends the capture control process. This will display an error message.
• step S 373 if it is determined in step S 373 that the capture of the picture of the video data being played back when the capture instruction is input from the input interface 1 1 5 is possible, that is, the immediately preceding step. If both capture—enable—flag_PlayList and capture_enable_flag_Clip obtained in S 3 7 3 are set to 1 to allow secondary use of video —evening, go to step S 3 7 5 to control player Module 2 1 2 supplies the graphics processing module 2 1 9 with the capture instruction of the picture of the video data being played back when the capture instruction is input from the input interface 1 1 5, and the step Proceed to S 376.
• step S 3 7 6 the graphics processing module 2 1 9 captures the picture of the video data from the video decoder control module 2 1 6 according to the instruction of the capture from the player control module 2 1 2, and the memory 1 1 3 (Fig. 1) is memorized and the capture control process ends.
• capture-enable_flag has a multi-bit configuration. If there are restrictions on the usage conditions, measures will be taken at this point. That is, play 3 ⁇ 4 If there is a limit to the size of the image Kiyapucha, image reduced at this point is Kiyapucha. If there are restrictions on the application to be used, a flag to that effect is recorded at the same time.
• Play ListO (Fig. 7) and clip information file ClipO (Fig. 12) corresponding to the video stream being played when a capture instruction is received from the user, respectively.
• 0apture_enable_f lag PlayList and capture one enable_f lag— If the logical product of CI ip and the logical AND is 1, that is, capture_enable_flag_PlayList and capture_enable—f lag_Cl ip both allow secondary use Only when it is set to 1, it is determined that secondary use of the video data is possible, and capture is performed. '
• the video stream is played, that is, the video stream is multiplexed into the clip stream file “oooor.ps”.
• the capture_enable_flag_PlayList in the first PlayListitO is 1 and the clip stream file “00001.PS played by the first Play It em # 0” Since capture_enable_f g_Clip in “Clip information file in Fig. 30A and Fig. 30B corresponding to" 00001. CLP "is 1, it is multiplexed into the video data being played (clip stream file" 00001.PS " It is judged that secondary use of the video data corresponding to the received video stream is possible, and captification is performed.
• capture_enable_flag_PlayList in the first PlayList # 0 is 1 when there is a capture instruction from the user.
• Capture_enable—flag_Clip is 0 in the clip information file “00002.CLP” in FIGS. 30A and 30B corresponding to the clip stream file “00002.PS” played by the second Playltem # l
• the secondary use of the video data being played (video data corresponding to the video stream multiplexed in clip stream file “00002.PS”) is judged to be impossible, and no capture is performed.
• the video stream is played, that is, the video stream multiplexed in the clip stream file “00003.PS” is played.
• c ap tur e_enab 1 e_f 1 ag_P 1 ayL ist in the second P 1 ayL ist # 1 is 0, and PlayItem # 0 in the second PlayList # l
• the pictures captured by the capture control process and stored in the memory 1 1 3 can be used secondary in the background screen saver process.
• Background Z screen saver processing is performed when, for example, the player control module 2 1 2 is operating but the elementary stream is not played back, that is, the disk drive 1 0 2 (Fig. 1) This is done when 1 0 1 is not inserted, or when elementary stream playback has ended.
• step S 3 80 the player control module 2 1 2 sets the graphics processing module 2 1 9 to display the picture stored in the memory 1 1 3 by the capture control process. Control.
• the graphics processing module 2 19 displays the pictures stored in the memory 1 13 by the capture control processing in accordance with the control from the player control module 2 1 2.
• the graphics processing module 2 1 9 if the picture stored in the memory 1 1 3 is displayed as a still image, so-called wallpaper is realized and displayed while being enlarged, reduced, moved, etc. at a fixed period. In this case, a screen server is realized. Further, the background screen saver process for displaying the picture stored in the memory 11 13 by the capture control process can be performed by another independent application instead of the player control module 2 1 2.
• capture_abble—flagJ ayList and capture—enable—flag_Cl ip are acquired for the video data being played, indicating whether secondary use of video data corresponding to PlayListO or PlayltemO is permitted.
• a capture_enable_flag—PlayList is provided in PlayListO (FIG. 7), and a clip information file ClipO (FIG. 1)
• Fig. 2 capture_enable_flag — Clip is provided, and permission for secondary use is determined using both capture_enable—flag_P yList and capture—enable —flag— Clip.
• Fig. 7 simply provide capture-enable_flag_PlayList, or simply provide capture_enable-flag_Clip in the clip information file ClipO (Fig. 12) corresponding to the clip stream file played by PlayltemO (Fig. 12).
• flag—PlayList or capture—enable—flag_Cl Use only one of ip to determine whether secondary usage is possible.
• step S376 the graphics processing module 2 19 follows the capture instruction from the player control module 2 1 2, and the video decoder control module 2 1 6 Picture of video data from, ie one pict Only the capture is captured, but it is also possible to capture multiple pictures. That is, it is possible to capture a plurality of time-series pictures output from the video decoder control module 2 16. In this case, the number of pictures to be captured at one time can be determined in advance, for example. Or, capture_ enable—flag—PlayList or capture—enable—flag—CI ip hits have been expanded to capture one enable—flag—PlayList or capture—enable—flag—one CI ip. You may include information on the number of sheets. '
• Permission information for J (capture—enable—flag_PlayL ist, capture—enable—flag—Clip) is set to PlayListO, The clip information file described in CI ip 0 and the video data corresponding to the video stream multiplexed in the clip stream file corresponding to the clip information file ClipO or the entire video data played by PlayListO according to the usage permission information It was decided to determine whether or not secondary usage is possible for the entire system.
• the usage permission information describes video data in any other unit, and the usage permission information is used to determine whether or not the video data is in any unit. It is possible to determine whether the next use is possible.
• Fig. 58 shows the syntax of private_stream2_PES-payloadO in which usage permission information is arranged
• Fig. 59 shows the syntax of au_information () in which usage permission information is arranged.
• private-stream2-PES-payloadO in Fig. 58 is the same as in Fig. 26 except that capture_enable_flag_ps2 as the usage permission information is placed immediately before the video-stream id. It is configured.
• Au_information () in Fig. 5 9 is also pic st rue The configuration is the same as in the case of Fig. 27 except that capture_enable_flag—AU is set as permissible information.
• capture 1 flag — ps 2 is the private—stream2—PES—pay load 0 This indicates whether or not secondary usage of the video stream corresponding to the video stream arranged immediately before the next private-s tream—2 PES—packet tO is permitted.
• capture_enable_flag_ps2 placed in private_stream2_PES_payload () in Fig. 8 it is determined whether or not secondary use is permitted for video data from one decode start point to the next decode start point. be able to.
• capture-enable-flag_AU arranged in au_information () in Fig. 59 indicates whether or not secondary use of video data of the video access unit corresponding to the capture_enable_flag_AU is permitted. Therefore, according to capture_enaMe_flag_AU arranged in au_information () in Fig. 59, it is possible to determine whether or not to permit secondary use of video data in units of video access units, that is, in units of pictures. .
• capture_enable_flag_PlayList as usage permission information in PlayListO (Fig. 7), capture_enable_nag_Clip, privat e_stream2_PES_payload () as usage permission information in clip information file CI ip 0 (Fig. 1 2) (Fig. 58) Capture_enable_flag as permission information capture_enable_flag as usage permission information in ps2, au_inf ormation 0 (Fig. 59)
• the availability of secondary use of a picture of a video data is not less than 2 This can be determined based on the logical product of the use permission information.
• the fifth 9 view of au_information () is in the second 6 view or j 5 Figure 8 disposed private- st ream2- PES- pay including load 0 private- stream_2 of P ES_packet () is the fourth 5
• the video read function unit 2 3 3 of the buffer control module 2 1 5 (Fig. 5) searches from the program stream stored in the buffer 2 1 5 A. To do. Therefore, when adopting p rivate_s tream2_PES_payload 0 in Fig. 58, where capture_enable-flag-ps2 is arranged, or au_information () in Fig.
• the player control module 2 1 2 needs to inquire the video reading function unit 2 3 3 for capture_enable_flag_ps2 and capture-enable-flag-AU when determining whether or not the secondary use of the video data is possible.
• the disc recording device shown in FIG. 60 can be applied to, for example, a disc player, a game device, a force navigation system, and the like.
• the disc 4 10 is, for example, an optical disc such as a DVD, a magneto-optical disc, a magnetic disc, etc. Overnight, and even content data can be recorded. Incidentally, the disc 4 10 can be used as the disc 1 0 1 in FIG. 1 by recording various events.
• the video input terminal 40 OA is connected to a video input device such as an imaging device (not shown), and supplies video data supplied from the video input device to the video input interface 401.
• Audio input terminal 4 0 0 B is connected to an audio input device such as a microphone or an amplifier (amplifier) (not shown), and supplies the input audio data to the audio input interface 4 0 2.
• 'Video input interface 4 0 1 performs necessary processing on the input video data and supplies it to video encoder 4 0 3 via bus 4 1 1.
• the audio input interface 4 0 2 performs predetermined processing on the input audio data and supplies it to the audio encoder 4 0 4 via the bus 4 1 1.
• the video encoder 40.3 encodes the video data supplied from the CPU 4105 and the video input video source, and the resulting compressed encoded data (encoded video data: eg MPEG 2 video stream) is recorded on the disc 4 1 0 by the disc drive 4 0 9 via the bus 4 1 1.
• the audio encoder 4 0 4 encodes the audio data supplied from the CPU 4 5 and the audio input interface 4 0 2, and the resulting compressed encoded data (encoded audio data). Evening: For example, MPEG 2 audio stream) is recorded on the disc 4 1 0 by the disc drive 4 0 9 via the bus 4 1 1.
• the CPU 4 0 5 and the memory 4 0 6 form a computer system. That is, the CPU 400 5 executes the program stored in the memory 4 06 to control the entire disk recording apparatus and perform various processes described later.
• the memory 4 0 6 stores a program executed by the CPU 4 5.
• the memory 4 06 temporarily stores data necessary for the operation of the CPU 4 5.
• the memory 406 can be composed of only a nonvolatile memory or a combination of a volatile memory and a nonvolatile memory.
• the program executed by the CPU 4 5 can be stored in advance in a memory 4 6 as a recording medium built in the disk recording device.
• the program may be a disk drive 4 0 9, a flexible disk other than the disk drive 4 0 9, a CD-R0M (Compact Disc-Read Only Memory), a MO (Magneto Optical) ice, a magnetic disk, a memory It can be stored temporarily or permanently on a removable recording medium such as a card. Such a removable recording medium can be provided as so-called package software.
• the program can be stored in advance in the memory 406, or can be installed in the disk recording device from the removable recording medium as described above.
• the program can be transferred wirelessly from a download site via a satellite for digital satellite broadcasting to a disk playback device, or via a network such as a LAN (Local Area Network) or the Internet. Wired transfer to the playback device, and the disc playback device can receive the program transferred in this way through the input interface 4 0 8 and install it in the built-in memory 4 0 6.
• the program may be processed by one CPU, or may be processed by multiple CPUs in a distributed manner.
• the drive interface 4 0 7 controls the disk drive 4 0 9 under the control of the CPU 4 0 5, so that the CP 4 via the bus 4 1 1 Data supplied from U40 5, memory 40 6, video encoder 40 3, audio encoder 404 is supplied to disk drive 40 9 i and recorded on disk 4 1 0 or recorded on disk 4 1 0 The stored data is read and supplied to the CPU 405 and the memory 406 via the bus 4 111.
• the input interface 408 receives a signal supplied by a user operating a key (button) (not shown) or a remote control (remote control commander), and supplies the signal to the CPU 40 5 via the bus 4 1 1. To do. Note that the input interface 408 also functions as a communication interface such as a mote (including an ADSL (Asymmetric Digital Subscriber Line) moam) or a NIC (Network Interface Card).
• a mote including an ADSL (Asymmetric Digital Subscriber Line) moam
• NIC Network Interface Card
• the video data and audio data can be supplied from the video input device and the audio input device to the disk recording device either by wire or wirelessly.
• a disk 4 10 is removable from the disk drive 40 9.
• the disk drive 409 has a built-in interface (not shown), and is connected to the drive interface 407 through the interface.
• the disk drive 409 drives the disk 410 mounted on the disk drive 409 and performs processing such as recording data on the disk 41 0 according to a recording instruction from the drive-in evening face 407.
• the data (recorded data) recorded on the disc 4 10 includes a program that can be executed by a computer, if necessary.
• the disk 4 10 which is a disk-shaped recording medium is adopted as the recording medium. It may be a semiconductor memory or a tape-shaped recording medium.
• Bus 4 1 1 has CPlKCentral Processing Unit
• Memory 06 Memory 06
• Drive interface 407 Drive interface 407
• Input interface 40 8 Video encoder 40 3
• Audio encoder 404 Video input interface 40 1, Audio input interface 40 2 Is connected.
• the audio encoder 404 compresses and encodes the audio signal input via the audio input terminal 400 B and the audio input / force interface 402 and outputs the result to the multiplexer 42 1. To do.
• the video encoder 403 compresses and encodes the video signal input via the video input terminal 400 A and the video input interface 401, and outputs the video signal to the multiplexer 421.
• the multiplexer 42 1 packetizes the input MPEG 2 video stream and MPEG 2 audio stream, and uses the above-described FIG. 18A and FIG. 18B to FIG. 27 for explanation. As you can see, time division multiplexing is used.
• the multiplexer 421 selects an intra picture in the stream and inserts PES_packet () of private_stream_2 shown in Fig. 26 at a frequency of about twice per second.
• the multiplexer 421 outputs the multiplexed stream to the RAPI rewriter 424 via the FIF 0422 and simultaneously outputs it to the RAPI information extractor 423.
• the video stream multiplexed into the multiplexed stream is placed immediately after the PES_packet 0 start position of private_stream_2 and immediately after PES_packet 0 of private_stream 2 Detect and store the time stamp (PTS) value of the intra picture, the corresponding intra picture, and the end positions of the second, third, and fourth reference images.
• PES time stamp
• the RAPI information extractor 4 2 3 outputs the detected intra picture and the end positions of the second, third and fourth reference images following it to the RAPI rewriter 4 2 4.
• the RAPI rewriter 424 overwrites the fields of lstR6 and picture, 2ndRef_picture> 3rdRef_picture> hRef— picture in Fig. 26 as RAPI information, and the reference images of the first, second, third and fourth reference images are overwritten respectively.
• the end position is recorded as a numerical value in units of sectors and stored in the output server 4 2 6.
• the controller 4 25 When the processing of the entire multiplexed stream is completed, the controller 4 25 is placed immediately after RAPI, and the start positions of all the RAPIs multiplexed and multiplexed in the multiplexed stream extracted and stored by the RAPI information extractor 423. Get the end position of the reference picture and the second, third, and fourth reference pictures.
• the controller 425 uses the input information to create EPjnapO described with reference to FIG.
• the address, the PTS of the immediately following intra picture, the intra picture and the second picture following it are sent to the RAPI.
• step S 3 8 the video encoder 403 is compressed via the video input terminal 400 A and the video input interface 40 1; (compressed encoded video signal is output to the multiplexer 421.
• the audio encoder 4 04 compresses and encodes the audio signal input via the audio input terminal 400 0 B and the audio input interface 402 and outputs the audio signal to the multiplexer 42 1.
• the stream output from the audio encoder 404 is an MPEG 2 audio stream
• the stream output from the video encoder 43 is an MPEG 2 video stream.
• step S 3 82 the multiplexer 42 1 converts the input MPEG2 video stream and MPEG2 audio stream into a bucket, and converts FIG. 18 A and FIG. 18 B to FIG.
• time-division multiplexing (packetization) is performed, an intra picture in the stream is selected, and PES_packet 0 of private_stream_2 shown in Fig. 26 is inserted at a frequency of about twice per second.
• PES_packet 0 of private_stream—2 indicates that a video intra-picture that can be decoded without referring to another picture is placed immediately after.
• a time stamp (PTS / DTS) is always assigned to the corresponding intra picture.
• the sub-title stream may be input to the multiplexer 4 2 1 and multiplexed together with the video stream and the audio stream.
• step S 3 83 the multiplexer 42 1 outputs the multiplexed stream to the RAPI rewriter 424 via the FIF042 2 and simultaneously outputs it to the RA PI information extractor 423.
• RAPI information extractor 42 3 Privat e_st ream— 2 PES in the video stream multiplexed into the multiplexed stream, the start position of packet 0, and 01 ” ⁇ 16_5 ⁇ & 111_2? 55_ ⁇
• the time stamp (PTS) value and the corresponding intra picture, and the end positions of the second, third, and fourth reference images that follow are detected and stored.
• the RAPI information extractor 4 2 3 outputs the detected intra picture and the end positions of the second, third, and fourth reference images following the detected intra picture to the RAPI rewriter 424.
• the RAPI rewriter 4 24 overwrites the RAPI information, including the IstRe- picture, 2ndRef_picture, 3rdRef_picture, and thRef_picture fields in Fig. 26, and the first, second, third, and fourth reference images, respectively. Is recorded as a numerical value in units of sectors and further stored in the output server 426.
• step S 3 85 the RAPI information extractor 42 3 extracts and stores the start position of all RAPIs multiplexed in the multiplexed stream, the intra picture placed immediately after RAPI, and the subsequent 2
• the end positions of the third, fourth, and fourth reference images are input to the controller 4 2 5.
• Controller 4 2 5 uses the input information to create EP-map 0 described with reference to FIG. It is assumed that the EPjnap 0 created here contains only the video stream information. EPjnap 0 for video is the location of all RAPIs placed in the stream, ie PES_packet () of private_stream_2, and this information is the information input from RAPI information extractor 4 2 3 to controller 42 5 Created with.
• the controller 425 starts from the data input from the RAPI information extractor 423 to RAPI with its address, the PTS of the immediately following intrastructure, the intrastructure, and the following. 2 sheets Select one of the end positions of the 3rd, 4th, and 4th reference images, create EPjnapO in the clip information file, and store it in the output server 4 26. That is, the controller 425 has a predetermined number of sectors out of the four reference image end positions (IstRef—Picture, .2ndRe, Picture, 3rdRef—Picture, 4thRe, Picture).
• the controller 4225 determines and records index minus1 based on N-th—Ref_picture_copyi. 1 Record to 0.
• the stream data and the database file stored in the output server 4 26 are supplied to the disk drive 409 from the drive interface 407 and recorded on the disk 4 10.
• the player control module 2 1 2 selects the playback start position 1 registered in EP_map () from the clip information file of the stream being played (step S 3 9 1), and RPN_EP_start described there Then, the read data from the size of N-th_Re and Picture_copy is determined (step S 39 2). The player control module 2 1 2 sends this information to the content data supply module 2 1 Tell 3 and then instruct the decode control module 2 1 4 to play fast forward.
• the content data supply module 2 1 3 uses the functions of the operating system 2 0 1 to read and buffer the clip stream file that stores the program stream in which the elementary stream to be played back is multiplexed. Supply to the control module 2 1 5 (step S 3 9 3). Since the file name has already been specified, it will not be repeated here. Unlike when playback is started, the read start address and the size of the data to be transferred are instructed to be read. '
• the video readout function unit 2 3 3 demultiplexes the multiplexed data input to the buffer control module 2 1 5 (step S 3 94), and only the video stream is sent to the video decoder control module 2 1 6. Supply. In this case, since it is a fast-forward process, the audio decoder control module 2 1 7, subtitle decoder control module 2 1 8, audio read function unit 2 3 4, and subtitle read function unit 2 3 3 do not operate.
• the input data contains 1 to 4 reference images.
• the fast-forward process only the reference image is decoded and displayed based on the entry point selected by the entry point selection process (step S 39 5) described with reference to the flowchart in FIG.
• Index_Njni nus l is sent in advance to the decode control module 2 1 4, and the decode control module 2 1 4 decodes the specified number of reference images and sequentially sends them to the subsequent stage for display (steps). S 3 9 6).
• index-Njninusl indicates the number of reference images included in the data when N-th-Re and then read up to Picture_copy.
• index_N_minuxl is 0 at the 1st and 3rd entry points, so there is 1 intra picture
• index_N— minusl is 3 at the 2nd and 4th entry points. Therefore, four reference images are included.
• Fast-forward images have the property of increasing their subjective quality by outputting two or more reference images. However, in order to output many reference images, it is necessary to increase the amount of data read, and there is a trade-off relationship that the update frequency becomes slow. Therefore, the player control module 212 evaluates the value of index_N_minusl when selecting the entry point ⁇ in EPjnapO to be displayed next.
• the entry point ⁇ thinning interval in EPjnapO increases, but at that time, the one with a large 'index_N_minusl' (that is, the one with higher subjective image quality) is preferentially selected. Also, when the fast-forward speed is slow, select the one with index_N minus minusl.
• step S 40 1 the player control module 2 1 2 determines whether the fast forward mode is the high speed mode or the low speed mode. If it is determined that fast-forwarding is in the high-speed mode, the process proceeds to step S402. If it is determined that fast-forwarding is in the low-speed mode, the process proceeds to step S4 1 1.
• step S 403 the player control module 2 1 2 reads index—Njninusl from the corresponding entry N, the previous entry (N ⁇ 1), and the previous entry (N + 1).
• step S 404 the player control module 2 1 2 determines whether inde_N .minus (N), that is, the index_N_minus 1 index of the Nth entrepreneur basket is 0 or 1. In step S404, for example, if the value of index_N_minusl is 0 or 1, the process proceeds to step S405, and the player control module 2 1 2 selects the Nth entry point and performs the process. finish. On the other hand, if the value of index_N_minusl is neither 0 nor 1 in step S 404, the process proceeds to step S 406.
• step S 40 6 the player control module 2 1 2 determines whether or not the value of index_N — minusl of the (N + 1) -th entry point is 0 or 1, inde_N _minus (N + l) judge.
• Step S 4 If inde_N_minus (N + l) is 0 or 1 at 0 6, the process proceeds to step S407 and the player control module 2 1 2 selects the (N + 1) th entry point. The process ends. On the other hand, if inde_N_minus (N + l) is neither 0 nor 1 in step S 406, the process proceeds to step S 408.
• step S 408 the player control module 2 1 2 determines whether or not the value of index_N jninusl possessed by inde_N_minus (N ⁇ l), that is, the (N ⁇ 1) -th entry point is 0 or 1. In step S408, if the value of index_N_minusl is 0 or 1, the process proceeds to step S409, and the player control module 2 1 2 selects the (N-1) th entry point and performs the process. finish. If it is neither 0 nor 1, the process proceeds to step S 41 0.
• step S 4 1 it is known that index_N_minusl is neither 0 nor 1 at all entry points of entries N, (Nil), and (N-1). The Nth entry point is selected and the process is terminated.
• step S 4 1 2 the player control module 2 1 2 reads index—Njninus 1 from the corresponding entry N, the previous entry (N—1), and the previous entry (N + 1).
• step S 4 1 the player control module 2 1 2 is inde_N minus (N), that is, the index— Njninus of the Nth entry lipoin ⁇ Determine whether the value of 1 is 3 or 2.
• step S 4 1 if the value of index_N_minusl of the Nth entry line is 3 or 3 or 2, the process proceeds to step S 4 1 4, where the player control module 2 1 2 Selects the Nth entry point and ends the process.
• step S 4 1 when the index_N_minusl value of the Nth entry is neither 3 nor 2, the process proceeds to step S 4 1 5.
• step S 4 1 the player control module 2 1 2 determines that inde—N — minus (N + l), that is, whether the value of index_N jninusl of the (N + l) th entry point is 3 or 2 Determine whether or not.
• step S 4 1 if the value of index_N_minusl of the (NH) -th entry point is 3 or 2, the process proceeds to step S 4 1 6, and the player control module 2 1 2 (N + 1) Select the 1st entry point and end the process.
• the value of index_Njninusl of the (N + 1) th entry point is neither 3 nor 2 in step S 4 15, the process proceeds to step S 4 1 7.
• step S 41 7 the player control module 2 1 2 determines whether or not inde_N — minus (Nl), that is, whether the value of index—N —minusl of the (N-1) -th entrepreneur ⁇ is 3 or 2. judge.
• step S 4 1 7 if the value of indexJUninusl of the (N-1) th entry point is 3 or 2, the process proceeds to step S 4 1 8, and the player control module 2 1 2 Select the (N-1) th entry point and end the process. If neither 3 nor 2 is selected, proceed to step S 4 1 9.
• step S 41 9 it is known that i ndex_N_minusl is 3 and not 2 in all entries of N, (N + 1), and (Nl).
• the player control module 2 1 2 selects the Nth entry point and ends the process. 1
• the entry point decimation interval in EP_map () increases, but priority is given to those with a large value for i ndex_N—minus l (that is, the one with higher subjective image quality). To choose.
• the fast-forward speed is slow, select the one with small i ndex_N—minus l.
• fast-forward playback can be realized without degrading subjective image quality.
• 'low-speed fast-forward playback allows fast-forward playback using more reference images, so that it is possible to suppress a reduction in the quality of the playback image.
• the read entry point information is always constant in the playback process.
• a disk playback device with a high processing capacity has many entry points. It is possible to improve the playback image by reading it, but on the other hand, if a large amount of entry point information is read by a disk playback device with low processing capability, the processing speed may be delayed.
• the disc playback device with high processing capacity uses all the information about the entry.
• the disc playback device with low processing capacity uses the high-priority entry point. It is also possible to read and process only.
• FIG. 65 is a functional block diagram for explaining the functions of the disk recording apparatus in which priority is set for entry points.
• the same functions as those of the disk recording apparatus of FIG. 61 are denoted by the same reference numerals, The details will be omitted as appropriate.
• the subtitle encoder 443 reads the material of 4 characters from the caption material server 442, compresses and encodes it, and writes it to the caption data server 444. Unlike video data and audio data, subtitle data exists intermittently on the time axis. Therefore, the subtitle material recorded in the subtitle material server 442 and the display start time and display duration of the subtitle data recorded in the subtitle data server 444 are prepared in the subtitle evening imming information .445.
• the multiplexer 44 1 basically has the same function as the multiplexer 4 2 1 in FIG. 61, but further multiplexes caption data and caption timing information. That is, the multiplexer 44 1 reads the input feMPEG2 video stream and MPEG 2 audio stream, and the subtitle data and subtitle evening information 445 supplied from the subtitle data server 444, and reads the first described above. Time division multiplexing is performed as described with reference to FIG. 8A and FIGS. 18B to 27.
• the multiplexer 441 selects an intra 'picture in the stream and inserts PES_packet () of private_stream_2 shown in Fig. 23 at a frequency of about twice per second.
• PES-packet 0 of private_stream 1-2 indicates that an intra picture of video that can be decoded without reference to another picture is placed immediately after. At this time, a time stamp (PTS / DTS) is always given to the corresponding intra picture.
• time stamps are always assigned to all access units of subtitle data.
• the input stream may be input to the multiplexer 44 1 and multiplexed together with the video stream and the audio stream.
• the S multiplexer 44 1 supplies the multiplexed stream to the RAPI rewrite device 424 via the FIF042 2 and also supplies it to the RAPI information extractor 423 at the same time.
• the RAPI information extractor 4 23 extracts and stores video stream information and subtitle stream information multiplexed into the multiplexed stream.
• the RAPI information extractor 423 for the video stream, the start position of PES-packet 0 of private_stream_2 and the time scan (P TS ) Detects and stores the value, the corresponding intra picture, and the end positions of the second, third, and fourth reference images that follow.
• the start positions and time stamps of all subtitle access units are detected and stored.
• the controller 446 uses the input information to create an EPjnapO as shown in FIG. It is assumed that the EP-map 0 created here contains information about the video stream and subtitle stream.
• the main information of EP_map () related to video is all RAPIs placed in the stream, that is, the position of PES-packet () of private_stream_2 and the time stamp of the next intra picture, and these information are extracted from RAPI information. It can be created using the information input from the controller 4 2 3 to the controller 446.
• the main information of EP-map () related to subtitles is the position and time stamp of the subtitle access unit, and these information can also be created with the information input from the RAPI information extractor 423 to the controller 446. .
• controller 44 6 uses the prioirty described later that has not yet been determined from the EP_map () information. —Create a flag.
• the three-time stamp is evaluated for all video entry points (RAP I entry points) and subtitle access units (to be described later) and priority_flag is set.
• controller scene change information 447 is input to controller 446.
• priority_flag has the meaning shown in Figure 67.
• the priori'ty_flag value is 3, it indicates that the entry corresponds to the beginning of the chapter.
• a priority_flag value of 2 indicates an entry corresponding to an important scene change every other minute.
• a priority_flag value of 1 indicates an entry every 3 seconds that corresponds to a scene change except for the above. All other entries have a priority-f lag value of 0.
• priority_flag value 3
• the entry corresponding to the subtitle stream indicates that the entry corresponds to the beginning of the chapter.
• priority_flag value is 2
• priority_flag 3 or 2 entries are about 200.
• Pri ority_flag 3 or 2 or 1 entries are about 2400, and if all others are included, the total is 14400.
• the flags are indicated by the values 3, 2, 1, 0.
• each flag with a bit and set the corresponding bit to 1. Conceivable. That is, if this field is set to 3 bits, the most significant bit is 1, it indicates the beginning of the chapter, and if the next bit is i, it indicates that the entry is every 1 minute. If the bit is 1, it is an entry every 5 seconds, and if all bits are 0, it can be defined that they are not included in those three categories.
• a priority-flag value of 1 indicates that the entry corresponds to the beginning of a chapter. In all other entries, the priority_flag value is 0. '
• step S448 the controller 446 determines whether or not the processing has been completed for all entries of all videos. If it is determined that the processing has not ended, the processing returns to step S441, and thereafter The descending process is repeated. That is, the processes in steps S 441 to S 448 are repeated until all priority_f g are set for the video entry.
• step S 448 determines whether all processing has been completed, that is, if it has been determined that processing has been completed for all video entries. If it is determined in step S 448 that all processing has been completed, that is, if it has been determined that processing has been completed for all video entries, the processing proceeds to step S 449.
• step S 449 the controller 446 determines whether the entry corresponds to the chapter head position with respect to the caption, that is, whether the entry under evaluation corresponds to the time of the chapter in the chapter / scene change information 447. Determine whether.
• step S 449 if it is determined not to be Chiyapu evening head position of the subtitle, in step S 45 1, the controller 4 46 whether the position of the important scene change of subtitle, namely, Next, it is determined whether the entry under evaluation corresponds to the position of every minute from the beginning of “Important scene change” in chapter scene change information 447.
• step S456 the controller 446 determines whether or not the processing has been completed for all entries of the subtitle. If it is determined that the processing has not been completed, the processing returns to step S449 and the subsequent processing is performed. Is repeated. In other words, the processing of steps S 44 9 to S 45 6 is repeated until all priority flags are set for the subtitle entries. In step S 45 6, the processing is performed for all the subtitle entries. When it is determined that the processing has been completed, the controller 446 outputs EPjiiapO data in accordance with the syntax shown in FIG. 66 to the output server 4 26.
• the disc playback device thins out EPjnapO depending on the size of the memory (for example, the memory 1 1 3 in FIG. 1). In other words, in a disk playback device whose function is reduced in order to reduce costs, only entries having a high priority_flag are left in the memory. Of course, it is not always necessary to perform such work on equipment that has sufficient memory capacity to hold the entire EPjnapO.
• the player control module 2 1 2 when reading EPjnapO, has a priority-flag value of 3, 1, or 1 when the stream type is video, depending on the values of stream_id and private_stream_id.
• the memory capacity required for EP map for one video stream can be reduced to about 1/6 to 1/10. It becomes possible.
• the amount of memory required for EP_map for a single subtitle stream can be reduced to several tenths.
• even a low-cost disc playback device can store entries according to the capacity of the memory, and can realize efficient playback processing.
• the above-described series of processing is performed by software.
• the above-described series of processing can also be performed by a dedicated hardware.
• the hardware decoder is adopted as the video decoder 1 16 (FIG. 1) and the video encoder 4 0 3 (FIG. 60).
• the video decoder 1 1 6 and the video encoder A software decoder can be used as the reader 40 3 (Fig. 60).
• a software decoder is adopted as the caption decoder, but a hardware decoder can also be adopted as the caption decoder.

Landscapes

• Engineering & Computer Science (AREA)
• Signal Processing (AREA)
• Multimedia (AREA)
• Signal Processing For Digital Recording And Reproducing (AREA)
• Television Signal Processing For Recording (AREA)
• Management Or Editing Of Information On Record Carriers (AREA)
• Indexing, Searching, Synchronizing, And The Amount Of Synchronization Travel Of Record Carriers (AREA)

Priority Applications (7)

Applications Claiming Priority (2)

Publications (1)

Family

ID=36564954

Family Applications (1)

Country Status (11)

Families Citing this family (18)

Citations (3)

Family Cites Families (6)

• 2004
  • 2004-12-02 JP JP2004350487A patent/JP4575129B2/ja not_active Expired - Fee Related
• 2005
  • 2005-11-17 AT AT05809345T patent/ATE473595T1/de active
  • 2005-11-17 KR KR1020077014869A patent/KR101217351B1/ko not_active Expired - Fee Related
  • 2005-11-17 CN CN2005800476695A patent/CN101112086B/zh not_active Expired - Fee Related
  • 2005-11-17 WO PCT/JP2005/021500 patent/WO2006059520A1/ja not_active Ceased
  • 2005-11-17 RU RU2007120508A patent/RU2335856C1/ru not_active IP Right Cessation
  • 2005-11-17 MX MX2007006162A patent/MX2007006162A/es active IP Right Grant
  • 2005-11-17 US US11/720,798 patent/US8326117B2/en not_active Expired - Fee Related
  • 2005-11-17 DE DE602005022222T patent/DE602005022222D1/de not_active Expired - Lifetime
  • 2005-11-17 EP EP05809345A patent/EP1819158B1/en not_active Expired - Lifetime
  • 2005-11-30 TW TW094142106A patent/TW200638767A/zh not_active IP Right Cessation

Patent Citations (3)

Also Published As

Similar Documents

Legal Events