JP2005004851A - Information preparation device and method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable reproduction of data in real time, especially. <P>SOLUTION: An edit list editing part prepares an edit list 301 indicating an edit result. A play list making part prepares a play list based on the edit list. In the edit list 301, a clip information file 321 controlling an image data file 323 and a voice data file 324 is specified as a reproduction object. In the play list 302, the image data file 323, the voice data file 324, and a bridge essence 331 are specified as the reproduction object. this device can be adapted to a device for edition. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an information creating apparatus, method, and program, and more particularly, to an information creating apparatus, method, and program capable of reproducing AV (Audio Visual) data in real time.
[0002]
[Prior art]
In recent years, recording media such as CD-RW (Compact Disk-ReWritable) and DVD-RW (Digital Versatile Disc-ReWritable) capable of repeatedly writing and erasing data are becoming widespread with the reduction in price.
[0003]
Further, an editing apparatus has been proposed that performs nondestructive editing of AV data by recording an edit list (edit list) indicating an editing operation on AV data recorded on the recording medium on the recording medium (for example, a patent). Reference 1).
[0004]
The nondestructively edited AV data is reproduced by being read from the recording medium according to the edit list.
[0005]
[Patent Document 1]
Japanese Patent Laid-Open No. 11-88221
[0006]
[Problems to be solved by the invention]
However, since the edit list describes the editing operation and is not created in consideration of the playback of AV data, AV data may not be played back in real time.
[0007]
The present invention has been made in view of such a situation, and enables reproduction of AV data in real time.
[0008]
[Means for Solving the Problems]
The information creation apparatus of the present invention includes a reproduction control information acquisition unit that acquires first reproduction control information that designates a management file that manages data as a reproduction target, and first reproduction control information that is acquired by the reproduction control information acquisition unit. And generating means for generating second reproduction control information for designating a file composed of data as a reproduction target.
[0009]
In the first playback control information, edit points set for the data are described, and it is determined whether or not the playback device can play back data that is an edit result based on the edit points in real time. And a rearrangement unit that rearranges data in a predetermined range in which edit points are set when it is determined by the determination unit and the determination unit that the playback device cannot play back the editing result data in real time. And the creation means creates second playback control information that designates a file composed of the data rearranged by the rearrangement means as a playback target.
[0010]
The information creation method of the present invention includes a reproduction control information acquisition step for acquiring first reproduction control information that designates a management file for managing data as a reproduction target, and a first reproduction acquired by processing of the reproduction control information acquisition step. And a creation step of creating second playback control information for designating a file composed of data as a playback target based on the control information.
[0011]
The program according to the present invention includes a reproduction control information acquisition step for acquiring first reproduction control information for specifying a management file for managing data as a reproduction target, and first reproduction control information acquired by processing of the reproduction control information acquisition step. And a creation step of creating second playback control information for designating a file composed of data as a playback target.
[0012]
In the present invention, first playback control information for specifying a management file for managing data as a playback target is acquired, and a file composed of data is specified as a playback target based on the first playback control information. Second reproduction control information is created.
[0013]
DETAILED DESCRIPTION OF THE INVENTION
Embodiments of the present invention will be described below. Correspondences between constituent elements described in the claims and specific examples in the embodiments of the present invention are exemplified as follows. This description is to confirm that specific examples supporting the invention described in the claims are described in the embodiments of the invention. Therefore, even if there are specific examples that are described in the embodiment of the invention but are not described here as corresponding to the configuration requirements, the specific examples are not included in the configuration. It does not mean that it does not correspond to a requirement. On the contrary, even if a specific example is described here as corresponding to a configuration requirement, this means that the specific example does not correspond to a configuration requirement other than the configuration requirement. not.
[0014]
Further, this description does not mean that all the inventions corresponding to the specific examples described in the embodiments of the invention are described in the claims. In other words, this description is an invention corresponding to the specific example described in the embodiment of the invention, and the existence of an invention not described in the claims of this application, that is, in the future, a divisional application will be made. Nor does it deny the existence of an invention added by amendment.
[0015]
The information creation device according to claim 1 is a management for managing the data in an information creation device (for example, the editing terminal device 66 in FIG. 1) that creates information provided to a playback device that plays back predetermined data. Reproduction control information acquisition means (for example, the process of step S21 in FIG. 8) that acquires first reproduction control information (for example, an edit list) that designates a file (for example, the clip information file 151 in FIG. 4) as a reproduction target is executed. 2 and the file composed of the data based on the first reproduction control information acquired by the reproduction control information acquisition means (for example, the image data file 152 of FIG. 4). Creating means (for example, the step of FIG. 8) for creating second reproduction control information (for example, a play list) that designates as a reproduction target. Characterized by comprising a playlist creation section 86 of FIG. 2) to perform a process flop S27.
[0016]
The information creating apparatus according to claim 2, wherein the first reproduction control information includes an edit point set for the data, and the reproduction apparatus uses an edit result based on the edit point. The determination means for determining whether or not the data can be reproduced in real time (for example, the playlist creation unit 86 in FIG. 2 that executes the process of step S24 in FIG. 8) and the determination means When the apparatus determines that the data that is the editing result cannot be reproduced in real time, a rearrangement unit that rearranges data in a predetermined range in which the editing points are set (for example, step in FIG. 8) 2 for executing the processing of S25, and the creation means creates a file composed of the data rearranged by the rearrangement means. Creating a second reproduction control information specifying for playback (for example, step S28 in FIG. 8) it is characterized.
[0017]
The information creation method according to claim 3 is an information creation method of an information creation device (for example, the editing terminal device 66 in FIG. 1) that creates information provided to a playback device that plays back predetermined data. A reproduction control information acquisition step (for example, step S21 in FIG. 8) for acquiring first reproduction control information (for example, an edit list) that designates a management file (for example, the clip information file 151 in FIG. 4) as a reproduction target. ) And the first reproduction control information acquired by the processing of the reproduction control information acquisition step, a file (for example, the image data file 152 in FIG. 4) configured to be designated as a reproduction target is designated. Creating step (for example, step S27 of FIG. 8) for creating reproduction control information (for example, playlist) of 2 Characterized in that it comprises a.
[0018]
A specific example of each step of the program described in claim 4 is the same as the specific example in the embodiment of the invention of each step of the information creating method according to claim 3.
[0019]
FIG. 1 is a diagram showing a configuration example of a video program production support system to which the present invention is applied.
[0020]
In FIG. 1, a video program production support system 51 is a system provided in, for example, a television broadcasting station that broadcasts a television signal, a video content production company such as a video or a movie, and the like. It is a system for producing a video program that is a video work. In addition, the video program production support system 51 makes it possible to consistently use metadata added to the video program, which is configured in an electronic file format, among a plurality of departments that share the production of the video program. This is a system for creating programs efficiently.
[0021]
As shown in FIG. 1, the video program production support system 51 includes a planning terminal device 61 for planning a video program, a network 62 to which the planning terminal device 61 is connected, and a news gathering terminal device connected to the network 62. 63, an imaging device 64 and a field PC / PDA (Personal Computer / Personal Digital Assistants) 65 (hereinafter referred to as field PC 65) constituting the coverage terminal device 63, and an editing terminal device 66 similarly connected to the network 62 And an optical disc 67 as a recording medium.
[0022]
The planning terminal device 61 includes, for example, an information processing device such as a personal computer and its peripheral devices, and is provided in a planning department or the like where a video program is planned. This planning department is responsible for the overall production of video programs. The planning and planning of the video program to be produced creates a scenario (scenario) for the video program, as well as the reporting department and editing department described later. This is the department that directs the production work to other departments. The planning terminal device 61 performs, for example, processing such as creating configuration table metadata in an electronic file format for each video program including policy instruction information corresponding to the video program scenario. The planning terminal device 61 supplies the generated configuration table metadata to the news gathering terminal device 63 and the like via the network 62. As a result, the planning component department instructs the news gathering department or the like of the scene and content to be interviewed or photographed.
[0023]
The news gathering terminal device 63 is a terminal device group used by a news gathering department that conducts news gathering, and includes, for example, an imaging device 64 and a field PC 65. This reporting department is the department that actually conducts interviews at the production site according to the production instructions and scenarios from the planning and composition department, for example, shooting the video of each scene that makes up the video program and covering the shooting status Department.
[0024]
The imaging device 64 is, for example, a video camera such as a camcorder (registered trademark), and is a device that is used for coverage of news programs for broadcasting, games such as sports, and video content such as movies. The imaging device 64 is connected to the network 62, and acquires the configuration table metadata from the planning terminal device 61 described above via the network 62, for example. Then, the imaging device 64 displays the acquired configuration table metadata on a predetermined display unit or the like, and makes a photographing staff such as a cameraman recognize the contents to be photographed. The imaging device 64 is operated by the imaging staff and performs imaging (imaging) of each scene constituting the video program based on the production instruction information of the acquired configuration table metadata. Then, image (video) data and audio data obtained by photographing are recorded on a recording medium such as the optical disc 67.
[0025]
Further, the imaging device 64, for example, not only original image data that is image data obtained by imaging, but also low resolution (low resolution) image data (hereinafter referred to as low resolution data) to the optical disc 67. Can be recorded. Original image data has a large amount of data, but is high-quality image data, and is therefore used for a finished video program product. On the other hand, the low-resolution data is image data corresponding to an image of a frame with a small number of pixels, which is generated, for example, by thinning out the number of pixels of each frame from the original image data.
[0026]
Further, the low resolution data may be further encoded by, for example, MPEG4 (Moving Picture Experts Group phase 4) method. This low resolution data has lower image quality than the original image data, but the data amount is small, so the processing load such as transmission and reproduction is light, and it is mainly used for coarse editing processing.
[0027]
The optical disc 67 on which image data, audio data, and the like are recorded by the imaging device 64 is transported and used, for example, to an editing department or a field PC 65 described later. However, since a certain amount of time is required for transporting the optical disc 67, the image pickup device 64 is sent to the planning terminal device 61, the field PC 65, the editing terminal device 66, or the like via the network 62. Data may be supplied. In that case, in order to shorten the transfer time (to reduce the load of the transfer process), the imaging device 64 uses a low resolution with a small data amount corresponding to the image data instead of the image data obtained by imaging. It is desirable to supply data.
[0028]
Note that the low resolution data transfer process by the imaging device 64 may be performed at any timing, may be performed in parallel with the imaging process, or may be performed collectively after the imaging process is completed. May be.
[0029]
In this way, by transferring the low resolution data prior to the conveyance of the optical disc 67, the editing department can perform comparatively early stages (for example, simultaneously with the imaging process) even if the conveyed optical disc 67 has not arrived. Since the editing work can be performed, the production efficiency of the video program can be increased. As described above, when the low resolution data is transmitted via the network 62, the imaging device 64 may record only the original image data and audio data on the optical disc 67, for example (low resolution data is recorded). It may not be recorded on the optical disc 67).
[0030]
The recording medium on which the imaging device 64 records video content and the like is not limited to the example of the optical disc 67 described above, and any recording medium may be used. For example, magneto-optical disks including MD (Mini-Disc) (registered trademark) and MO (Magneto Optical disk), magnetic disks including flexible disks, magnetic tapes used for DV (Digital Video) and VHS (Video Home System), It may be a semiconductor memory including a flash memory.
[0031]
The field PC 65 includes, for example, a portable information processing device such as a notebook personal computer or PDA, a peripheral device, and the like. The field PC 65 is connected to the imaging device 64 through various types of wired or wireless lines. For example, the configuration table metadata, image data, audio data, and the like can be shared with the imaging device 64.
[0032]
For example, the field PC 65 acquires the configuration table metadata from the planning terminal device 61 or the configuration table metadata from the imaging device 64 via the network 62. The field PC 65 displays the acquired configuration table metadata on a predetermined display unit, and allows the staff in charge of the news gathering department to recognize the contents to be gathered and photographed.
[0033]
Furthermore, the field PC 65 generates shooting situation information that is information relating to the coverage and shooting situation based on the input of the person in charge of the reporting department that is the user, and adds the generated shooting situation information to the corresponding column in the configuration table metadata. To do. In this way, the field PC 65 edits the configuration table metadata by adding the shooting status information to the corresponding column in the configuration table metadata. This shooting situation information is, for example, text data described from various viewpoints for each take or for each coverage location, and is useful information during subsequent editing processing. Further, the field PC 65 supplies the shooting state information as metadata to the imaging device 64 and adds it to image data and audio data obtained by the imaging device 64.
[0034]
The editing terminal device 66 is composed of, for example, an information processing device such as a personal computer and peripheral devices, and is provided in an editing department that performs image data and audio data editing processing. The editorial department edits the image data and audio data obtained by the imaging device 64 based on the production instructions and scenarios from the planning department, composition table metadata reflecting the interview situation in the interview department, etc., and completes the video program. It is a department to let you.
[0035]
The editing terminal device 66 acquires configuration table metadata and low resolution data from the imaging device 64 via the network 62, for example. The editing terminal device 66 obtains original image data and audio data from the optical disc 67 on which image data and audio data are recorded in the imaging device 64. Further, the editing terminal device 66 can also obtain a production instruction (instruction related to editing) directly from the planning terminal device 61 or the field PC 65 via the network 62.
[0036]
The editing terminal device 66 preferably reproduces and displays image data and audio data based on the acquired configuration table metadata. For example, the editing terminal device 66 is operated by the user and continuously converts low resolution data acquired via the network 62 and original image data and audio data recorded on the optical disc 67 in the order according to the scenario. Or display only image data of a desired clip. When the original image data recorded on the optical disc 67 is reproduced, the editing terminal device 66 reads, for example, the data recorded on the optical disc 67 and writes the data on the optical disc 67. A disk device or the like is used.
[0037]
The editing terminal device 66 not only reproduces and displays necessary image data and the like in a suitable order based on the configuration table metadata, for example, but also performs an editing process on the image data obtained by the interview. . This editing process includes a rough editing process and a main editing process.
[0038]
The rough editing process is a simple editing process for image data and audio data. For example, when the editing terminal device 66 acquires a plurality of clip data corresponding to a clip that is a unit indicating one imaging process in the rough editing process, for example, the editing terminal apparatus 66 performs the main editing from the clip data. Select the clip data to be used, select the necessary image or audio part from the selected clip data (Logging), and edit start position (IN point) corresponding to the selected image or audio part The editing end position (OUT point) is set using, for example, a time code or the like, and the corresponding portion is extracted (Ingesting) from the above-described clip data.
[0039]
Note that a clip is not only a single imaging process, but also a unit indicating the time from the start of imaging to the end of imaging, and a unit indicating the length of various data obtained by the imaging process. It is also a unit indicating the data amount of various data obtained by the imaging process. Furthermore, the clip may also indicate the collection of various data itself.
[0040]
This editing process connects the clip data that has undergone the rough editing process, performs final image quality adjustments on the image data, and creates complete package data that is data to be broadcast in programs, etc. It is processing to do.
[0041]
Each of the devices such as the planning terminal device 61, the imaging device 64, the field PC 65, and the editing terminal device 66 described above may be configured by a plurality of devices. For example, image data obtained by a plurality of imaging devices 64 may be acquired by one editing terminal device 66 via the optical disc 67 or the network 62, and the data may be edited. Alternatively, data supplied from one imaging device 64 may be edited by a plurality of editing terminal devices 66.
[0042]
Conversely, each device such as the planning terminal device 61, the imaging device 64, the field PC 65, and the editing terminal device 66 described above has been described as being configured separately, but not limited thereto, Some or all of the functions of the apparatus may be integrated with each other.
[0043]
The video program production support system 51 includes, for example, a center server (not shown) connected to the network 62 separately from the planning terminal device 61, the imaging device 64, the field PC 65, and the editing terminal device 66 described above. May be configured as a client / server system using the planning terminal device 61, the imaging device 64, the field PC 65, the editing terminal device 66, and the like as clients.
[0044]
FIG. 2 shows a detailed configuration example of the editing terminal device 66 of FIG.
[0045]
In FIG. 2, a CPU (Central Processing Unit) 81 of the editing terminal device 66 executes various processes according to a program stored in a ROM (Read Only Memory) 82. A RAM (Random Access Memory) 83 appropriately stores data and programs necessary for the CPU 81 to execute various processes.
[0046]
The clip data editing unit 84 controls the output unit 92 to display a GUI (Graphical User Interface) or the like on a display or the like, receives an operation input from the user via the input unit 91, and based on the operation input or the like, Edit and edit image data, audio data, low resolution data, metadata, etc. recorded on the optical disc 67 mounted in the drive 95, or low resolution data acquired via the communication unit 94, etc. Information on the contents, information on the edited data, and the like are generated and supplied to the edit list editing unit 85. Note that the clip data editing unit 84 performs nondestructive editing processing without updating various data to be reproduced.
[0047]
The edit list editing unit 85 generates an edit list indicating the editing result based on various types of information generated along with the editing process performed in the clip data editing unit 84 and records it on the optical disc 67.
[0048]
The playlist creation unit 86 creates a playlist based on the edit list and records it on the optical disc 67. The playlist is information on the result of compiling the edit list. The playlist can include a bridge essence described later as a component. Note that the playlist itself cannot be edited, and each time an edit list is edited, a new playlist reflecting the changed contents is generated. When the edit list is deleted, the corresponding playlist is also deleted.
[0049]
The bridge essence creation unit 87 creates a bridge essence. That is, when playing back clip data recorded on the optical disc 67 based on the edit list, depending on the physical layout of the clip data, the editing result cannot be played continuously without interruption due to the seek performance of the drive. There is. In such a case, the bridge essence creation unit 87 copies a section where continuous playback is impossible to another place, rearranges the sections so as to be physically continuous, creates a bridge essence, and performs continuous playback in real time. Guarantee.
[0050]
The CPU 81, ROM 82, RAM 83, clip data editing unit 84, edit list editing unit 85, playlist creation unit 86, and bridge essence creation unit 87 are connected to each other via a bus 88. An input / output interface 90 is also connected to the bus 88.
[0051]
The input / output interface 90 is connected to an input unit 91 including a keyboard and a mouse, and outputs a signal input to the input unit 91 to the CPU 81. The input / output interface 90 is also connected with an output unit 92 including a display and a speaker.
[0052]
Further, the input / output interface 90 includes a storage unit 93 including a hard disk, an EEPROM (Electronically Erasable and Programmable Read Only Memory), and a communication unit 94 that performs data communication with other devices via the network 62 and the like. Is also connected. The drive 95 is used when data is read from or written to the removable medium 101 formed of a recording medium such as an optical disk 67, a magnetic disk, a magneto-optical disk, or a semiconductor memory.
[0053]
Next, a file system for managing each data recorded on the optical disc 67, and a directory structure and files in the file system will be described with reference to FIG.
[0054]
As a file system for managing data recorded on the optical disc 67, any file system may be used. For example, UDF (Universal Disk Format), ISO 9660 (International Organization for Standardization 9660), or the like may be used. In addition, when a magnetic disk such as a hard disk is used instead of the optical disk 67, the file system is FAT (File Allocation Tables), NTFS (New Technology File System), HFS (Hierarchical File System), or UFS (Unix registered trademark). ) File System) or the like may be used. A dedicated file system may be used.
[0055]
In FIG. 3, a PROAV directory 132 is provided in a root directory (ROOT) 131. In the directory below the PROAV directory 132, information related to essence data such as image data and audio data, an edit list indicating the editing result of the essence data, and the like are arranged.
[0056]
The PROAV directory 132 includes an index file (INDEX.XML) 133, an index file (INDEX.BUP) 134, a disc information file (DISCINFO.XML) 135, a disc information file (DISCINFO.BUP) 136, a disc metafile (DISCMETA. XML) 137, a clip root directory (CLPR) 138, and an edit list root directory (EDTR) 139 are provided.
[0057]
In the index file 133, management information for managing all clip data and edit lists recorded on the optical disc 67 are described. Note that the index file 134 is a copy of the index file 133, and the reliability is improved by recording them separately in two files.
[0058]
For example, the index file 133 and the index file 134 include, as management information for managing clip data, a UMID added to a clip information file for managing clip data, which will be described later, and a file name of the clip information file. Information indicating the correspondence is described.
[0059]
The disc information file 135 describes information that must be strictly managed inside the playback device, such as the playback start position, among the metadata for the entire data recorded on the optical disc 67. The disc information file 136 is a copy of the disc information file 135, and the reliability is improved by separately recording the disc information file 135 in two files.
[0060]
The disc metafile 137 describes information that can be freely rewritten, for example, disc attributes, etc., among the metadata for the entire data recorded on the optical disc 67.
[0061]
In the clip root directory 138, clip data is provided in a lower directory, and in the edit list root directory 139, edit list data indicating an editing result for the clip data is provided in a lower directory.
[0062]
In the clip root directory 138, clip data recorded on the optical disc 67 is recorded in different directories for each clip. For example, in the example of FIG. 3, the data of three clips are divided and recorded in three directories: a clip directory (C0001) 141, a clip directory (C0002) 142, and a clip directory (C0003) 143.
[0063]
That is, each piece of data of the first clip recorded on the optical disc 67 is recorded in a file in a directory under the clip directory 141, and each piece of data of the clip recorded on the optical disc 67 is subordinate to the clip directory 142. Each piece of clip data recorded in the directory file and thirdly recorded on the optical disc 67 is recorded in a file in a directory below the clip directory 143.
[0064]
In the edit list root directory 139, the edit list recorded on the optical disc 67 is recorded in different directories for each editing process. For example, in the example of FIG. 3, there are four edit lists: an edit list directory (E0001) 144, an edit list directory (E0002) 145, an edit list directory (E0003) 146, and an edit list directory (E0004) 147. It is recorded separately.
[0065]
That is, the edit list indicating the first editing result of the clip recorded on the optical disc 67 is recorded in a file in a directory under the edit list directory 144, and the editing list indicating the second editing result is the edit list directory 145. The edit list that is recorded in a file in the lower directory of the file and that indicates the third edit result is managed as a file in a directory that is lower in the edit list directory 146, and the edit list that indicates the fourth edit result is the edit list directory 147. It is recorded in the file of the directory below.
[0066]
FIG. 4 shows a configuration example of files in a directory below the clip directory 141 provided in the clip root directory 138. In the clip directory 141, each piece of clip data first recorded on the optical disc 67 is provided as a file and managed.
[0067]
The clip directory 141 includes a clip information file (C0001C01.SMI) 151 which is a file for managing clips, an image data file (C0001V01.MXF) 152 which is a file including clip image data, and audio data of eight channels of clips. Audio data files (C0001A01.MXF to C0001A08.MXF) 153 to 160, low resolution data files (C0001S01.MXF) 161 that are files including low resolution data corresponding to clip image data, clip data and Non-real-time metadata that is a file containing non-real-time metadata that does not require real-time properties, such as metadata as an attribute of the editing result File (C0001M01.XML) 162, a real-time metadata file (C0001R01), which is a file including real-time metadata required for real-time properties such as LTC (Linear Time Code), UMID, etc. .BIM) 163 and a picture pointer file which is a file in which the frame structure of the image data file 152 (for example, information regarding the compression format for each picture in MPEG or the like, information such as an offset address from the beginning of the file) is described. (C0001I01.PPF) 164 is provided.
[0068]
In the example of FIG. 4, each of the image data of the image data file 152, the low resolution data of the low resolution data file 161, and the real time metadata of the real time metadata file 163, which is data that requires real time properties at the time of reproduction, is one. It is recorded in a file so that the reading time does not increase.
[0069]
The audio data of the audio data files 153 to 160 is also required to have real-time characteristics at the time of reproduction. However, in order to cope with the increase in the number of audio channels such as 7.1 channels, 8 channels are prepared and are different from each other. It is recorded in the file. In FIG. 4, the audio data is recorded in eight files. However, the present invention is not limited to this, and the number of audio data files may be seven or less, or nine or more. .
[0070]
Similarly, the image data of the image data file 152, the low resolution data of the low resolution data file 161, and the real time metadata of the real time metadata file 163 may be recorded in two or more files depending on circumstances. .
[0071]
In FIG. 4, non-real-time metadata that does not require real-time property of the non-real-time metadata file 162 is recorded in a file different from real-time metadata that requires real-time property of the real-time metadata file 163. This is to prevent unnecessary metadata such as image data from being read out during normal playback. By doing so, the processing time of playback processing and the load required for processing can be reduced. Can do.
[0072]
The non-real-time metadata file 162 is described in an XML (extensible Markup Language) format in order to provide versatility. The real-time metadata file 163 is a BIM format file obtained by compiling an XML format file in order to reduce the processing time of the playback process and the load required for the processing.
[0073]
The file configuration example of the clip directory 141 shown in FIG. 4 can be applied to all clip directories corresponding to each clip recorded on the optical disc 67. That is, the file configuration example shown in FIG. 4 can be applied to the other clip directories 142 and 143 shown in FIG.
[0074]
Note that the directory structure of the clip directory 141 is not limited to the example shown in FIG. 4, and a non-real-time metadata file corresponding to the clip exists in a directory (including the clip directory itself) below each clip directory. Any configuration may be used.
[0075]
FIG. 5 shows an example of a file structure in a directory below the edit list root directory 139. In the directory below the edit list directory 145 provided in the edit list root directory 139, edit list data indicating the second editing result of each data of the clip recorded on the optical disc 67 is provided as a file and managed. .
[0076]
The edit list directory 145 includes an edit list file (E0002E01.SMI) 171 which is a file for managing the editing result (edit list), edited essence data (among the data of all clips used for editing, after editing). Edit list non-real-time metadata file (E0002M01.E) which is a file including non-real-time metadata corresponding to (a portion extracted as data) or non-real-time metadata newly generated based on the non-real-time metadata. XML) 172, a playlist file (E0002P01.SMI) 173, which is a file including information such as a reproduction procedure (playlist) of essence data based on the editing result (edit list), playlist A file in which the frame structure of image data to be reproduced based on the reproduction procedure included in the file 173 (for example, information about the compression format for each picture in MPEG or the like, information such as an offset address from the beginning of the file) is described. A file including picture data (bridge essence image data) for guaranteeing real-time reproduction based on a reproduction procedure (playlist) of a playlist picture pointer file (E0001I01.PPF) 174 and a playlist file 173. Four files including audio data (bridge essence audio data) for guaranteeing real-time reproduction based on the reproduction procedure (playlist) of the bridge essence image data file (B0002V01.BMX) 175 and the playlist file 173 Low resolution data to guarantee real-time playback based on a playback procedure (playlist) of a bridge essence audio data file (B0002A01.BMX to B0002A04.BMX) 176 to 179 and playlist file 173 (bridge resolution low resolution data) Bridge essence low-resolution data file (B0002S01.BMX) 180 that is a file including the real-time metadata for guaranteeing real-time reproduction based on the reproduction procedure (playlist) of the playlist file 173 (real-time metadata of the bridge essence) A bridge essence real-time metadata file (B0002R01.BBM) 181 is provided.
[0077]
In FIG. 5, the non-real-time metadata that is not required for the real-time property of the edit list non-real-time metadata file 172 is recorded in a file different from the real-time metadata that is required for the bridge essence real-time metadata file 181. This is to prevent unnecessary metadata from being read during reproduction of image data or the like using the reproduction procedure (playlist) (during reproduction of the editing result). The processing time of the reproduction process and the load necessary for the process can be reduced.
[0078]
Note that the bridge essence non-real-time metadata file 172 is described in the XML format in order to have versatility. The edit list real-time metadata file 181 is a BBM format file corresponding to a BIM format obtained by compiling an XML format file in order to reduce the processing time of reproduction processing and the load necessary for the processing.
[0079]
Image data included in the bridge essence image data file 175, audio data included in the bridge essence audio data files 176 to 179, low resolution data included in the bridge essence low resolution data file 180, and included in the bridge essence real time metadata file 181 The real-time metadata is data extracted from image data, audio data, low-resolution data, and real-time metadata corresponding to clips managed in a directory under the clip root directory 138 in FIG. Is data corresponding to. These data are read when a reproduction process is performed based on a reproduction procedure (playlist) included in the playlist file 173.
[0080]
The image data recorded in the bridge essence image data file 175, the low resolution data recorded in the bridge essence low resolution data file 180, and the real time metadata recorded in the bridge essence real time metadata file 181 may be respectively It may be managed as a plurality of files (recorded as a plurality of files). Similarly, audio data recorded in the bridge essence audio data files 176 to 179 may be recorded in three or less files or five or more files.
[0081]
The configuration example of the file in the edit list directory 145 shown in FIG. 5 can be applied to all edit lists (editing results). That is, since the configuration example of the file shown in FIG. 5 can be applied to the other edit list directories 144, 146, or 147 shown in FIG. 3, the description thereof is omitted.
[0082]
The directory structure of the edit list directory corresponding to one editing operation is not limited to the above-described example, and the edit list directory corresponding to the edit list is included in a directory below each edit list directory (including the edit list directory). Any configuration may be used as long as the non-real-time metadata file exists.
[0083]
FIG. 6 is a flowchart for explaining edit list creation processing of the edit list editing unit 85 of FIG. This edit list creation process starts when the user operates the input unit 91 and instructs to record an edit list.
[0084]
In step S1, the edit list editing unit 85 creates an edit list directory 145 below the edit list root directory 139 recorded on the optical disc 67, and proceeds to step S2. In step S2, the edit list editing unit 85 creates an edit list file 171 for managing an edit list indicating the editing result in the edit list directory 145 created in step S1, and the process proceeds to step S3.
[0085]
In step S3, the edit list editing unit 85 is an edit list that is a file including non-real-time metadata corresponding to edited essence data or non-real-time metadata newly generated based on the non-real-time metadata. The non-real-time metadata file 172 is created in the edit list directory 145 created in step S1.
[0086]
Specifically, for example, when editing is performed, the edit list editing unit 85 edits the essence data after editing from the non-real-time metadata included in the non-real-time metadata file 162 of the clip directory 141 recorded on the optical disc 67. The non-real-time metadata for the edit list is reconstructed by using the extracted non-real-time metadata to reconstruct new non-real-time metadata with the edited essence data as one clip. Created in the edit list directory 145 created in step S1.
[0087]
After the processing in step S3, the process proceeds to step S4, and the edit list editing unit 85 has created the edit list file 171 in step S2, so that the PROAV recorded on the optical disc 67 including management information for managing the edit list. The contents of the index file 133 and index file 134 in the directory 132 are updated, and the process ends.
[0088]
FIG. 7 shows an example of an edit list described in the edit list file 171.
[0089]
FIG. 7 shows an example of codes in the range specified by the </ body> tag that is the end tag from the <body> tag that is the start tag in the edit list. In FIG. 7, numbers at the beginning of each line and a colon symbol (:) are added for convenience of explanation, and are not part of the code. The same applies to FIGS. 9 and 10 described later.
[0090]
As described above, the edit list indicates the editing result, and the contents are described between the <par> tag on the second line and the </ par> tag on the thirteenth line.
[0091]
The comment sentence “<!-Clip1->” on the third line indicates that codes related to clip # 1 are described in the fourth to seventh lines below. The string <! -Indicates that the subsequent part of the line is a comment.
[0092]
In the fourth and fifth lines, “<ref src =“ urn: smpte: umid: 060A... 10 ”” indicates that the UMID defined by the SMPTE of the clip information file 151 of clip # 1 to be reproduced is “ 060A ... 10 ".
[0093]
“Type =” edlDoc ”begin =“ smpte-30 = 00: 00: 00: 00 ”clipBegin =“ smpte-30 = 00: 00: 00: 00 ”on the sixth line and“ clipEnd ”on the seventh line = “Smpte-30 = 00: 10: 00: 0” /> ”,“ type = ”edlDoc” indicates that the type (type) of the clip information file is “edlDoc”, and “begin = “Smpte-30 = 00: 00: 00: 00” indicates that the start position of clip # 1 after editing is set to “TC = 00: 00: 00: 00” with reference to a certain time. It represents. “TC = XX: XX: XX: XX” represents a time code.
[0094]
Also, “clipBegin =“ smpte-30 = 00: 00: 00: 00 ”” represents that the IN point of clip # 1 is “TC = 00: 00: 00: 00” with a certain time as a reference. “ClipEnd =“ smpte-30 = 00: 10: 00: 00 ”” indicates that the OUT point of clip # 1 is set to “TC = 00: 00: 10: 00”. That is, the playback time of clip # 1 is 10 minutes.
[0095]
The comment sentence “<!-Clip2->” on the eighth line indicates that the code relating to clip # 2 is described in the ninth to twelfth lines below.
[0096]
“<Ref src =“ urn: smpte: umid: 060A... 0F ”” in the ninth and tenth lines indicates that the UMID of the clip information file 151 of clip # 2 is “060A... 0F”. ing.
[0097]
“Type =” edlDoc ”begin =“ smpte-30 = 00: 10: 00: 0 ”clipBegin =“ smpte-30 = 0: 02: 00: 00: 00 ”on the 11th line and“ clipEnd ”on the 12th line = “Smpte-30 = 00: 03: 30: 30”, “type =” edlDoc ”indicates that the type of the clip information file 151 is“ edlDoc ”, and“ begin = ”smpte-30”. = 00: 10: 00: 0 "" indicates that the start position of clip # 2 after editing is set to "TC = 00: 00: 10: 00" with a certain time as a reference. That is, the start position of clip # 2 is the time point of 10 minutes when the reproduction of clip # 1 ends from the start position of clip # 1 “TC = 00: 00: 00: 00”. Therefore, the edit list in FIG. 7 indicates that clip # 2 is played after clip # 1 is played.
[0098]
Also, “clipBegin =“ smpte-30 = 00: 02: 00: 00: 00 ”represents that the IN point of clip # 2 is“ TC = 0: 02: 00: 00: 00 ”with reference to a certain time. “ClipEnd =“ smpte-30 = 00: 03: 30: 30 ”” indicates that the OUT point of clip # 2 is set to “TC = 0: 03: 30: 30”.
[0099]
When the editing terminal device 66 reproduces the optical disk 67 based on the edit list of FIG. 7, first, the management information of the clip data of clip # 1 is described, and the UMID is “060A... 10”. The clip information file 151 is read out. The editing terminal device 66 refers to the clip information file 151 and, from the data of the clip # 1, “TC = 00: 00: 00: 00” to “TC = 00: 00: 10: 00”. Data reproduction is started from “TC = 00: 00: 00: 00”.
[0100]
Then, the editing terminal device 66 reads the clip information file 151 having the UMID “060A... 0F” in which the clip data management information of the clip # 2 is described. The editing terminal device 66 refers to the clip information file 151 and, from the data of clip # 2, “TC = 0: 02: 00: 00: 00” to “TC = 00: 00: 03: 00”. Data reproduction starts from “TC = 00: 10: 00: 00”, and when all of the data is reproduced, the process is terminated.
[0101]
FIG. 8 is a flowchart for explaining the playlist creation processing of the editing terminal device 66 of FIG. This playlist creation processing starts when, for example, the user inserts the optical disc 67 into the drive 95 and selects a predetermined edit list to be converted into a playlist from the edit list recorded on the optical disc 67. Is done.
[0102]
In step S21, the playlist creation unit 86 reads (obtains) the edit list (FIG. 7) selected by the user from the edit list file 171 recorded on the optical disc 67, interprets it, Proceed to step S22. Specifically, the playlist creation unit 86 is a playback target in the playlist and the UMID of the clip information file 151 (management file) in which the management information of the clip specified as the playback target in the edit list is described. Recognize IN point and OUT point (edit point) set for clip data.
[0103]
For example, when an edit list as shown in FIG. 7 is read out, the playlist creating unit 86 starts reproduction from “<ref src =“ urn: smpte: umid: 060A... 10 ”” on the fifth line. It is recognized that the UMID defined by SMPTE of the clip information file 151 of clip # 1 is “060A... 10”, and “clipBegin =“ smpte-30 = 00: 00: 00: 00 ”on the sixth line. ”And“ clipEnd = “smpte-30 = 00: 10: 00: 0” /> ”on the seventh line, the IN point set for clip # 1 to be played back in the playlist is“ TC = 00:00 ”and the OUT point of clip # 1 is recognized as“ TC = 00: 00: 10: 00 ”.
[0104]
After the processing in step S21, the process proceeds to step S22, and the playlist creation unit 86 recognizes the file name of clip data to be reproduced in the playlist based on the edit list interpreted in step S21.
[0105]
Specifically, the playlist creation unit 86 recognizes the file name of the clip information file 151 to be reproduced in the edit list specified by the UMID from the index file 133 based on the edit list. That is, the index file 133 describes the correspondence between the UMID added to the clip information file 151 and the file name of the clip information file. By referring to the correspondence, the playlist creating unit 86 The file name of the clip information file 151 to be reproduced recognized in step S21 is recognized.
[0106]
Then, the playlist creation unit 86 reads the clip information file 151 based on the file name of the clip information file 151, and clips to be reproduced in the playlist from the IN point and OUT point of the clip described in the edit list. Recognizes the data and recognizes the name of the file in which the clip data is recorded.
[0107]
After the processing in step S22, the process proceeds to step S23, and the playlist creating unit 86 reads out the picture pointer corresponding to the clip data to be reproduced in the playlist recognized in step S22 from the picture pointer file 164. Proceed from step S23 to step S24.
[0108]
In step S24, the playlist creation unit 86 causes the playback device to edit the clip data to be played back in the playlist with the edit points (IN point and OUT point) set for the clip data described in the edit list. ) To determine whether or not it can be played back in real time (performs a real-time playability determination). That is, the playlist creating unit 86 determines whether or not the playback device can play back the edited clip data that is the editing result in real time. The real-time playability determination is performed for all seek occurrence positions.
[0109]
Details of the real-time reproduction permission / inhibition determination are described in Japanese Patent Application Nos. 2002-366197 and 2002-366199. The techniques described in these documents can also be applied to the real-time playability determination performed by the editing terminal device 66 of FIG. In addition, for example, the AV data is virtually played under the same conditions as the playback device, and the real-time playback availability determination is performed by various methods such as determining whether the playback is performed in real time. Good.
[0110]
If it is determined in step S24 that the playlist creation unit 86 is not capable of real-time playback, the process proceeds to step S25, where the bridge essence creation unit 87 obtains a bridge essence (bridge essence file (for example, bridge essence image data file 175)). create. At this time, the bridge essence creation unit 87 determines a bridge essence creation position on the optical disc 67 based on the result of the real-time reproduction availability determination, and creates a bridge essence at the creation position.
[0111]
That is, depending on the physical arrangement state of clip data, the clip data may not be continuously reproduced (real time reproduction) without interruption based on the edit list due to the seek performance of the drive. In such a case, the bridge essence creation unit 87 transfers the clip data in a range where continuous reproduction is impossible among the clip data in the range where the edit points (IN point and OUT point) are set to another location on the optical disc 67. And rearrange them so that they are physically contiguous to create a bridge essence. Since the bridge essence is rearranged so as to be physically continuous, by reproducing the bridge essence instead of the clip data in a range where continuous reproduction is impossible, continuous reproduction in real time is guaranteed. Details of the creation of the bridge essence are described in Japanese Patent Application No. 2001-109341.
[0112]
After the processing in step S25, the process proceeds to step S26, and the playlist creation unit 86 creates a playlist picture pointer. That is, the playlist creating unit 86 uses the picture pointer corresponding to the clip data to be reproduced in the playlist, read from the picture pointer file 164 in step S23, as the playlist picture pointer. A file 174 is created.
[0113]
After the processing in step S26, the process proceeds to step S27, and the playlist creation unit 86 designates the file name of the clip data file to be reproduced in the playlist recognized in step S22 based on the edit list as the reproduction target. A playlist to be played (playlist file 173) is created, and the process proceeds to step S28.
[0114]
In step S28, the playlist creation unit 86 rewrites the playlist so that reproduction is performed with reference to the bridge essence. That is, the playlist creation unit 86 specifies the file name of the bridge essence file as the playback target for the essence data for which the bridge essence is created in step S25 among the clip data to be played back in the playlist. , Rewrite the playlist. Then, the playlist creation unit 86 ends the process.
[0115]
On the other hand, if it is determined in step S24 that the seek time is short and the playback apparatus can perform real-time playback in accordance with the edit point of the edit list, the playlist creation unit 86 proceeds to step S29 and plays Based on the edit list, the list creation unit 86 creates a playlist (playlist file 173) that designates the file name of the clip data file to be played back in the playlist recognized in step S22 as the playback target, End the process.
[0116]
In step S27 and step S29 described above, the playlist creation unit 86 creates the playlist by rewriting the edit list so that the file name of the clip data to be played in the playlist is designated as the playback target. When the clip data is played back on the device, it is not necessary to read out the clip information file 151 and recognize the clip data file to be played back in the playlist, and only to refer to the playlist to be played back in the playlist. Clip data can be played immediately. Therefore, the playback device does not require a lot of processing until the clip data is played back, and the time taken for playback can be shortened.
[0117]
Further, in step S24 and step S25 described above, the playlist creation unit 86 determines whether or not it can be played back in real time, and if it is determined that playback is not possible in real time, the bridge essence creation unit 87 Of the clip data in the range where the edit points are set, the clip data in the range where real-time playback is impossible is copied to another location on the optical disc 67, rearranged so that it is physically continuous, and bridge essence Therefore, real-time reproduction is guaranteed by reproducing bridge essence instead of clip data in a range where continuous reproduction is impossible.
[0118]
Note that the playlist creating unit 86 can also skip the process of step S29. In other words, if the playback device determines that the playback device can perform real-time playback according to the editing points of the edit list, the play list creation unit 86 does not create a playlist, and the playback device performs clip data according to the edit list. Can also be played.
[0119]
9 and 10 are diagrams showing examples of playlists described in the playlist file 173. In addition, FIG. 10 is a figure following FIG.
[0120]
FIG. 9 and FIG. 10 show examples of codes in a range specified from the <body> tag that is the start tag to the </ body> tag that is the end tag in the playlist.
[0121]
The contents of the playlist are described between the <par> tag on the second line and the </ par> tag on the 40th line.
[0122]
The <switch> tag on the third line specifies the type of codec (CODEC (Compressor DECompressor)), and is between the <switch> tag on the third line and the </ switch> on the 39th line. The codec type of the content described in can be specified.
[0123]
<! --Main Stream-> is a comment sentence representing the essence data, and <par systemComponent = “MPEG2HD25_1440_MP @ HL”> on the fifth line indicates that the codec type to be specified is “MPEG2HD25_1440_MP @ HL” ” Indicates that the codec is compatible. That is, a codec corresponding to an MP @ HL (main profile high level) decoder for MPEG (High Definition) image data encoded in MPEG2 and having a bit rate of 25 Mbps and a horizontal number of pixels of 1440 in the image. Is specified.
[0124]
In ““ MPEG2HD25 — 1440_MP @ HL ””, the number of pixels in the vertical direction of the image is omitted in order to shorten the description.
[0125]
Also, the 6th line <! --VIDEO-> is a comment sentence indicating that image data is described in the 7th to 38th lines below.
[0126]
“<!-Clip1->” on the seventh line is a comment sentence indicating that the code relating to clip # 1 is described in the eighth to twelfth lines below.
[0127]
“<Video src =” / PROAV / CLPR / 0001 / C0001V01. MXF ″ ”indicates that the file name of the data file of clip # 1 to be reproduced is“ C0001V01 ”. That is, the data of clip # 1 is the data of the image data file 152 (FIG. 4).
[0128]
“ClipBegin =“ smpte−30 = 00: 00: 00 ”” on the ninth line and “clipEnd =“ smpte-30 = 00: 05: 00 ”on the tenth line indicate a certain time. As a reference, the IN point of clip # 1 represents “TC = 00: 00: 00: 00”, and “clipEnd =“ smpte-30 = 00: 00: 00: 00 ”” This indicates that the OUT point is set to “TC = 00: 05: 00: 00: 00”. That is, the playback time of clip # 1 is 5 minutes.
[0129]
“Type =“ MPEG2HD25 — 1440_MP @ HL ”aspectRatio = 16: 9” in the 11th row indicates that the data type of clip # 1 is “MPEG2HD25 — 1440_MP @ HL”, and the aspect ratio of the image data is “16”. : 9 ". “Header =“ 65536 ”” on the 12th line indicates that the header size of the MXF (Media Exchange Format) file of the image data file 152 is 65536 bytes.
[0130]
“<!-Bridge Essence->” on the 13th line is a comment sentence indicating that the code relating to the bridge essence is described in the 14th to 29th lines below.
[0131]
“<Video src =” B0002V01. BMX ”” and “begin =“ smpte-30 = 00: 05: 00: 00: 00 ”,“ <video src = ”B0002V01. “BMX ″” indicates that the file name of the bridge essence to be reproduced is “B0002V01”. That is, the bridge essence data is data of the bridge essence image data file 175. Also, “begin =“ smpte-30 = 00: 05: 00: 00: 00 ”indicates that the bridge essence start position after editing is set to“ TC = 0: 05: 00: 00: 00 ”with reference to a certain time. It shows that there is. That is, the start position of the bridge essence is a time point of 5 minutes when the reproduction of the clip # 1 ends from the start position “TC = 00: 00: 00: 00” of the clip # 1.
[0132]
Here, assuming that the bridge essence 175 to be reproduced is the bridge essence # 1 as the bridge essence to be reproduced for the first time, “clipBegin =” smpte-30 = 00: 00: 00: on the 15th line. “00 ″” represents that the IN point of the bridge essence # 1 is “TC = 00: 00: 00: 00” on the basis of a certain time, and “clipEnd =“ smpte-30 = 00 ”on the 16th line. ": 00: 00: 12""indicates that the OUT point of the bridge essence # 1 is set to" TC = 00: 00: 02: 00 ". That is, the reproduction time of bridge essence # 1 is 12 frames.
[0133]
In the 17th line, “type =“ MPEG2HD25 — 1440_MP @ HL ”aspectRatio = 16: 9” /> ”, the data type of the bridge essence # 1 is“ MPEG2HD25 — 1440_MP @ HL ”and the aspect ratio of the image data is“ 16: 9 ".
[0134]
“<Video src =” B0002V01. BMX ”” and “begin =“ smpte-30 = 00: 05: 00: 12 ”,“ <video src = ”B0002V01. “BMX ″” indicates that the file name of the bridge essence # 2 to be reproduced is “B0002V01”. That is, the data of the bridge essence # 2 is the data of the bridge essence image data file 175. Also, “begin =“ smpte-30 = 00: 05: 00: 12 ”sets the start position of the edited bridge essence # 2 to“ TC = 00: 05: 00: 12 ”with a certain time as a reference. It represents what is being done. That is, the start position of the bridge essence # 2 is ended from the start position “TC = 0: 05: 00: 00: 00” of the bridge essence # 1 to be reproduced last time. The time is 12 frames.
[0135]
“ClipBegin =“ smpte-30 = 00: 00: 00: 17 ”” on the 19th line indicates that the IN point of bridge essence # 2 is “TC = 0: 00: 00: 17” with reference to a certain time. "ClipEnd =" smpte-30 = 00: 00: 00: 27 "" on the 20th line indicates that the OUT point of the bridge essence # 2 is set to "TC = 0: 00: 00: 27" It represents what is being done. That is, the reproduction time of bridge essence # 2 is 10 frames.
[0136]
“DecBegin =” smpte-30 = 00: 00: 00: 15 ”predecDur =“ 1 ”on the 21st line and“ decEnd = ”smpte-30 = 00: 00: 0: 28” postDecDur on the 22nd line = “1” is based on a certain time, the input start position to the decoder is “TC = 00: 00: 0: 15”, and the decoder input end position is “TC = 00: 00: 0: 28”. It represents that. The period (number of frames) that requires input to the decoder between the IN point and the input start position to the decoder is “1”, and input to the decoder between the OUT point and the decoder input end position is required. This means that a long period (the number of frames) is “1”.
[0137]
In other words, in the MPEG encoding method, it may be necessary to decode from the picture whose display order is earlier than the IN point. The start position of the decoding is specified by decBegin, and the frame that is not displayed but needs to be decoded. The number is specified by preDecDur. Also, in the MPEG encoding method, it may be necessary to decode up to a picture whose display order is later than the OUT point. The decoding end position is designated by decEnd, and the number of frames that are not displayed but need to be decoded. Is specified by postDecDur.
[0138]
Note that “decBegin” can be omitted when it is the same as “clipBegin”, and “decEnd” can be omitted when it is the same as “clipEnd”. For example, since “decBegin” and “decEnd” are not described in the 8th to 12th lines in which the code related to clip # 1 is described, “decBegin” is the same as “clipBegin”. “TC = 00: 00: 00: 00”, and “decEnd” is “TC = 0: 05: 00: 00: 00”, which is the same as “clipEnd”.
[0139]
“Type =“ MPEG2HD25 — 1440_MP @ HL ”” on the 23rd line and “aspectRatio = 16: 9” /> on the 24th line indicate that the data type of the bridge essence # 3 to be reproduced is “MPEG2HD25 — 1440_MP @ HL”. Yes, it represents that the aspect ratio of the image data is “16: 9”.
[0140]
“<Video src =” B0002V01. BMX ”” and “begin =“ smpte-30 = 00: 05: 00: 22 ”,“ <video src = ”B0002V01. “BMX ″” indicates that the file name of the bridge essence # 3 to be reproduced is “B0002V01”. That is, the bridge essence data is data of the bridge essence image data file 175. Also, “begin =” smpte-30 = 00: 05: 00: 22 ”means that the bridge essence start position after editing is set to“ TC = 0: 05: 00: 22 ”with a certain time as a reference. It shows that there is. That is, the start position of the bridge essence # 3 ends from the start position “TC = 00: 05: 00: 12” of the previous bridge essence # 2 to be played back, and the playback of the bridge essence # 2 of the previous playback target ends. This is the time point of 10 frames.
[0141]
On the 26th line, “clipBegin =“ smpte−30 = 00: 00: 01: 03 ”” indicates that the IN point of the bridge essence # 3 is “TC = 0: 00: 00: 01: 03” with reference to a certain time. “ClipEnd =“ smpte−30 = 00: 00: 01: 14 ”” on the 27th line indicates that the OUT point of the bridge essence # 3 is set to “TC = 00: 00: 00: 00” It represents what is being done. That is, the reproduction time of the bridge essence # 3 is 11 frames.
[0142]
“Type =“ MPEG2HD25 — 1440_MP @ HL ”” on the 28th line and “aspectRatio = 16: 9” on the 29th line indicate that the data type of the bridge essence # 3 to be reproduced is “MPEG2HD25 — 1440_MP @ HL”. This indicates that the aspect ratio of the image data is “16: 9”.
[0143]
“Header =“ 500000 ”/>” on the 29th line indicates that the offset to the frame to be reproduced is 500,000 bytes.
[0144]
"<!-Clip3->" on the 30th line is a comment sentence indicating that the code relating to clip # 3 is described in the 31st to 38th lines below.
[0145]
“<Video src =” / PROAV / CLPR / 0005 / C0005V01. “MXF ″” indicates that the file name of the data file of clip # 3 to be reproduced is “C0005V01”. “Begin =“ smpte-30 = 00: 05: 01: 03 ”on the 32nd line indicates that the start position of clip # 3 after editing is“ TC = 00: 05: 01: 03 ”with a certain time as a reference. It is set to. That is, the start position of clip # 3 is the end of playback of bridge essence # 3 of the previous playback target from the start position “TC = 0: 05: 00: 22” of bridge essence # 3 of the previous playback target. It is the time after the frame.
[0146]
In line 33, “clipBegin =“ smpte-30 = 00: 10: 00: 15 ””, the IN point of clip # 3 is “TC = 00: 10: 00: 15” with reference to a certain time. “ClipEnd =“ smpte−30 = 00: 15: 10: 00 ”” on the 34th line indicates that the OUT point of clip # 3 is “TC0: 00: 15: 10: 00”. Represents.
[0147]
“DecBegin =” smpte-30 = 00: 10: 00: 12 ”predecDur =“ 2 ”in the 35th line and“ decEnd = ”smpte-30 = 00: 15: 10: 00” postDecDur in the 36th line = “0”, with reference to a certain time, the input start position to the decoder is “TC = 00: 10: 00: 12”, and the decoder input end position is “TC = 0: 15: 10: 00”. It represents that. In addition, the period (number of frames) that requires input to the decoder between the IN point and the input start position to the decoder is “2”, and input to the decoder between the OUT point and the decoder input end position is required. This indicates that a long period (the number of frames) is “0”.
[0148]
“Type =“ MPEG2HD25 — 1440_MP @ HL ”” on the 37th line indicates that the data type of clip # 3 is “MPEG2HD25 — 1440_MP @ HL”. Of the “aspectRatio = 16: 9” header = “1000000” /> ”on the 38th line,“ aspectRatio = 16: 9 ”represents that the aspect ratio of the image data is“ 16: 9 ”, “Header =“ 1000000 ”/>” indicates that the header size of the MXF file of clip # 3 is 1000000 bytes.
[0149]
FIG. 11 is a diagram illustrating a configuration example of the reproducing device 201 that reproduces the optical disc 67.
[0150]
The playback control unit 211 includes a reading unit 221 and a decoding control unit 222.
[0151]
The playback control unit 211 plays the clip data such as the image data file 152 and the audio data file 153 recorded on the optical disc 67 mounted on the drive 212 in the playlist file 173 recorded on the optical disc 67 together with the clip data. Play based on the list.
[0152]
The reading unit 221 includes a picture pointer reading unit 231 and a playlist reading unit 232. The playlist reading unit 232 reads a playlist from the playlist file 173 recorded on the optical disc 67 loaded in the drive 212 via the disc I / F 241 and supplies it to the picture pointer reading unit 231.
[0153]
The picture pointer reading unit 231 sends a picture pointer of essence data (clip data and bridge essence) to be reproduced in the playlist supplied from the playlist reading unit 232 from the optical disk 67 mounted on the drive 212 to the disk I. Read through / F. That is, the picture pointer reading unit 231 reads the picture pointer corresponding to the clip data to be reproduced and the picture pointer corresponding to the bridge essence from the picture pointer file 164 and the playlist picture pointer file 174, respectively.
[0154]
The picture pointer reading unit 231 supplies the read picture pointer to the decoder control unit 222 together with the playlist supplied from the playlist reading unit 232.
[0155]
Based on the decoding type (codec type) described in the playlist, the decoding control unit 222 selects a decoder to be used for reproduction from the decoders 261-1 to 261-N of the decoding unit 213. Further, the decode control unit 222 controls the selected decoder based on the picture pointer and the playlist, and reproduces the essence data to be reproduced on the optical disc 67.
[0156]
The drive 212 is composed of a disk I / F 241. When the optical disk 67 is loaded in the drive 212, the disk I / F 241 reads a picture pointer and a playlist from the optical disk 67 and supplies them to the picture pointer reading unit 231 and the playlist reading unit 232, respectively. Further, the disk I / F 241 reads out other data and supplies it to the decoders 261-1 to 261 and decoder 261 -N of the decoder unit 213.
[0157]
The decoder unit 213 includes decoders 261-1,... In the following, when it is not necessary to individually distinguish each of the decoders 261-1 to 261-N, they are collectively referred to as a decoder 261.
[0158]
The decoder 261 is controlled by the decode control unit 222 and reproduces essence data to be reproduced recorded on the optical disc 67.
[0159]
FIG. 12 is a flowchart for explaining the reproduction process of the reproduction apparatus 201 in FIG. This reproduction process starts when the user inserts the optical disk 67 into the drive 212 and instructs to reproduce the optical disk 67 based on the playlist.
[0160]
In step S 41, the playlist reading unit 232 reads a playlist from the playlist file 173 recorded on the optical disc 67 and interprets it.
[0161]
For example, when the playlist is as shown in FIG. 9 and FIG. 10, the playlist reading unit 232 determines the codec type of the designated decoder from “<par systemComponent =“ MPEG2HD25 — 1440_MP @ HL ”>” on the fifth line. Is a codec corresponding to ““ MPEG2HD25 — 1440_MP @ HL ””, “<video src =” PROAV / CLPR / 0001 / C0001V01. MXF ″ ”interprets that the file name of the essence data to be reproduced specified in the playlist is“ C0001V01 ”.
[0162]
Also, the playlist read-out unit 232 has “clipBegin =” smpte-30 = 00: 00: 00: 00 ”on the ninth line and“ clipEnd = ”smpte-30 = 00: 05: 00” on the tenth line. 0:00 ”, it is interpreted that the IN point of the essence data to be reproduced is“ TC = 0: 00: 00: 00: 00 ”and the OUT point is“ TC = 0: 00: 00: 00: 00 ”.
[0163]
Furthermore, since “decBegin” and “decEnd” are not described in the playlist reading unit 232, “decBegin”, that is, the start position to the decoder is the same as the IN point “TC = 0: 00: 00: 00: 00” It is interpreted that “decEnd”, that is, the decoder end position is “TC = 00: 05: 00: 00: 00” which is the same as the OUT point.
[0164]
Then, the playlist reading unit 232 supplies the interpreted playlist to the picture pointer reading unit 231 and proceeds from step S41 to step S42.
[0165]
In step S42, the picture pointer reading unit 231 reads the picture pointer of the essence data to be reproduced by the playlist.
[0166]
For example, when the file name of the essence data to be played back by the playlist is “C0001V01”, the picture pointer from the picture pointer file 164 in which the picture pointer of the image data file 152 whose file name is “C0001V01” is described. Is read.
[0167]
Then, the picture pointer reading unit 231 supplies the read picture pointer together with the playlist supplied from the playlist reading unit 232 in step S41 to the decode control unit 222, and proceeds from step S42 to step S43.
[0168]
In step S43, the decoding control unit 222 recognizes the codec type of the designated decoder from the playlist supplied from the picture pointer reading unit 231, and selects the decoder 261.
[0169]
For example, when the codec type of the decoder specified in the playlist is a codec corresponding to ““ MPEG2HD25 — 1440_MP @ HL ””, the decoder 261 having the codec is selected as the decoder 261 that decodes the essence data to be played back. To do.
[0170]
After the processing of step S43, the process proceeds to step S44, and the decoder control unit 222 controls the decoder 261 to perform reproduction.
[0171]
Specifically, the decoder control unit 222 sets the decoding start position and decoding end position of the essence data to be reproduced based on the picture pointer and the playlist supplied from the picture pointer reading unit 231 in step S42, The decoder 261 is controlled. Based on the decoding start position and decoder end position set by the decoder control unit 222, the decoder 261 reads and decodes the essence data of the file having the file name designated as the reproduction target in the playlist from the optical disc 67 (reproduction). I do). Then, the decoder control unit 222 ends the process.
[0172]
In the playback process described above, in the playlist, the file name of the essence data is designated as the playback target. Therefore, the decoder 261 plays back the essence data immediately by playing back the essence data based on the playlist. Can do. Therefore, a lot of processing is not required until the reproduction of the essence data, and the time required for the reproduction can be reduced.
[0173]
Note that the playback device 201 repeats the process of playing back the clip data to be played back based on the playlist until the user gives an instruction to stop playback. For example, when playback processing is performed based on the playlist of FIGS. 9 and 10, after clip # 1 is played back, bridge essence # 1, bridge essence # 2, bridge essence # 3, and clip # 3 are played in this order. Is done.
[0174]
FIG. 13 is a diagram showing the concept of an edit list and a playlist.
[0175]
In FIG. 13, a clip information file 321-1 is a management file for managing an image data file 323-1 and an audio data file 324-1. The clip information file 321-2 is a management file for managing the image data file 323-2 and the audio data file 324-2.
[0176]
In the edit list 301, when the IN point and the OUT point are set in the image data file 323-1 and the image data file 323-2, a clip information file 321-which is a management file for managing the image data file 323-1. 1 and a clip information file 321-2 which is a management file for managing the image data file 323-2 are to be reproduced.
[0177]
Therefore, when clip data is reproduced based on the edit list 301, first, the clip information file 321-1 and the clip information file 321-2 are reproduced. Then, referring to the clip information file 321-1 and the clip information file 321-2, the image data file 323-1 and the image data file 323-2 are reproduced.
[0178]
Further, when the playlist 302 is created based on the edit list 301, in the playlist 302, the image data file 323-1 and the image data file 323-2 to be reproduced are directly designated as reproduction targets.
[0179]
Therefore, when clip data is reproduced based on the playlist 302, the image data file 323-1 and the image data file 323-2 are directly reproduced.
[0180]
Here, when the bridge essence file 331 has been created in order to guarantee real-time playback, the playlist 302 also specifies the bridge essence file 331 as a playback target.
[0181]
In the play list 302, the image data file 323-1 and the image data file 323-2 are directly designated as playback targets, so that the playback device immediately stores the direct image data file 323-1 and the image data file 323-2. Can be played. Accordingly, it is possible to shorten the time required for reproduction without requiring much processing until reproduction of the image data file 323-1 and the image data file 323-2.
[0182]
The editing terminal device 66 and the playback device 201 have been described as being configured separately from each other. However, the present invention is not limited to this, and some or all of the functions of each device are integrated with each other. You may make it do.
[0183]
In the above description, the edit list is created by the editing terminal device 66. However, the edit list is acquired by receiving the edit list created by another editing terminal device via a network such as the Internet. May be.
[0184]
In addition, in the present specification, the processes described in the flowcharts are executed in parallel or individually even if they are not necessarily processed in time series, as well as processes performed in time series according to the order described as steps. It also includes processing.
[0185]
【The invention's effect】
As described above, according to the present invention, data can be reproduced. In particular, the time required for data reproduction can be shortened, whereby the data can be reproduced in real time.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a configuration example of a video program production support system to which the present invention is applied.
FIG. 2 is a block diagram illustrating a configuration example of the editing terminal device in FIG. 1;
FIG. 3 is a diagram showing a configuration example of a directory structure for managing data by a file system.
4 is a diagram showing a detailed configuration example of the directory structure of FIG. 3;
5 is a diagram showing a detailed configuration example of the directory structure of FIG. 3;
6 is a flowchart for describing edit list creation processing of the edit list editing unit in FIG. 2; FIG.
FIG. 7 is a diagram showing an example of an edit list.
FIG. 8 is a flowchart for explaining playlist creation processing of the playlist creation unit of FIG. 2;
FIG. 9 is a diagram illustrating an example of a playlist.
FIG. 10 is a diagram illustrating an example of a playlist.
FIG. 11 is a block diagram illustrating a configuration example of a playback device.
FIG. 12 is a flowchart for explaining playback processing of the playback device of FIG. 11;
FIG. 13 is a diagram showing the concept of an edit list and a playlist.
[Explanation of symbols]
51 video program production support system, 61 planning terminal device, 62 network, 63 coverage terminal device, 64 imaging device, 65 field PC, 66 editing terminal device, 67 optical disc, 84 clip data editing unit, 85 edit list editing unit , 86 playlist creation unit, 87 bridge essence creation unit, 211 playback control unit, 212 drive, 213 decoding unit, 221 readout unit, 222 decoder control unit, 231 picture pointer readout unit, 232 playlist readout unit, 241 disc I / F, 261 decoder

Claims (4)

In an information creation device that creates information provided to a playback device that plays back predetermined data,
Reproduction control information acquisition means for acquiring first reproduction control information for designating a management file for managing the data as a reproduction target;
Creating means for creating second reproduction control information for designating a file composed of the data as a reproduction target based on the first reproduction control information obtained by the reproduction control information obtaining means; Information creation device. In the first reproduction control information, edit points set for the data are described.
Determining means for determining whether or not the playback device can play back the data that is an editing result based on the editing point in real time;
Relocation means for rearranging data in a predetermined range in which the editing points are set when the determination means determines that the playback apparatus cannot reproduce the data as the editing result in real time. And further comprising
2. The information creation according to claim 1, wherein the creation unit creates second playback control information that also designates a file including the data rearranged by the rearrangement unit as a playback target. apparatus. In an information creation method of an information creation device for creating information provided to a playback device that plays back predetermined data,
A reproduction control information acquisition step of acquiring first reproduction control information for designating a management file for managing the data as a reproduction target;
Creating a second reproduction control information for designating a file composed of the data as a reproduction target based on the first reproduction control information acquired by the process of the reproduction control information acquisition step. An information creation method characterized by In a program for causing a computer to perform information creation processing for creating information provided to a playback device that plays back predetermined data,
A reproduction control information acquisition step of acquiring first reproduction control information for designating a management file for managing the data as a reproduction target;
A creation step of creating second playback control information for designating a file composed of the data as a playback target based on the first playback control information acquired by the processing of the playback control information acquisition step. A program characterized by

Images