JP4433559B2 - Production system and production method - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a production system and a production method for producing a project from an essence.
[0002]
[Prior art]
In recent years, SMPTE (Society of Motion Picture and Television Engineers) has been standardizing metadata, and the meanings of essence indicating content and wrappers that combine metadata and essence are defined. Yes. Furthermore, KLV (Key Length Value) protocol and UMID (Unique Material Identifier), which are metadata data structures, are proposed, and a metadata dictionary (Meta data Dictionary) that collects specific metadata itself is proposed. Standardization is ongoing.
[0003]
[Problems to be solved by the invention]
By the way, the lack of program software due to multi-channel and multimedia has become a problem in broadcasting stations, minimizing the cost burden and improving the service without reducing the quality of the program (contents). In order to achieve this, how to secure program software is an important issue. This means how efficiently video / audio data can be processed in a series of processes from recording / creation to editing, transmission, and archiving. Reuse past programs. Media asset management, including the construction of an archiving system, is the biggest challenge.
[0004]
Accordingly, an object of the present invention is to provide a production system and a production method capable of efficiently producing a project from an essence in view of such a conventional situation.
[0005]
[Means for Solving the Problems]
The present invention is a production system for producing a project from the essence. Data relating to the essence, including means for generating a plurality of metadata each identified by a SMPTE (Society of Motion Picture and Television Engineers) label, a preamble part for describing the metadata, and essence data It consists of a main body for description, an index part including an index table, and a postamble part. The preamble part is an area where a universal label, an allocation table, and metadata including a universal label as a key are described. A means for transmitting the plurality of metadata as a data file in which the allocation information of each object in the overall metadata area is registered in the allocation table. Have A pre-production that generates metadata describing the essence, a production that creates the essence and associates the essence with the metadata and stores them in a recording medium, and uses the metadata generated during the pre-production. And post production for producing the project from the essence.
[0006]
In addition, the present invention is a production system for producing a project from the essence. Data relating to the essence, including means for generating a plurality of metadata each identified by a SMPTE (Society of Motion Picture and Television Engineers) label, a preamble part for describing the metadata, and essence data It consists of a main body for description, an index part including an index table, and a postamble part. The preamble part is an area where a universal label, an allocation table, and metadata including a universal label as a key are described. A means for transmitting the plurality of metadata as a data file in which the allocation information of each object in the overall metadata area is registered in the allocation table. Have Pre-production for generating metadata describing the essence, production for producing the essence, storing the essence and the metadata in association with each other on a recording medium, and post-production for producing the project from the essence. And the post-production operation is controlled using metadata generated during the pre-production.
[0007]
In addition, the present invention is a production system for producing a project from the essence. Data relating to the essence, including means for generating a plurality of metadata each identified by a SMPTE (Society of Motion Picture and Television Engineers) label, a preamble part for describing the metadata, and essence data It consists of a main body for description, an index part including an index table, and a postamble part. The preamble part is an area where a universal label, an allocation table, and metadata including a universal label as a key are described. A means for transmitting the plurality of metadata as a data file in which the allocation information of each object in the overall metadata area is registered in the allocation table. Have Pre-production for generating metadata describing the essence, production for producing the essence, storing the essence and the metadata in association with each other on a recording medium, and post-production for producing the project from the essence. The post-production operation is performed in association with the metadata generated during the pre-production.
[0008]
The present invention also relates to a production method for producing a project from an essence. Data describing the above essence, and a plurality of metadata, each identified by an SMPTE (Society of Motion Picture and Television Engineers) label, is generated, a preamble part for describing the metadata, and an essence data It consists of a main body for description, an index part including an index table, and a postamble part. The preamble part is an area where a universal label, an allocation table, and metadata including a universal label as a key are described. And a step of transmitting the plurality of metadata as a data file in which the allocation information of each object in the overall metadata area is registered in the allocation table. , In addition to producing the essence, the essence and the metadata are associated with each other on a recording medium. Memorizing step; Using the metadata generated during pre-production, the above project from the above essence And having a production step It is characterized by that.
[0009]
The present invention also relates to a production method for producing a project from an essence. Data describing the above essence, and a plurality of metadata, each identified by an SMPTE (Society of Motion Picture and Television Engineers) label, is generated, a preamble part for describing the metadata, and an essence data It consists of a main body for description, an index part including an index table, and a postamble part. The preamble part is an area where a universal label, an allocation table, and metadata including a universal label as a key are described. And a step of transmitting the plurality of metadata as a data file in which the allocation information of each object in the overall metadata area is registered in the allocation table. , In addition to producing the essence, the essence and the metadata are associated with each other on a recording medium. Memorizing step; Using post-production metadata, post-production operations that produce the project from the essence And controlling step It is characterized by that.
[0010]
Furthermore, the present invention relates to a production method for producing a project from an essence. Data describing the above essence, and a plurality of metadata, each identified by an SMPTE (Society of Motion Picture and Television Engineers) label, is generated, a preamble part for describing the metadata, and an essence data It consists of a main body for description, an index part including an index table, and a postamble part. The preamble part is an area where a universal label, an allocation table, and metadata including a universal label as a key are described. And a step of transmitting the plurality of metadata as a data file in which the allocation information of each object in the overall metadata area is registered in the allocation table. , In addition to producing the essence, the essence and the metadata are associated with each other on a recording medium. Memorizing step; Post-production operations that create the project from the essence in association with the metadata generated during pre-production Having the steps of It is characterized by that.
[0011]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
[0012]
The present invention is applied to, for example, a program creation / distribution system 100 configured as shown in FIG.
[0013]
The program creation / distribution system 100 includes a distribution program organization system 10, a production system 20, a news system 30, an archive system 40, and a program distribution system 50 connected via the Gigabit Ethernet 1, and is provided to the production system 20. An acquisition system 60 for acquiring video and audio is provided.
[0014]
The distribution program organization system 10 is a system for so-called pre-production processing before shooting, in which related parties such as producers, directors, and production staff make arrangements regarding distribution contents of programs, etc. Through a plurality of workstations 10A connected to the Ethernet 1, a person concerned with the program can make a meeting regarding the distribution contents of the program.
[0015]
The production system 20 is a system for shooting and production processing that collects video and audio. For example, as shown in FIG. 2, a recording management system 21 for a recording person to input necessary items, production management, and the like. System 22, ingest system 23 for storing video and audio acquired by acquisition system 60, coding system 24 for performing video and audio coding processing, editing / processing system 25 for video and audio editing processing, CG ( It includes a CG creation system 26 for creating a map by computer graphics), a map for displaying the image superimposed on the video, a weather map, characters, and the like.
[0016]
The recording management system 21 includes a plurality of workstations 21A connected to the Gigabit Ethernet 1, and a reporter can input articles via the workstation 21A. The production management system 22 includes a device controller 22A and an A / V server 22B connected to the Gigabit Ethernet 1. The ingest system 23 includes a playback device 23A that plays back video and audio recorded on a video tape, a telecine device 23B that converts film-captured video into a video signal, and a plurality of ingest clients connected to the Gigabit Ethernet 1 The video and audio acquired by the acquisition system 60 can be stored in the ingest client 23C via the playback device 23A and the telecine device 23B. The coding system 24 includes a coding controller 24A, an MPEG encoder 24B, and an MPEG decoder 24C connected to the Gigabit Ethernet 1. The editing / processing system 25 includes an offline editing device 25A, an online editing device 25B, a video processing device 25C, and an audio processing device 25D connected to the Gigabit Ethernet 1.
[0017]
The news system 30 is a system that comprehensively manages news information, and performs management of on-air items and material management such as which material is subjected to which stage of processing.
[0018]
The archive system 40 is a system for storing video data and audio data, and includes an archive manager 40A and a petasite 40B connected to the Gigabit Ethernet 1. Essence and metadata are stored in the petasite 40B.
[0019]
The program distribution system 50 includes a server controller 51, an authoring system 52, a Web system 53, and an on-air server 54 connected to the Gigabit Ethernet 1, and a routing switch 55 that selects an on-air program.
[0020]
The acquisition system 60 includes a video camera 61 and a relay vehicle 62.
[0021]
This program creation / distribution system 100 records video and audio (hereinafter referred to as materials) in, for example, broadcasting stations and video production companies, and edits and processes these materials to produce video for distribution. Further, the image processing system has a function of storing the video, and in each image processing process such as recording, editing, and storing of the material, additional information for identifying the material in detail is a recording medium or a dedicated recording. Input to the server.
[0022]
Note that metadata is used as the additional information. The metadata is data for describing information necessary for identifying a material obtained by recording, such as a recording time, a recording ID, a recording title, a photographer name, and a reporter name.
[0023]
In the program creation / distribution system 100, SDI (Serial Digital Interface), which is a digital data transmission format standardized by SMPTE, is used as a transmission format for transmitting video data, audio data, and metadata. FIG. 3A shows the configuration of the entire SDI format data.
[0024]
The SDI format includes a 4-dot EAV (End of Video) area indicating end synchronization, a 268-dot ANS (Ancillary) area, a 4-dot SAV (Start of Video) area indicating start synchronization, and an active 1440 dot area. A video area, and is composed of 525 lines. However, the numbers in parentheses indicate values defined by the PAL (Phase Alternation Line) method.
[0025]
The active video area has a 9-line vertical blanking section (VBK). ₁ ) And 10-line optional blanking section (OBK) ₁ ) And 244 lines of active video (ACV) ₁ ) And 9-line vertical blanking section (VBK) ₂ ) And 10-line optional blanking section (OBK) ₂ ) And 243 lines of active video area (ACV) ₂ ).
[0026]
SDI is a format for transmitting uncompressed digital data such as the so-called D1 format and D2 format. Audio data is stored in the ancillary area, and video data such as D1 and D2 is stored in the active video area. Is transmitting. In the SDI format, the metadata is inserted into the ancillary area and transmitted.
[0027]
FIG. 3B shows one line of the SDI format. When transmitted, data of 10 bits width per line is transmitted after being subjected to parallel-serial conversion and transmission path coding.
[0028]
Further, as a transmission format for transmitting video data, audio data, and metadata in the image processing system 1, in addition to the above-mentioned SDI format, SDTI for transmitting compressed data compressed by the MPEG method, DV method or the like. (Serial Digital Transfer Interface) format or SDTI-CP (Serial Digital Transfer Interface-Content Package) format which further restricts the SDTI format may be used.
[0029]
FIG. 4A shows the data structure of the SDTI format. Similar to the SDI format, the SDTI format includes a 4-dot EAV (End of Video) area indicating end synchronization, a 268-dot ANC (Ancillary) area, and a 4-dot SAV (Start of Video) area indicating start synchronization. However, an active video area composed of 525 lines in the SDI format is defined as a payload area. However, the numbers in parentheses indicate values defined by the PAL (Phase Alternation Line) method.
[0030]
In the SDTI format, the payload area has a blank data portion (BDT ₁ , BDT ₂ ) And the data part (DT ₁ , DT ₂ ), But the number of lines in each data part is not defined.
[0031]
FIG. 4B shows one line of the SDTI format. When transmitted in the SDTI format, data of 10 bits width per line is transmitted after being subjected to parallel-serial conversion and transmission path coding.
[0032]
In the SDTI format, the ancillary area includes 53 words of SDTI header data into which a source address, a destination address, a line number CRC, and the like are inserted. In the SDTI format, metadata is inserted into the area of the ancillary area excluding the SDTI header data.
[0033]
FIG. 5 shows the data structure of the SDTI-CP format. The packet structure in the SDTI-CP further restricts the SDTI format, and various data are easily inserted by changing the payload structure.
[0034]
Data transmitted by the SDTI-CP format includes MPEG (Moving Picture Expert Group) 2 Video Elementary Stream and the like, and various data such as auxiliary data including audio and metadata can be transmitted together.
[0035]
Data to be inserted into the payload is delimited by “items”, and various data are inserted into each item. Specifically, there are four types of items: System Item, Picture Item, Audio Item, and Auxiliary Item.
[0036]
The System Item has areas such as System Item Bitmap, Content Package rate, SMPTE Universal Label, Package Metadata Set, Picture Metadata Set, Audio Metadata Set, Auxiliary Metadata Set, and the like.
[0037]
In the SDTI-CP format, the metadata is transmitted after being inserted into the Package Metadata Set, Picture Metadata Set, Audio Metadata Set, and Auxiliary Metadata Set areas of the System Item.
[0038]
Metadata is unique data that is added to identify materials such as video data and audio data, and is KLV (Key Length Value) protocol and UMID (Unique Material Identifier) data based on the SMPTE standard. Transmitted by format.
[0039]
The KLV format stores 16-byte Universal Label Data Key describing Universal Label Data, Value Length indicating the data length of metadata stored in the Value area, and actual metadata corresponding to the SMPTE Dictionary. It is a data transmission format with three areas of Value. FIG. 6 shows the KLV format.
[0040]
Universal Label Data Key is a data area for uniquely labeling stored metadata. The Universal Label Data Key further includes a 1-byte Object ID and a UL (Universal Label) Header area that includes a UL (Universal Label) Size, 1-byte UL (Universal Label) Code, SMPTE Design, and Registry, respectively. Each area is divided into a UL (Universal Label) Designatores area including Design, Data Design, and Reference Version, and a 9-byte Data Element Tag area.
[0041]
The UMID is an identifier that is uniquely determined to identify video data, audio (voice) data, and other material data. FIG. 7 shows the data structure of UMID.
[0042]
The UMID is a basic UMID as an ID for identifying material data composed of a series of video, audio, and metadata (hereinafter referred to as content), and a signature for identifying each content in the material data. And Extended UMID.
[0043]
Basic UMID has a 32-byte data area, and is composed of a 12-byte Universal Label area, a 1-byte Length Value area, a 3-byte Instance Number area, and a Material Number area indicated by 16 bytes. Yes.
[0044]
The Universal Label area stores codes for identifying digital data, and the details are standardized in SMPTE-298M. The Length Value area indicates the length of the UMID. Since the code length is different between Basic UMID and Extended UMID, it is indicated by 13h in the case of Basic UMID and 33h in the case of Extended UMID. The Instance Number area indicates whether the material data has been overwritten or edited. The Material Number area has three areas and stores a code for distinguishing material data.
[0045]
Time Snap indicated by 4 bytes indicates the number of snap clock samples per day. This indicates the creation time of the material data in units of clocks. The 8-byte Rnd (Random Number) is assigned a double number when an incorrect time is set, or when the network address of a device defined by, for example, the Institute of Electrical and Electronics Engineers (IEEE) changes. It is a random number to prevent it from being done.
[0046]
Extended UMID, on the other hand, is an 8-byte Time / Date Code that identifies the time and date when the material was generated, and correction (time difference information) related to the time when the material was generated, as well as latitude, longitude, and altitude. 12 bytes of Spatial Co-oredinates that define the location information to be defined, and the alphabetical code (Country) of bytes that define the country name 4 and the characters and symbols of the omitted alphabets, etc. Are composed of a 4-byte Alphnumeric Code (Organization) that defines the organization name and a 4-byte Alphnumeric Code (User) that defines the name of the user who created the material.
[0047]
The Basic UMID and Extended UMID described above do not include metadata indicating the video size, generation number, and the like. In particular, the Material Number does not indicate other information related to the material state or the material image. Metadata indicating the video size, generation number, etc. is transmitted based on the KLV format.
[0048]
Here, in the metadata dictionary, which is a dictionary definition that incorporates a universal label standardized in SMPTE298M, the following data element name metadata is specified.
[0049]
That is, as data element names corresponding to SMPTE labels, as shown as # 1 to # 33 in FIG. 8, class 1 ID, locator (IDENTIFIERS & LOCATORS), globally unique identifiers (Globally Unique Identifiers), and UMID video (UMID) Video), UMID Audio, UMID Data, UMID Data, UMID System, UMID System, International Broadcasting Organization IDs, Organization Identifiers, and Program ID (Programme Identifiers), UPID (UPID), UPN (UPN), Media ID (Physical Media identifiers), Tape ID (Tape Identifiers), EBU ID NO (IBTN), ISO ID (ISO Identifiers), ISO audio visual NO (ISAN), ISO book NO (ISBN), ISO serial NO (ISSN), ISO music Calwork Code (ISWC), ISO Printed Music NO (ISMN), ISO Commercial ID (ISCI), ISO Recording Code (ISRC), ISO Report NO (ISRN), ISO Glossary (ISBD), ISO Textual Work Code (ISTC), Digital Object ID (DOI), Compound ID (Compound IDs), Serial Item and Contribution ID (SICI), Book Item and Component ID (BICI), Audio Visual Item And component ID (AICI), distribution source ID (PII), object ID (Object identifiers), and Internet global unique ID (GUID).
[0050]
Further, as shown as # 34 to # 66 in FIG. 9 as data element names corresponding to SMPTE labels, SMPTE labels (GUID and SMPTE label identifiers), metadata object IDs (MobIDs), and object ID details (Definition object identifiers), object ID details (DefinitionObject_Identification), container version display (GenerationAUID), CNRI (CNRI Handles), device ID (Device Identifiers), device specification (Device Designation), and device creation (Device Make), device model (Device Model), device serial number (Device Serial Number), globally unique locators (Globally Unique Locators), unique resource IDs (UR locators (and "identifiers")) and , Unique resource locator (URL), unique resource locator (URL) and UNICO URL string (URLString), continuation URL (PURL), resource name (URN), media locators (Media locators), local ID (Local Identifiers), administrative ID (Administrative identifiers), and transmission ID (Transmission Identifier) ), Archive ID (Archive Identifier), item ID (Item ID), accounting reference NO (Accounting Reference), transmission charge (Traffic), physical media ID (Physical Media identifiers), and film codes (Film codes) ), Reel NO (Reel / Roll number), tape ID (Tape identifiers), tape NO (Tape number), object ID (Object identifiers), and local unique ID (LUID).
[0051]
Further, as data element names corresponding to the SMPTE labels, as shown as # 67 to # 99 in FIG. 10, a slot ID (SlotID), an object text ID (Object text identifiers), a group name (Mob_Name), Slot name (SlotName), object name (DefinitionObject_Name), local locator (Local Locators), local media locator (Local Media locators), local file path (Local File Path), film locator (Film Locators) and Edge Code, Edge Code, Frame Code, Key Code, Ink NO (Ink number), Segment Start Code (EdgeCode_Start), Proxy locators, Proxy Key text, proxy key frame (Key Frame), proxy key sound (Key Sound), and key data (Key data or program), handwriting (Free-form, human readable locator), handwritten name (TextLocator_Name), title (Titles), title kind (Title kind), subject (Main title), and subtitle (Secondary title) Series NO (Series number), Episode No (Episode Number), Scene NO (Scene number), Take NO (Take Number), Owner (Unique IPR Identifiers), and CISAC owner (IPI ( SUISA / CISAC)), the person in charge (Natural Person / legal entity), and the ID (AGICOA / MPAA) by AGICOA.
[0052]
Also, as data element names corresponding to SMPTE labels, as shown as # 100 to # 132 in FIG. 11, AGCOA ID (AGICOA / MPAA Identifier), class 2 management (ADMINISTRATION), supplier (Supplier), Source Company, Contract NO (Supply contract number), Original Producer Name, Product, Total number of Episodes in a Series, Rights (Rights ), Copyright, Copyright Status, Copyright Owner, Intellectual rights, Intellectual rights type (IP Type), IP Details of rights (IP Right), legal personalities (Legal personalities), owners (Rights Owner), management rights (Rights Management Authority), interested parties (owned parties) (IP Right options), Maximum Number Of Usages, License options, financial information, currency, payments and costing, royalty financial information, profit information, Royalty Financial Information, Permitted Access, Access Level (Restrictions on Use), Security, and Technical Access (System Access) are defined.
[0053]
Further, as shown as # 133 to # 165 in FIG. 12, the data element name corresponding to the SMPTE label includes a user name (Username), a user name (Username), a password (Password), and a password (Password). Film, film, scramble key type, scramble key kind, scramble key value, publication outlet, and broadcast channel Information (Broadcast), broadcaster (Broadcaster), name (Name), channel (Channel), transmission path (Transmission Medium), broadcast region (Broadcast Region), number of broadcasts (Broadcast and Repeat Statistics), 1st use (First Broadcast Flag), repeat number (Repeat number), current repeat number (Current repeat number), previous use number (Previous repeat number), rating (Ratings) and Audience rating, audience reach, other ratings, Participating parties, representatives (Persons (Groups and Individuals)), and contact person (Nature of Person (Group or individual)), talent, staff, etc. (Production), talent, staff, etc. (Contribution Status), cooperation and management (Support and Administration), and cooperation management staff (Support / Administration Status) Organization and Public Bodies, and Kind of Organization or Public Body are defined.
[0054]
Moreover, as shown as # 166 to # 198 in FIG. 13 as data element names corresponding to the SMPTE labels, production, film lab (Contribution Status), cooperation and management (Support and Administration), cooperation Administrative staff (Support / Administration Status), function (Job Function Information), function (Job Function), role (Role / Identity), information acquisition (Contact information), contact type (Contact kind), Contact Department, representative (Person or Organization Details), contact person (Person name), family name (Family name), first given name (First Given name) and second choice Second Given name, Third Given name, Group name, Main name, Main name, Supplementary name, Organization name ), The main name, and the complement Supplementary organization name, Class 3 interpreter (INTERPRETIVE), Fundamental information (Fundamental), Country name (Countries), ISO 3166 Country Code System (ISO 3166 Country Code System), ISO 3166 Country Code (ISO 3166) Country Code System), ISO Language Code, ISO Language Code, ISO Language Code, Interpretation Parameters, Operating System Interpretations, and Basic 4 Definitions (Fundamental Dimensions) ) And length (Length) are defined.
[0055]
In addition, as shown in FIG. 14 as # 199 to # 231, the data element name corresponding to the SMPTE label includes a length system (Length System), a length system (Length System), and a unit of length ( Length Units, Length Units, Time, Time system, Time system, Time Units, Time Units (Time Units) Time Units, Volume, Energy, Descriptive-Human Assigned, Categorisation, Content Classification, Type, Genre, (Genre), to (Target Audience), cataloging (Cataloguing and Indexing), audit catalog (Catalogue History), metadata status (Status of Data Set), metadata status (Status of Data Set) ) And the ID in use (Cataloguing, Indexing or T hesaurus system used), theme (Theme), genre (Genre), sub code (Subject Code), keywords (Keywords), key frames (Key Frames), key sounds (Key Sounds), and key data (Key data), character string characteristics (Textual Description), outline (Abstract), purpose (Purpose), and description (Description) are defined.
[0056]
As data element names corresponding to SMPTE labels, as shown as # 232 to # 264 in FIG. 15, color information (Color descriptor), format information (Format descriptor), hierarchy (Stratum), and type of hierarchy (Stratum kind), additional information (Supplemental Information), assessments (Assessments), Awards (Individual), programs (Programmes), quality parameters (Qualitative Values), and property values ( Asset Values, Content Value, Cultural Quality, Artistic Value, Historical Value, Technical Value, and other values (Other Values), descriptors (Descriptors (Machine Assigned or Computed)), categorization (Categorisation), content class (Content Classification), and cataloging (Cataloguing) and Indexing), audit catalog (Catalogue History), metadata status (Status of Data Set), cataloging (Cataloguing, Indexing or Thesaurus system used), keywords (Keywords), key frames (Key Frames) and , Key Sounds, Key data, Textual Description, Hierarchy (Stratum), Hierarchy kind (Stratum kind), Class 4 parameter (PARAMETRIC), Video encoding parameters (Video Essence Encoding Characteristics) are specified.
[0057]
In addition, as shown in FIG. 16 as # 265 to # 297 as data element names corresponding to the SMPTE label, video basic characteristics (Video Fundamental Characteristics), video source equipment (Video Source Device), and OE conversion system (Fundamental opto-electronic formulation), gamma information, gamma equation, gamma, luminance calculation (Luma equation), colorimetry code, scanning information ( Fundamental sequencing and scanning), component sequence (Signal Form Code), color frame index (Color Field Code), vertical rate (Vertical Rate), frame rate (Frame Rate), aspect ratio (Image dimensions) , Lines (Image lines), Total Lines per Frame and Active Lines / Frames per Frame), Rising (Leading Lines), Falling (Trailing Lines), Horizontal and Vertical dimensions, Aspect Ratio (Display Aspect Ratio), Image Aspect Ratio, Sensor Capture aspect ratio, saved height (Stored Height), saved width (StoredWidth), sample height (Sampled Height), sample width (Sampled Width), and sample X offset (Sampled X Offset) ), Sampled Y Offset, Display Height, Display Width, and Display X Offset are defined.
[0058]
As data element names corresponding to SMPTE labels, as shown as # 298 to # 330 in FIG. 17, display Y offset, video original signal characteristics (Video Coding Characteristics), and analog video characteristics ( Analogue Video System), Luminance Sample rate, Active Samples per Line, Total Samples per Line, and Bits Per Pixel ), Sampling Information, Sampling Hierarchy Code, Horizontal Subsampling, ColorSiting, Rounding Method Code, and Filtering Code ( Filtering Code), Sampling Structure, and Sampling Structure Co de), frame layout (FrameLayout), line field information (VideoLineMap), signal pseudonym (AlphaTransparency), component width (ComponentWidth), black reference level (BlackReferenceLevel), and white reference level (WhiteReferenceLevel), color dynamic range (ColorRange), order of color components (PixelLayout), color palette (Palette), palette layout (PaletteLayout), and the same number of data in the horizontal direction of the original signal (Is Uniform) The number of stores of adjacent bytes (Is Contiguous), JOEG table (JPEG Table ID), TIFF parameter (TIFFDescriptor_Summary), MPEG coding characteristics (MPEG Coding Characteristics), and MPEG-2 coding characteristics (MPEG-2 Coding characteristics) Characteristics, Field Frame Type Code, and Film parameters are specified. To have.
[0059]
As data element names corresponding to SMPTE labels, as shown by # 331 to # 363 in FIG. 18, film video characteristics (Film to Video parameters), field position priority (Field Dominance), and frame phase sequence (Framephase sequence), film pull-down characteristics, pull-down sequence, pull-down phase, pull-down type, pull-down direction, and pull-down direction. Phase Frame, Film Frame Rates, 24.00 fps (Capture Film Frame rate), 23.976 fps (Transfer Film Frame rate), special frame rate (FilmDescriptor_FrameRate), film Characteristics (Film characteristics), film aperture characteristics (Film capture aperture), Film Color Process, edge code format (CodeFormat), header text (Header), video and film test parameters (Video and Film test parameters), video test parameters (Video test parameters), Test parameter, Test Result (real), Test Result (integer), Film test Parameters, Test parameter parameter), test result (real), test result (integer), storage alignment (Video digital storage alignment), and buffer size at frame store (Image Alignment Factor), leading byte (Client Fill Start), trailing byte (Client Fill End), padding bits (Padding Bits), and audio signal equipment characteristics (Audio Essence Encoding Characteristics) are defined.
[0060]
Further, as shown as # 364 to # 396 in FIG. 19 as data element names corresponding to the SMPTE label, basic audio characteristics (Audio Fundamental Characteristics), audio source equipment (Audio Source Device), and basic audio control (Fundemental audio formulation), audio channel classification (Electro-spatial formulation), audio filtering characteristics (Filtering applied), audio reference level (Audio reference level), and number of audio mixing channels (Number of audio channels) in mix), number of mono channels (Mono channels), number of stereo channels (Stereo channels), number of tracks (Physical Track Number), audio from film (Film sound source), optical recording (Optical track) ), Magnetic recording, and analog audio characteristics (Analogue Audio Codin g Characteristics), analog system, audio sampling characteristics (Sample Audio), sample rate, clock frequency (Reference clock frequency), and bits per sample (Bits per Sample, rounding law, dither, audio coding characteristics (Digital Audio Coding Characteristics), coding type (Coding Law), number of layers (Layer number), and average bit rate ( Average Bit rate), Fixed bitrate, Audio test parameters, SNR (Signal to noise ratio), Weighting, Audio summary information, AIFC Format summary (AIFCDescriptor_Summary), WAVE format summary (WAVEDescriptor_Summary), Down coding method (Data Essence Encoding Characteristics) are defined.
[0061]
In addition, as data element names corresponding to SMPTE labels, as shown as # 397 to # 429 in FIG. 20, basic characteristics (Data Essence Fundamental Characteristics), information of original original signals (Analogue Data Essence Coding Characteristics), analog Data coding (Analogue Data Coding), digital coding characteristics (Digital Data Coding Characteristics), original record data (Data test parameters), metadata equipment characteristics (Metadata Encoding Characteristics), and metadata fundamental characteristics (Metadata Fundamental) Characteristics), timecode characteristics (Timecode Characteristics), timecode type (Timecode Kind), timecode type (Timecode Kind), drop frame (Drop), LTC / VITC (Source Type), Timecode timebase, frame / second (FPS), and user bit N / OFF (Timecode User bits flag), start address (Start), timecode sample rate (TimecodeStream_Sample Rate), timecode data itself (Source), timecode with sync signal (IncludeSync), analog meta Data information (Analogue Metadata Coding Characteristics), analog metadata carrier (Analogue Metadata Carrier), digital metadata information (Digital Metadata Coding Characteristics), digital metadata carrier (Digital Metadata Carrier), and metadata test characteristics (Metadata test parameters), equipment characteristics (System & Control Encoding Characteristics), metadata basic characteristics (System & Control Fundamental Characteristics), original analog signal information (Analogue System & Control Coding Characteristics), and analog systems (Analogue System & Control Coding), original digital signal information (Digital System Coding Characteristics), and digital And Rumetadeta information (Digital System Metadata Sampling Characteristics), and characteristics of metadata of the original signal (System Metadata test parameters), the general encoding characteristics (General Encoding Characteristics) are defined.
[0062]
As data element names corresponding to the SMPTE labels, as shown as # 430 to # 462 in FIG. 21, the general essence encoding characteristics, the sample rate, the length, and the length , Container encoding characteristics, Byte Order, Storage Medium parameters, Tape cartridge format, Videotape gauge and format, Tape size (FormFactor), signal format (VideoSignal), tape format (TapeFormat), recording time (Length), tape production company (TapeDescriptor_ManufacturerID), tape product number (Model), disc recorder equipment information (Disc recorder) parameters), disc kind and format, and film material (Film Medium Parameters), manufacturer name (Film stock manufacturer), product number (Film Stock type), perforation information (PerforationsPerFrame), film type (FilmKind), film format (FilmFormat), film Aspect ratio (FilmAspectRatio), manufacturer (Manufacturer), part number (Model), film gauge (Film gauge and format), (Object Characteristics (Placeholder)), equipment characteristics (Device Characteristics), camera Characteristics (Camera Characteristics), optical characteristics (Optical Characteristics), depth of focus (Focal Length), CCD size (Sensor Size), and lens (Lens Aperture) are defined.
[0063]
Also, as the data element names corresponding to the SMPTE label, as shown as # 463 to # 495 in FIG. 22, the original signal CCD size (Sensor Type Code), field of view (Field of View), special lens (Anamorphic lens) characteristic, Optical Test parameters, Sensor Characteristics, Flare, Microphone Characteristics, Sensor type, and Polar characteristic ), Image Characteristics, Image Category, Class 5 Production Process (PROCESS), Process Status Flag (Process indicators), Basic Information (Fundamental), Shot, Clip, Segment Display (Integration Indication), replication performance (Quality Flag), purpose of replication (Physical Instance Category), recording (Capture), and original recording Log / digital (Digital or analogue origination), microphone placement (Microphone Placement techniques), dubbing information (Manipulation), number of changes (Simple Flagging), number of copies (Copy Number), number of clones (Clone number) A work in progress flag, a digital or analogue mix, a payload compression history (Downstream Processing History), a video payload compression history (Video Compression History), and a video compression method. (Video Compression Algorithm), compression history data set (MPEG-2 dynamic coding historical dataset), noise reduction algorithm (Video Noise Reduction Algorithm), and compression are specified.
[0064]
As data element names corresponding to SMPTE labels, as shown as # 495 to # 528 in FIG. 23, an audio compression history, an audio compression algorithm, and audio compression history data ( MPEG-2 Audio dynamic coding history), Noise Reduction Algorithm, Data Compression History, Metadata Compression History, MPEG Processing, , Splicing metadata, enhancement or modification, video processing, enhancement or modification description, and equipment specification (Video processor settings) (Device-specific)), device type, and device parameter ), Device parameter setting, Audio Processing, Description of enhancement (Enhancement or Modification Description), Audio processor settings (Device-specific), Device type, device parameter, device parameter setting, data modification, data processing, enhancement or modification description, device (Data processor settings (Device-specific)), device type (Device kind), device parameters (Device parameter), device set (Device parameter setting), editing information (Editing Information), Editing version information (Editing version information)
The file format version (Version), editing details (Editing decisions), changes (RelativeScope), and change slots (RelativeSlot) are specified.
[0065]
Further, as shown as # 529 to # 561 in FIG. 24 as data element names corresponding to the SMPTE labels, the original signal group (SourceMobSlotID), the default of the fade information (DefFadeType), and the editing matte information (Editing matte information) Editing mat information (HotSpotRect), editing event information (Editing event information), comments (Event_Comment), event ON / OFF information (ActiveState), editing effect information (Editing effect information), audio Fade-in type (FadeInType), audio fade-out type (FadeOutType), control point (ControlPoint_Value), constant value (ConstantValue_Value), hint (EditHint), transient information (IsTimeWarp), category information (Category) And the number of input segments (NumberInputs), bypass information (Bypass), and editing eb information (Editing web information), start (BeginAnchor), end (EndAnchor), editing note (Editing user notes), tag information (TaggedValue_Name), value information (TaggedValue_Value), and information between class 6 data ( RELATIONAL), Relationships, Relations, Relationships, Essence to Essence, Source Material, UMID (Source Material UMID), Source Material, The last edit text (Most Recent Edit text) and the last UMID (Most recent edit UMID) are defined.
[0066]
Also, as data element names corresponding to the SMPTE labels, as shown as # 562 to # 594 in FIG. 25, essence-related metadata (Metadata to Essence), metadata mutual (Metadata to Metadata), and object mutual (Object to Object), metadata about the object (Metadata to Object), production material (Related production material), support material (Program support material), advertising material (Programme advertising material), Relationship with CM (Programme commercial material), countdown information (Numerical sequence), countdown (Numerical position in sequence), offset information (Relative position in sequence (value)), preview, next information (Relative position in sequence) (descriptive)), preview, next information (Relative position in sequence (descriptive)), and structural Relationship structures, Containing relations, Contents one (Contains one), Still image (Still Frame), Hot Spot Matte, Annotation, Translation Rendering, Retrieval (InputSegment), Extraction (Selected), Transition effect (Operation Group), Web address (Manufacturer Info), Content group (Content), Content description (Dictionary) Essence Description, Segment Description, Contains set, Parameters, Parameters, Alternates, Group, and Essence Data ( Essence Data) is specified.
[0067]
As data element names corresponding to SMPTE labels, as shown by # 595 to # 627 in FIG. 26, properties (Properties), locators (Classators), class definitions (Class Definitions), and type definitions. Type Definitions, Operating Definitions, Parameter Definitions, Data Definitions, Plugin Descriptors, Codec Descriptions Definitions, Container Definitions, Interpolation Definitions, User Comments, Contains ordered set, Different Format Specifications (Choices), and Input Segments ), Nesting information (NestedScope_Slots), components (Components), Locator, ID List (Identification List), Group Slot (Mob_Slots), Point Value (PointList), Data Contains Stream (Data), Data (Data), ID (Sample Index, Weak reference relation, Weak reference to one object, Generation, Data Description, Operation Definition, and Source ID (SourceID), effect type (Control Point_Type), edited ID (Operation Definition_DataDefinition), and control type (Parameter Definition_Type) are defined.
[0068]
As data element names corresponding to SMPTE labels, as shown as # 628 to # 660 in FIG. 27, a property (Property Definition_Type), a category (Category Class), a file descriptor (FileDescriptor Class), and a group name ( MobID), Container Format, Parameter Description (Definition), Parameter Type (Parameter_Type), Interpolation, Data Type (TaggedValue_Type), and Strong Association of Objects (Type Definition Strong Object Reference_Referenced) Class, weak association of objects (Type Definition Weak Object Reference_Referenced Class), underline element type (Type Definition Enumeration_Element Type), variable array element type (Type Definition FixedArray_Element Type), and fixed array element type ( Type Definition Variable Arra y_Element Type), element type description (Type Definition Set_Element Type), string element (Type Definition String_Element Type), stream element (Type Definition Stream_Element Type), rename (Renamed Type), and set of weak reference (Set of weak references), plugin descriptors (Plugin Descriptors), parameters (ParametersDefined), data descriptions (Data Definitions), order of weak references (Ordered set of weak references), performance degradation (Degrade To), Member Types, Class relations, Parent class, Parent Class, Child class, and Instance of class , Object class, metadata object definitions, and class definition It has been.
[0069]
In addition, as data element names corresponding to SMPTE labels, as shown as # 661 to # 693 in FIG. 28, property (Property definition), hint (Is Searchable), required / optional (Is Optional), and default condition (Default Value), local ID (Local Identification), type description (Type definition), size (Size), specified size (Is Signed), element name (TypeDefinitionEnumeration_ElementNames), element name (Type Definition Enumeration_Element Values, number of arrays (Element Count), member names (Member Names), extended names (Type Definition Extendible Enumeration_Element Names), extended names (Type Definition Extendible Enumeration_Element Values), and execution descriptions (Instance descriptions) , Description, Container definitions, Essence Is Identified, Code object (Related code objects), Plug-in code object (Relations to plugin code objects), Name (Name), Plug-in (Plugin Descriptor_Identification), Description (Description), Version number (Version Number), Version series, manufacturer (Manufacturer), manufacturer ID (Manufacturer ID), platform (Platform), platform version (Min Platform Version), platform OS version (Max Platform Version), A plug-in engine (Engine), a mini engine version (MinEngine Version), and a max engine version (MaxEngine Version) are defined.
[0070]
As data element names corresponding to the SMPTE label, as shown as # 694 to # 726 in FIG. 29, an API plug-in (Plugin API), an API mini-plug-in (Min Plugin API), and an API max. Plug-in (Max Plugin API), software (Software Only), accelerator (Accelerator), verification (Authentication), relations of application code (Relations to application code objects), company name (Company Name), Production Name (Product Name), Production Number (Product ID), Production Version (Product Version), Production Version Series (Product Version String), Toolkit Version (Toolkit Version), Platform (Platform), Class 7 space-time (SPATIO-TEMPORAL), position and space vectors (Position and Space Vectors), image guidance system (Image Coordinate System), and map origin (Ma p Datum Used), Absolute Position, Local Datum Absolute Position, Local Datum Absolute Position Accuracy (m), Device Absolute Position, Device Absolute Positional Accuracy (m), Device Code (Device Altitude (m)), Device Code (Device Altitude (metres, concise)), and Device Latitude (degrees) The latitude of the equipment (Device Latitude (degrees, concise)), the longitude of the equipment (Device Longitude (degrees)), the longitude of the equipment (Device Longitude (degrees, concise)), and the size of the equipment (X) Device X Dimension (m)), equipment size (Y) (Device Y Dimension (m)), subject absolute position (Subject Absolute Position), and frame position accuracy (Frame Positional Accuracy (m)) are specified. Has been.
[0071]
As data element names corresponding to the SMPTE labels, as shown as # 727 to # 759 in FIG. 30, the frame center latitude (Frame Center Latitude (degrees)) and the frame center latitude (Frame Center Latitude (degrees, concise)) ), Frame Center Longitude (degrees), Frame Center Longitude (degrees, concise), Frame Center Lat-Long, and Relative Position ), Local reference of relative position (Local Datum Relative Position), accuracy of local reference of relative position (Local Datum Relative Position Accuracy), relative position of equipment (Device Relative Position), and accuracy of relative position of equipment ( Device Relative Positional Accuracy), Relative Position of Device (X) (Device Relative Position X (metres)), Relative Position of Device (Y) (Device Relative Position Y (metres)) Relative Position (Z) (Device Relative Position Z (metres)), Subject Relative Position (Subject Relative Position), Subject Relative Positional Accuracy (metres)), Image Positional Information X position from the image (Position within viewed image y coordinate (pixels)), y position from the image (Position within viewed image y coordinate (pixels)), and the source image center (x pixel) (Source image center x coordinate (pixels)), source image center (y pixel), and viewport image center x coordinate (pixel (y pixel) s) ), Viewport image center y coordinate (pixels), Rate and Direction of Positional Change, Device Position Change Speed and Direction (Device Rate) and Direction of Positional Change) Absolute device rate and direction of positional change, device movement speed (Device Absolute Speed (metres / sec)), device direction (Device Absolute Heading (degrees)), device Relative Device Rate and Direction of Positional Change, Device Relative Speed (metres / sec), and Device Relative Heading (degrees )), The subject's position change speed and direction (Subject Rate and Direction of Positional Change), the subject's absolute position change speed and direction (Absolute Subject Rate and Direction of Positional Change), and the subject's absolute speed. (Subject Absolute Speed (metres / sec)) is specified.
[0072]
As the data element names corresponding to the SMPTE labels, as shown as # 760 to # 792 in FIG. 31, the absolute direction of the target (Subject Absolute Heading (degrees)) and the relative speed and direction of the position change of the target (Relative Subject Rate and Direction of Positional Change), subject relative speed (Subject Relative Speed (metres / sec)), subject relative orientation (Subject Relative Heading (degrees)), angle information (Angular Specifications), Device angles, Sensor Roll Angle (degrees), Angle to North (degrees), Obliquity Angle (degrees), and target Angles (Subject angles (degrees)), distance measurements (Device to Subject distance), angles (Slant Range (metres)), distances (Dimensions) , Subject Dimensions, Target Width, Sense location (Studio and Location Dimensions), object dimensions (Media Dimensions), object length (Physical Media length (metres)), image dimensions (Image Dimensions), image panning and scanning Pan and scan image dimensions, Viewport height, Viewport width, Abstract Locations, Place names and , Gazetteer used, Place Keyword, Country Codes, Described Country Code, Country code of shoot, Country code of Setting (Characterised Place), country code of copyright (Country code of Copyright License), and country code of intellectual property (Country code of IP License) ing.
[0073]
In addition, as shown as # 763 to # 825 in FIG. 32, as the data element name corresponding to the SMPTE label, the region name (Regions) in the country, the region name (Region of Object) to be drawn, and the region name of the shooting (Region of shoot), setting region code (Region of Setting (Characterised Place)), copyrighted region code (Region or area of Copyright License), and intellectual property right region code (Region or area) of IP License, Postal Address, Room Number, Street Number or Building name, Street Name, Postal Town, City Name, State (State or Province or County), Postal Code, Country, Country, Setting Address (Characterised Place), and Setting Room Number (Setting room number) and the setting lot number or Setting Street Number or Building name, Setting Street, Setting Town, Setting City, Setting State or Province or County, Setting Postal Code, Setting Country, Setting Description, Setting Description, Electronic Address, Telephone number (Telephone number), FAX number (Fax number), e-mail address (e-mail address), date and time information (Date and Time), date and time (Material Date and Time) related to itself are specified Has been.
[0074]
As data element names corresponding to the SMPTE labels, as shown as # 826 to # 858 in FIG. 33, the operation date and time (Operational Date-Time Stamps), the production date and time (Creation Date-Time stamp), and the production date and time (Creation Date-Time stamp), Last modified Date-Time stamp, Last modified Date-Time stamp, Date and time (User defined Date-Time stamp) Appropriate date and time (User defined Date-Time stamp), absolute date and time (Absolute Date and Time), production start date and time (Start Date Time), production end date and time (End Date Time), segment start date and time (Segment Start Date and Time, Segment End Date and Time, Relative Date and Time, Media Start Date Time, and Media End Date Time , Segment Start Date and Time, and Segment Segment End Date and Time, Time Interval (Material Durations), Absolute Time Interval (Absolute Durations), Content Duration (Time Duration), and Segment Duration (Segment Duration) ), Frame Count, Segment frame count, Textless black duration, Relative Durations, Relative Durations, and Segment Duration. Segment duration, film frame interval (Frame Count), segment frame interval (Segment frame count), rights date and time (Rights Date and Time), copyright date and time (Copyright Date and Time) ), IP rights date and time (IP Rights Date and Times), and license start date (License start date and time).
[0075]
In addition, as shown as # 859 to # 891 in FIG. 34 as data element names corresponding to SMPTE labels, option start date and time (Option start date and time), license end date and time (License end date and time) and Option end date and time, Rights Durations, Copyright Durations, Intellectual Property Rights (IP Rights Durations), and License Duration ( License duration), optional duration (Option duration), cataloging date and time (Cataloguing Date and Time), creation date and time (Creation Date and Time), last modified date (Last Modified), and event date and time (Event Date and Time) time, absolute date and time of the event (Absolute Date and Time), event start date and time (Absolute start times), project start date and time (Project Mission Start Date and Time), and scene start date and time (Scene Start Date and Time) Time, shooting start date and time (Shot Start Date and Time), broadcast start date and time (Broadcast Start Date and Time), absolute end times (Absolute end times), and project end date and time (Project Mission End Date and Time) ), Scene End Date and Time, Recording End Date and Time, Broadcast End Date and Time, Relative Date and Time Relative start times, Relative start times of the project, Project Mission Start Date and Time, Relative start date of the scene (Scene Start Date and Time), and Relative start date of the recording (Shot Start Date and Time, relative start date and time of broadcast (Broadcast Start and Time), relative end time and date (Relative end Times), relative end date and time of project (Project Mission End Date and Time), and relative end date and time of scene (Scene End Date and Time) and relative end date and time of recording (Shot End Date and Time) is specified.
[0076]
Also, as data element names corresponding to SMPTE labels, as shown as # 892 to # 924 in FIG. 35, the relative end date and time (Broadcast End Time) of the broadcast, event duration information (Event Durations), and absolute duration information (Absolute Durations), the absolute duration of the event (Time Duration), the relative duration (Relative Durations), the relative duration of the event (Time Duration), the editing date and time (Editing Date and Time), and the editing length (Length) Edit position (Position), start relative time (StartTime), audio fade-in length (FadeInLength), audio fade-out length (Fade Out Length), cut point standard (Cut Point), Time standard (Time), last modified date (Last Modified), final edited result ID (LastModified), final production date (Creation Time), default standard for audio soft cut (Default Fade Length), fade Inn's default Standard (Def Fade Edit Unit), event time unit standard (Event Mob Slot_Edit Rate), slot time unit standard (Timeline Mob Slot_EditRate), last modification date (Identification_Date), and slot origin (Origin ), Process Date and Time, Technical Modification Date and Time, Simple Modification Date and Time, Broadcast Date and Time, Disposition date and time, Setting Date and Time (Characterised Time Period), Keyword validity period (Time period Keyword Thesaurus), Keyword period unit (Time period Keyword), A delay period (Delay) and encoding / decoding information (Encoding / Decoding) are defined.
[0077]
As data element names corresponding to the SMPTE labels, as shown as # 925 to # 940 in FIG. 36, an encoding delay time (Encoding Delay), a decoding delay time (Decoding Delay), and a buffer delay time (Buffer Delay). ), Simultaneity information (Latency), temporary information (Temporal shape (Shuttering etc) [PLACEHOLDERS]), shutter characteristics (Shutter characteristics [placeholder]), shutter speed (Shutter speed [placeholder]), Shutter opening characteristics (Shutter Gating [placeholder]), class 14 user data (USER ORGANIZATION REGISTERED), shared registration metadata (Publicly registered user organization metadata), private metadata (Privately registered user organization metadata), Department of Defense metadata (DoD Metadata), UAV metadata (UAV Metadata), RQ1A metadata (RQ1A Metadata), and RQ1 A closed caption metadata (RQ1A Closed Caption Set) and class 15 experimental metadata (EXPERIMENTAL METADATA) are defined.
[0078]
In the program creation / distribution system 100, the essence data and the metadata are converted into the MXF file format when transmitted on the Gigabit Ethernet 1. For example, a video essence recorded on one recording medium may become one MXF file, or one MXF file may be created from one video program, and the unit of the essence is an application. It can be set freely according to.
[0079]
As shown in FIG. 37, the metadata MXF file 200 includes a preamble section 201 for describing metadata, a body 202 for describing essence data, an index section 203 including an index table, a post And an amble unit 204.
[0080]
The preamble section 201 includes a universal label 205, an allocation table 206, and an overall metadata area 207. The universal label 205 of the MXF file 200 has the same syntax structure as the universal label of KLV coding. The allocation table 206 is a table in which the allocation information of each object in the overall metadata area 207 is registered.
[0081]
The overall metadata area 207 is an area in which metadata registered in a metadata dictionary, which is a dictionary rule that incorporates a universal label standardized in SMPTE 298M as a key, is described. The Header_Object 210 is a root object and is an object for indicating each object in the overall metadata area 207. Specifically, Identification_Object 211, Master_Metadata_O0bject 212, Source_Metadata_0bject 213, and Essence_Data_Object 214 are provided in the node of Header_Object 210. Since the master essence is composed of a plurality of types of source essences, in this overall metadata area 207, the metadata regarding the master essence and the metadata regarding the source essence are expressed by different objects.
[0082]
Master_Metadata_Object 212 is an object including metadata for explaining the properties of each essence included in the MXF file 200 and a pointer for pointing to Master_Timeline_Track_Objects 215. The Master_Timeline_Track_Objects 215 is an object for defining and explaining tracks constituting the essence included in the XMF file 200 and pointing to the Master_Clip_Object 216. The track mentioned here is a unit set for each type of essence such as video and audio, and the clip is an editing clip defined by the in and out points when editing the essence. However, the unit is different from the scene. Master_Clip_Object 216 is an object that includes metadata indicating which source material is used, and includes a pointer that points to Source_Metadat_Object 213.
[0083]
Source_Metada_Object 213 is an object provided for each source essence constituting the master essence, and is an object that includes metadata about the source essence and a pointer indicating Source_Timeline_Track_Object 217. Source_Timeline_Track_0bject 217 is an object set for each track of each source essence, and includes metadata about each track and a pointer for pointing to Source_Clip_Object 218. The source_Clip_Object 218 is an object set for each clip included in each track constituting each source essence, and has metadata regarding the clip and a pointer for pointing to the Essence_Clip 219. Accordingly, Source_Clip_Object 218 is set as many as Essence_Clip 219. Essence_Clip 19 is an object that includes data of a clip constituting the essence.
[0084]
In the program creation / distribution system 100, program creation / distribution processing is performed according to the workflow shown in FIGS.
[0085]
That is, in the workflow of the program creation / distribution system 100, the pre-photographing stage (Pri-Production) process executed by the distribution program organizing system 10 is shown as a program planning process PLN. Acquisition processing ACQ is performed by the acquisition system 60 in accordance with the program creation plan prepared by, and further, material accumulation (Ingest) processing ING, editing processing EDT, CG generation (CG Creation) by the production system 20 The distribution program is created by performing the processing CGC and the audio creation processing AUC, and the created distribution program is stored by the program distribution system 50 by the program distribution processing DST and the archive system 40. ) Processing ARV is performed
[0086]
In the program creation / distribution system 100, asset management is realized by generating metadata indicating various information for each project, each medium, each scene, or each frame, and controlling the archive system 40 according to the metadata.
[0087]
The metadata generated for each project includes the subject (Main Title), subtitle (Secondary Tilte (Sub Title)), series (Senes Number), episode (Epsode), original (Original (Bock / Title)), author There is metadata indicating various information such as (Original Author / Writer), Director (Director), Rights (Rghit) and Copyright (Copyrigt).
[0088]
Further, as metadata generated for each medium, there is metadata indicating various kinds of information such as a reel (roll) number (Real Number (Roll Number) and a frame rate).
[0089]
Also, the metadata generated for each scene includes cast actors (Cast Actrot / Actoress), elements (Element), dialogue (Screen Play), scene details (Scene Description), props (Set), props (Properties) , Unit / Crew / Staff, Camera Setup Data, Lighting Info, Video Format, Audio Format, Audio Channel Assignment (Audio Channel Assiginment, Motion Capture Data, Comment, Comment, Telecine Data, Soundtrack (Music) Composer, Song Writer, Arranger ), Compositing information (Compositing Info), visual effects (Visual Effects), sound effects (Sound Effects), V-Chip information (V-Chip Info), generation (Generation (Numb er of Copy)).
[0090]
The metadata generated for each frame includes scene number, shot number, take number, OK shot / NG shot, UMID (video) ( UMID for video essence), UMID (audio) (UMID for audio essence), UMID (data) (UMID for data essence), UMID (others) (UMID for others), place (Place), GPS latitude (GPS Latitude), GPS longitude (GPS Longtude), GPS height (GPS Altitude), camera ID (Camera ID), camera lens (Camera Lenz Data), lens ID (Lenz ID), focus (Focus), zoom (Zoom), iris (Iris ), Tripod angle information (Tripod), tripod ID (Head ID), pan (Pan), tilt (Tilt), roll (Roll), dolly position information (Dolly), dolly ID (Dolly ID), arm height (Arm Various information such as Height, Position (Travel) and Closed Caption There are metadata indicating the.
[0091]
In the pre-shooting stage (Pri-Production) executed by the distribution program organization system 10, the planning process PP1, the casting process PP2, the storyboard process PP3, and the screen play process PP4. A location hunting process PP5, a scheduling process PP6, and the like are performed.
[0092]
At the stage of the planning process PP1 for examining the contents of the program, the main title, subtitle (Secondary Tilte (Sub Title)), series (Senes Number), episode (Epsode), original (Original (Bock / Title) ), Author (Original Author / Writer), Director (Director), Element (Element), Comment (Comment), Soundtrack (Music) Composer (Composer), Songwriter (Song Writer), Arranger ( Metadata indicating various types of information such as Arranger, right (Rghit), copyright (Copyrigt), and V-Chip information (V-Chip Info) is generated. Also, in the stage of the casting process PP2 for determining performers, metadata indicating various information such as casts (Cast Actrot / Actoress) and units / crew / staff (Unit / Crew / Staff) is generated. At the stage of the PP3 storyboard process that examines the contents of the program, the scene number (Scne Number), shot number (Shot Number), tool (Set), tool (Properties), video format (Video Format), frame rate ( Metadata indicating various information such as (Frame rate), audio format (Audio Format), and audio channel assignment (Audio Channel Assiginment) is generated. At the stage of the screen play process PP4 for confirming the dialogue, metadata indicating various information such as dialogue (Screen Play), scene details (Scene Description), place (Place), closed caption (Closed Caption) is generated. .
[0093]
Main title, subtitle (Secondary Tilte (Sub Title)), series (Senes Number), episode (Epsode), original (Original (Bock / Title)), author (Original Author / Writer) and director (Director) ) And the like are generated after the project and used for the casting process PP2, storyboard process PP3, screen play process PP4, location hunting process PP5 and scheduling process PP6, and recorded by the acquisition system 60. The process ACQ, the authoring process by the production system 20, the program distribution process DST by the program distribution system 50, and the program archive process ARV by the archive system 40 are used.
[0094]
Various metadata generated in the pre-shooting stage by the distribution program organization system 10 is transmitted to the archive system 40 via the Gigabit Ethernet 1 and stored in the petasite 40B of the archive system 40. The production system 20, the news system 30, the archive system 40, the program distribution system 50, and the acquisition system 60 can be fetched via the Gigabit Ethernet 1 according to various metadata stored in the petasite 40B of the archive system 40 as required. .
[0095]
Note that various metadata generated in the pre-shooting stage may be changed and rewritten in various processing stages to be described later.
[0096]
The acquisition system 60 captures metadata necessary for the recording device, that is, the imaging device, and executes the recording process ACQ.
[0097]
In the recording process ACQ executed by the acquisition system 60, the reel (roll) number (Real Number (Roll Number), scene number (Scene Number), take number (Take Number), OK shot / NG shot (OK shot / NG shot) ), UMID (video) (UMID for video essence), UMID (audio) (UMID for data essence), UMID (data) (UMID for data essence), UMID (others) (UMID for others), camera setup data (Camera Setup Data), camera ID (Camera ID), camera lens (Camera Lenz Data), lens ID (Lenz ID), focus (Focus), zoom (Zoom), iris (Iris), tripod angle information (Tripod), tripod ID Various information such as (Head ID), Pan (Pan), Tilt (Tilt), Roll (Roll), Dolly position information (Dolly), Dolly ID (Dolly ID), Arm height (Arm Height) and Position (Travel) Is generated.
[0098]
Various metadata generated in the recording process stage by the acquisition system 60 is supplied to the production system 20 together with video information and audio information obtained by recording.
[0099]
In the production system 20, ingesting processing PR1, telecine processing PR2, dupe processing PR3, coarse editing (Off-line Edit processing) PR4, full editing processing PR5, voice over ( A voice over process PR6, a sound effect process PR7, a voice sweetening process PR8, a CG generation process CG9 and a finishing process PR10 are performed.
[0100]
In the ingesting process PR1 in the production system 20, various metadata generated in the recording process stage by the acquisition system 60 are stored together with video information and audio information. In the telecine process PR2, video information and audio information recorded on the film obtained by the acquisition system 60 is converted into a television signal. In the coarse editing (Off-line Edit) process PR4, the video data and the audio data (material data) are edited based on the information about the material added as metadata, and the meta data based on the editing result. An EDL (Editing Decision List) that is data is created. Here, the editing result indicates information relating to the editing point in which the IN point and OUT point on the recording medium are represented by a Reel Number or a time code. In the stage of the complete editing process PR5, the materials accumulated by the ingesting process PR1 and the telecine process PR2 are roughly edited (Off-line) based on the contents determined at the time of planning. Edit) This editing is performed using the EDL created by the process PR4. Further, in the finishing process PR9, the distribution program is completed by using the video data and audio data that have been subjected to the main editing by the above-mentioned complete editing process PR5 and the audio material that has undergone the voice over process PR6. To do. At this time, a CG image created by a CG creation process (CG Creation) or a material stored in the archive system 40 may be used.
[0101]
In the program distribution system 50, an authoring process for distributing the distribution program completed by the finishing process PR9 as a package cage medium, and the distribution program is distributed via a wireless network or a wired network. Perform the distribution process.
[0102]
In the program creation / distribution system 100 having such a configuration, for example, the subject matter at the stage of the planning process PP1 and the casting process PP2 in the pre-photographing stage (Pri-Production) executed by the distribution program organization system 10 is performed. (Main Title), Subtitle (Secondary Tilte (Sub Title)), Series (Senes Number), Episode (Epsode), Original (Original (Bock / Title)), Author (Original Author / Writer), Director (Director), The metadata such as the composer, composer, song writer, and arranger of the soundtrack (SoundTrack (Music)) is input by a computer or a portable terminal, and the input metadata is input by the above acquisition system 60. A stage of the off-line edit process PR4 in the production system 20 by supplying the production system 20 with the video information and audio information obtained by recording. In this case, it is possible to specify the timing of the stuff roll and automatically generate a character according to the metadata included with the video information and audio information in accordance with the specified timing, and perform the complete editing process PR5. .
[0103]
In this program creation / distribution system 100, the archive system 40 constructs a database for centrally managing metadata together with the essence of video data, audio data, etc., and the distribution program organization system 10 performs planning processing PP1 and casting ( Casting) When the metadata input at the stage of PP2 is registered in the database centrally managed by the archive manager 40A of the archive system 40, a tag indicating the registered metadata is issued, and this tag is the acquisition. It is bundled with video information and audio information obtained by recording by the system 60. In the production system 20, the timing at which the staff roll is flown at the stage of the coarse editing (Off-line Edit) process PR 4 in the production system 20 is specified, and the tag bundled with the video information and the audio information is pointed according to the specified timing. Metadata is extracted from the database to be processed, characters corresponding to this are automatically generated, and the complete editing process PR5 can be performed.
[0104]
That is, in the program creation / distribution system 100, a support system for automatically generating a staff roll character using metadata can be constructed.
[0105]
In the program creation / distribution system 100, GPS data indicating the recording location, position, and time is input as metadata by, for example, GPS (Grobal Positioning System) at the stage of acquisition (ACQ) by the acquisition system 60. The input metadata is bundled with video information and audio information obtained by recording by the acquisition system 60 and supplied to the production system 20, thereby performing a rough editing (Off-line Edit) process in the production system 20. In the PR4 stage, the editor can perform time distribution of programs without being aware of the existence of GPS data. Further, in the stage of CG creation (CG creation) processing PR9, a search is performed from a database showing a map prepared separately by using tag data representing a position and time bundled with video information and audio information. A map graphic is output, and a program using the map graphic can be completed by a complete editing process PR5.
[0106]
Also in this case, as in the case of automatically generating the character, CG generation (CG) is performed by registering metadata indicating the position and time in a database centrally managed by the archive manager 40A of the archive system 40. Creation) process PR9 can also be supported.
[0107]
That is, in this program creation / distribution system 100, it is possible to construct a support system for performing CG generation by matching the GPS data with the map data using metadata.
[0108]
Here, when content is created using a VTR, a large amount of material video tape is generated during recording. For example, in the case of producing a 30-minute document, usually about 50 to 100 material tapes are generated, and a content is created by selecting a necessary cut from these and joining them together.
[0109]
Therefore, in this program creation / distribution system 100, UMID for video essence (UMID for video essence) and UMID reminiscent of the content recorded in the material tape at the stage of the acquisition (ACQ) processing by the acquisition system 60. (UMID for audio essence), UMID (data) (UMID for data essence), UMID (others) (UMID for others), reel (roll) number (Real Number (Roll Number), tape ID (Tape ID) , Tape ID Number, Object ID, Object Title, Main Title, Subtitle (Secondary Tilte (Sub Title)), Series (Senes Number), Episode (Epsode), Essence Metadata (Metadata to Essence) ), Locators, Essence Description, etc., metadata is recorded together with video and audio information. The system 20 reads out the metadata at the time of playback, and can quickly search for a necessary cut from the material tape using the read metadata as a clue. The metadata of items to be associated is bundled with video information and audio information and recorded in synchronization with video frames, recorded on electronic labels on individual video tapes, or from several tens to several hundreds Are recorded on an external storage medium that can be managed and managed together.
[0110]
That is, in the program creation / distribution system 100, it is possible to construct a support system that saves the tape screening work by using metadata.
[0111]
Further, in the program creation / distribution system 100, in the telecine processing PR2 executed in the production system 20, the vertical rate, the frame rate, the total number of lines / frame (Total Lines per Frame) ), Active Lines per Frame, Aspect Ratio (Display Aspect Ratio), Image Aspect Ratio (ImageAspectRatio), Storage Height (Stored Height), Storage Width (Stored Width), and Sample Height (Sampled) Height, sample width (Sampled Width), sample X offset (SampledX Offset), sample Y offset (SampledY Offset), display height (Display Height), display width (Display Width), display X offset (DisplayX Offset) And metadata of items related to telecine, such as video signal characteristics (Video Coding Characteristics), and video information and audio information. As a result, in the complete editing process PR5, after editing work such as length adjustment, the trimming position of the output is calculated using the metadata recorded in accordance with the output format to obtain the output. be able to.
[0112]
In the program creation / distribution system 100, the essence data and the metadata are converted to the MXF file format when transmitted over the Gigabit Ethernet 1, and the editing work by the production system 20 is accompanied by the editing work. The status of the used material is described in the header information as a history. The origin of the content can be known from this header information. As described above, for example, Clip_Object refers to a scene or a cut as a clip, and indicates the time length and time code of the start position. A content is an aggregate of clips, and a time code that is a candidate for a chapter can be known by searching information indicated by a clip in order from the earliest in time. Since the final number of chapter points is smaller than the number of clip change points, all of the chapters can be determined by selecting necessary ones from those listed as candidates.
[0113]
Therefore, in the program creation / distribution system 100, when the content created by the production system 20 is distributed by media such as DVD and LD, the authoring system 52 uses the MFX for the package that has been edited by the production system 20. Search the file header to list the candidate chapter points, view only the candidate before and after, select only the desired chapter points, and distribute the above content on media such as DVD and LD Format conversion, that is, authoring processing. That is, in the authoring system 52, the authoring process of the edited video program is performed from the metadata indicating the logical structure of the video program.
[0114]
In addition, in this program creation / distribution system 100, rights, rights, copyrights, intellectual rights, owners, payments and costing information about performers for each scene. By logging such information and recording it as metadata at the same time, it is possible to trace when a clip is cut out.
[0115]
【The invention's effect】
According to the present invention, Data describing the essence, multiple metadata each identified by the SMPTE (Society of Motion Picture and Television Engineers) label is generated, the preamble part for describing the metadata, and the essence data are described The index part including the index table including the index table and the postamble part is an area where the universal label, the allocation table, and metadata including the universal label as a key are described. It consists of an overall metadata area, and the allocation table transmits the plurality of metadata as a data file in which the allocation information of each object in the overall metadata area is registered, In addition to producing the essence, the essence and the metadata can be associated and stored in a recording medium, and the project can be efficiently produced from the essence using the metadata generated during pre-production.
[0116]
Moreover, according to the present invention, Data describing the essence, multiple metadata each identified by the SMPTE (Society of Motion Picture and Television Engineers) label is generated, the preamble part for describing the metadata, and the essence data are described The index part including the index table including the index table and the postamble part is an area where the universal label, the allocation table, and metadata including the universal label as a key are described. It consists of an overall metadata area, and the allocation table transmits the plurality of metadata as a data file in which the allocation information of each object in the overall metadata area is registered, In addition to producing the essence, the essence and the metadata are associated with each other on a recording medium. Remember, By using the metadata generated during pre-production, the project can be efficiently produced from the essence by controlling the post-production operation for producing the project from the essence.
[0117]
Furthermore, according to the present invention, Data describing the essence, multiple metadata each identified by the SMPTE (Society of Motion Picture and Television Engineers) label is generated, the preamble part for describing the metadata, and the essence data are described The index part including the index table including the index table and the postamble part is an area where the universal label, the allocation table, and metadata including the universal label as a key are described. It consists of an overall metadata area, and the allocation table transmits the plurality of metadata as a data file in which the allocation information of each object in the overall metadata area is registered, In addition to producing the essence, the essence and the metadata are stored in association with a recording medium, and the post-production operation for creating the project from the essence is performed in association with the metadata generated during pre-production. Makes it possible to produce projects efficiently from the essence.
[Brief description of the drawings]
FIG. 1 is a system configuration diagram showing a configuration of a program creation / distribution system to which the present invention is applied.
FIG. 2 is a system configuration diagram showing a configuration of a production system in the program creation / distribution system.
FIG. 3 is a diagram schematically showing a data structure of an SDI format.
FIG. 4 is a diagram schematically showing a data structure of an SDTI format.
FIG. 5 is a diagram schematically showing a data structure of an SDTI-CP format.
FIG. 6 is a diagram schematically illustrating a data structure of a KLV format.
FIG. 7 is a diagram schematically showing a data structure of UMID.
FIG. 8 is a diagram showing the contents of a metadata dictionary that is a dictionary definition in which a universal label standardized in SMPTE298M is taken as a key.
FIG. 9 is a diagram showing the contents of a metadata dictionary.
FIG. 10 is a diagram showing the contents of a metadata dictionary.
FIG. 11 is a diagram showing the contents of a metadata dictionary.
FIG. 12 is a diagram showing the contents of a metadata dictionary.
FIG. 13 is a diagram showing the contents of a metadata dictionary.
FIG. 14 is a diagram showing the contents of a metadata dictionary.
FIG. 15 is a diagram showing the contents of a metadata dictionary.
FIG. 16 is a diagram showing the contents of a metadata dictionary.
FIG. 17 is a diagram showing the contents of a metadata dictionary.
FIG. 18 is a diagram showing the contents of a metadata dictionary.
FIG. 19 is a diagram showing the contents of a metadata dictionary.
FIG. 20 is a diagram showing the contents of a metadata dictionary.
FIG. 21 is a diagram showing the contents of a metadata dictionary.
FIG. 22 is a diagram showing the contents of a metadata dictionary.
FIG. 23 is a diagram showing the contents of a metadata dictionary.
FIG. 24 is a diagram showing the contents of a metadata dictionary.
FIG. 25 is a diagram showing the contents of a metadata dictionary.
FIG. 26 is a diagram showing the contents of a metadata dictionary.
FIG. 27 is a diagram showing the contents of a metadata dictionary.
FIG. 28 is a diagram showing the contents of a metadata dictionary.
FIG. 29 is a diagram illustrating the contents of a metadata dictionary.
FIG. 30 is a diagram showing the contents of a metadata dictionary.
FIG. 31 is a diagram showing the contents of a metadata dictionary.
FIG. 32 is a diagram showing the contents of a metadata dictionary.
FIG. 33 is a diagram showing the contents of a metadata dictionary.
FIG. 34 is a diagram showing the contents of a metadata dictionary.
FIG. 35 is a diagram showing the contents of a metadata dictionary.
FIG. 36 is a diagram showing the contents of a metadata dictionary.
FIG. 37 is a diagram showing the contents of a metadata dictionary.
FIG. 38 is a diagram schematically showing a configuration of an asset management system together with a processing procedure of program creation / distribution work in the program creation / distribution system.
FIG. 39 is a flowchart showing a processing procedure of program creation / distribution work in the program creation / distribution system;
[Explanation of symbols]
100 program creation and distribution system, 1 gigabit Ethernet, 10 distribution program organization system, 20 production system, 21 recording management system, 22 production management system, 22A device controller, 22B A / V server, 23 ingest system, 23A playback device, 23B Telecine device, 23C ingest client 23C, 24 coding system, 24A coding controller, 24B MPEG encoder, 24C MPEG decoder 24C, 25 editing / processing system, 25A offline editing device, 25B online editing device, 25C video processing device, 25D audio processing Equipment, 26 CG Creation System, 30 News System, 40 Archive System, 40A Arca Bed manager, 40B petasite, 50 program distribution system, 51 server controller, 52 authoring system, 53 Web system 54 on-air server 55 routing switch, 60 the acquisition system

Claims (6)

In a production system that creates projects from the essence,
Data relating to the essence, including means for generating a plurality of metadata each identified by a SMPTE (Society of Motion Picture and Television Engineers) label, a preamble part for describing the metadata, and essence data It consists of a main body for description, an index part including an index table, and a postamble part. The preamble part is an area where a universal label, an allocation table, and metadata including a universal label as a key are described. A means for transmitting the plurality of metadata as a data file in which the allocation information of each object in the overall metadata area is registered in the allocation table. Anda pre-production for generating metadata that describes the essence,
Producing the essence, and storing the essence and the metadata in a recording medium in association with each other;
A production system comprising: post-production that produces the project from the essence using the metadata generated during the pre-production. In a production system that creates projects from the essence,
Data relating to the essence, including means for generating a plurality of metadata each identified by a SMPTE (Society of Motion Picture and Television Engineers) label, a preamble part for describing the metadata, and essence data It consists of a main body for description, an index part including an index table, and a postamble part. The preamble part is an area where a universal label, an allocation table, and metadata including a universal label as a key are described. A means for transmitting the plurality of metadata as a data file in which the allocation information of each object in the overall metadata area is registered in the allocation table. Anda pre-production for generating metadata that describes the essence,
Producing the essence, and storing the essence and the metadata in a recording medium in association with each other;
With post production to produce the project from the essence,
A production system characterized by controlling the operation of the post-production using the metadata generated during the pre-production. In a production system that creates projects from the essence,
Data relating to the essence, including means for generating a plurality of metadata each identified by a SMPTE (Society of Motion Picture and Television Engineers) label, a preamble part for describing the metadata, and essence data It consists of a main body for description, an index part including an index table, and a postamble part. The preamble part is an area where a universal label, an allocation table, and metadata including a universal label as a key are described. A means for transmitting the plurality of metadata as a data file in which the allocation information of each object in the overall metadata area is registered in the allocation table. Anda pre-production for generating metadata that describes the essence,
Producing the essence, and storing the essence and the metadata in a recording medium in association with each other;
And a post-production that creates the project from the essence, and the post-production operation is performed in association with the metadata generated during the pre-production. In the production method of creating a project from the essence,
Data describing the above essence, and a plurality of metadata, each identified by an SMPTE (Society of Motion Picture and Television Engineers) label, is generated, a preamble part for describing the metadata, and an essence data It consists of a main body for description, an index part including an index table, and a postamble part. The preamble part is an area where a universal label, an allocation table, and metadata including a universal label as a key are described. And a step of transmitting the plurality of metadata as a data file in which the allocation information of each object in the overall metadata area is registered in the allocation table. ,
Producing the essence and associating the essence with the metadata and storing them in a recording medium ;
Using the metadata generated during pre-production to create the project from the essence ;
Production methods having. In the production method of creating a project from the essence,
Data describing the above essence, and a plurality of metadata, each identified by an SMPTE (Society of Motion Picture and Television Engineers) label, is generated, a preamble part for describing the metadata, and an essence data It consists of a main body for description, an index part including an index table, and a postamble part. The preamble part is an area where a universal label, an allocation table, and metadata including a universal label as a key are described. And a step of transmitting the plurality of metadata as a data file in which the allocation information of each object in the overall metadata area is registered in the allocation table. ,
Producing the essence and associating the essence with the metadata and storing them in a recording medium ;
Using metadata generated during pre-production to control post-production operations that produce the project from the essence ;
Production methods having. In the production method of creating a project from the essence,
Data describing the above essence, and a plurality of metadata, each identified by an SMPTE (Society of Motion Picture and Television Engineers) label, is generated, a preamble part for describing the metadata, and an essence data It consists of a main body for description, an index part including an index table, and a postamble part. The preamble part is an area where a universal label, an allocation table, and metadata including a universal label as a key are described. And a step of transmitting the plurality of metadata as a data file in which the allocation information of each object in the overall metadata area is registered in the allocation table. ,
Producing the essence and associating the essence with the metadata and storing them in a recording medium ;
Performing post-production operations to create the project from the essence in association with the metadata generated during pre-production ;
Production methods having.

Images