Classifications

• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
  • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
  • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
  • G06F16/787—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using geographical or spatial information, e.g. location
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
  • G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
  • G06F16/48—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
  • G06F16/489—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using time information
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
  • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
• • G—PHYSICS
  • G11—INFORMATION STORAGE
  • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
  • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
  • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
  • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
  • G11B27/034—Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
• • G—PHYSICS
  • G11—INFORMATION STORAGE
  • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
  • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
  • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
  • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
  • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
  • G11B27/32—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier
  • G11B27/322—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier used signal is digitally coded

Definitions

• the present invention generally relates to workflow systems and methods and, more particularly, to systems and methods where metadata is collected, managed and exchanged between a plurality of devices at different times in a workflow to contribute to one or more databases for a completed project, e.g., in making a motion picture.
• Examples of current systems are paper records from the production crew with information about circle takes, camera settings, etc.
• PDAs personal digital assistants
• the circle take information is dumped in a database and never used or accessed after dailies.
• a circle take is a take the director liked (e.g., well acted, right dialog, good action, etc) and is usually given special attention at dailies and editorial.
• An inventive method includes recording content during production of media and associating metadata with the recorded content during media production.
• Metadata collection devices include devices incorporated in the equipment and/or devices configured to externally access the system.
• the metadata collection devices are configured to collect metadata and associate the metadata with the content at any point and any time in the workflow.
• the collected metadata can then be used to automate, facilitate and improve content processing in any part of the workflow.
• a system for recording and using metadata in a workflow includes at least one recording device capable of collecting content, metadata devices configured to collect metadata associated with the content anywhere in the workflow at anytime, a server configured to receive metadata from the metadata devices at any point in the workflow and store the metadata in a database, and at least one usage device configured to access the server and render the metadata in association with the content throughout the workflow.
• FIG. 1 is a block diagram of another illustrative embodiment showing analog and -digital eameras reeording-content and- combining-the-content-with- metadata for improving the workflow process in accordance with an embodiment of the present invention
• FIG. 2 is a block diagram of another illustrative embodiment showing analog and digital cameras and other equipment reporting metadata to a common database and the database providing the metadata to usage devices in accordance with yet another embodiment of the present invention
• FIG. 3 is a block diagram of another illustrative embodiment showing metadata capture using portable devices which report the metadata to one or more databases and the database(s) providing the metadata to usage devices in accordance with yet another embodiment of the present invention.
• FIG. 4 is a block diagram of another illustrative embodiment showing metadata capture using portable devices which report the metadata to a database server or servers which permit metadata collection and usage to/by devices in the workflow in accordance with yet another embodiment of the present invention. It should be understood that the drawings are for purposes of illustrating the concepts of the invention and are not necessarily the only possible configuration for illustrating the invention.
• the present invention supports collection, management, and usage of metadata at any point of motion picture workflows. Any type of device can be used to record or extract relevant metadata that is collected and made available to other points of the workflows for automating, improving accuracy, facilitating tasks, etc.
• the present invention is described in terms of a metadata collection, management and exchange in the movie industry; however, the present invention is much broader and may include any workflow project in any industry.
• the present invention is applicable to a network environment that fosters the entry and usage of metadata in conjunction with the collection and usage of other digital data.
• the metadata can be recorded by any recording method including recording data taken by telephone, set top boxes, computer, satellite links, computer entry, etc.
• the present invention is described in terms of a private network; however, the concepts of the present invention may be extended to any wireless and wired network type " tr ⁇ at " mayl ⁇ cl ⁇ de a pu6lic " n ⁇ work, " a priva " te ⁇ e j ⁇ ?orfro ⁇ " a combination of both.
• the elements shown in the FIGS may be implemented in various forms of hardware, software or combinations thereof. Preferably, these elements are implemented in a combination of hardware and software on one or more appropriately programmed general-purpose devices, which may include a processor, memory and input/output interfaces.
• the present description illustrates the principles of the present invention. It will thus be appreciated that those skilled in the art will be able to devise various arrangements that, although not explicitly described or shown herein, embody the principles of the invention and are included within its spirit and scope.
• processors When provided by a processor, the functions may be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which may be shared.
• explicit Use of trfe ' term "processor” ⁇ o ⁇ ⁇ "co ' ntroller” should not be ⁇ construed to refer exclusively to hardware capable of executing software, and may implicitly include, without limitation, digital signal processor (“DSP”) hardware, read-only memory (“ROM”) for storing software, random access memory (“RAM”), and non-volatile storage.
• DSP digital signal processor
• ROM read-only memory
• RAM random access memory
• any element expressed as a means for performing a specified function is intended to encompass any way of performing that function including, for example, a) a combination of circuit elements that performs that function or b) software in any form, including, therefore, firmware, microcode or the like, combined • with appropriate circuitry for executing that software to perform the function.
• the invention as defined by such claims resides in the fact that the functionalities provided by the various recited means are combined and brought together in the manner which the claims call for. It is thus regarded that any means that can provide those functionalities are equivalent to those shown herein.
• Present principles provide several options for maintaining metadata and content. For example: (1 ) the metadata could be collected and be transported together with the content (FIG.
• the metadata could be collected in a separate database or network of database servers (e.g., FIG. 2).
• a unique link between the metadata and the content is maintained, e.g., by employing universal time stamps or unique identifiers.
• the link could be from the metadata to the content and/or from the content to the metadata.
• the system 10 may include a network of devices capable of communication with at least one database 30.
• the devices may include a camera or cameras 12 or 26, processors (e.g. a datacine processor 22 for dailies processing and viewing, computers or other viewing /editing equipment 24, etc. These devices either record or use workflow metadata.
• the devices may include a capability for recording content, and metadata may bexombined with the content. For example, in the case of a camera 12, image data is collected for a scene during filming.
• data may be automatically acquired or entered by a user or other device to be recorded with the content or at least associated with the content in the form of metadata.
• the metadata may include camera settings, lookup tables for images (e.g., color correction information or the like), or any other information that could be useful for the production and/or editing of a film.
• the content and metadata from the camera may be reported directly to a physical vault or database 30 or passed on to a next stage in the processing of the film (or digital media), e.g., digitizing of the film or early processing using a datacine processor 22.
• Processor 22 may employ the content and/or the metadata to enhance the datacine (digitizing) processing of the film from camera 12.
• the datacine processing 22 may provide new metadata or augment the old metadata with e.g., scanner settings, lookup tables, or other useful data.
• the metadata enhanced (e.g., accumulated metadata from all previous processes) content may then be sent or provided to a next processing stage.
• the metadata can be provided directly to a database 30 or included with the content or edited content for the next stage in the workflow.
• a review of the content may be performed using a television, display or projector at equipment 22 or 24.
• Equipment 24 may include the ability to edit the content and/or provide notes related to the content, preferably in the form of metadata.
• metadata e.g., color decisions and changes, edit lists, scene information or ratings, etc.
• the entire content with metadata may be stored in the database 30 and/or provided to editing equipment 28.
• the editors will have at their disposal all of the metadata information collected at all stages of the work flow. This information can be searchable from the database 30 and can be indexed to each scene or frame.
• the database 30 may provide an opportunity to add other metadata.
• System 10 may include a digital camera 26 which may be used instead of or in addition to a film camera 12 for recording image content.
• Film or digital media may " be eTnpl ⁇ yec ⁇ o record metaaat ⁇ TfaRen ' artrre ' time ⁇ of filmTng ⁇ Which " is ⁇ related to the filming process.
• metadata may be associated with the film scenes or frames and recorded directly to an archive or database 30.
• Film from camera 12 may include the metadata, such as camera settings, lookup tables, etc., or the metadata based on notes or other collected information may be introduced or associated with content when the film is converted to digital information with equipment 22.
• Equipment 22 may include processing equipment, e.g., for viewing and editing dailies.
• the metadata may be placed directly in with the content and forwarded to a next stage.
• the metadata may be sent to archive 30 directly.
• Equipment 24 may be employed for grading, editing scenes and otherwise enhancing the content.
• Equipment 24 may receive digital content from digital camera 26 and/or digital content from equipment 22.
• Equipment 24 may also receive the metadata from camera 26 (e.g., camera settings, lookup table, etc.) and from equipment 22.
• Equipment 24 changes or adds additional metadata (e.g. color information, edit lists, etc.) to the content (or provides the metadata directly to the archive). All the metadata previously added in the workflow is provided to the editors (or others accessing the information) of the motion picture of feature.
• Editing equipment 28 uses the content and metadata to better organize the content and make corrections based upon recorded information.
• the archive 30 also may provide metadata (e.g., access rights and location information for stored metadata). Referring to FIG.
• a distributed network 100 includes a database 102 in communication with a plurality of metadata sources.
• the network 100 is composed of devices that record and/or use workflow metadata.
• a network of metadata servers are provided that collect, manage and publish the metadata. Any type of workflow metadata could be supported including circle takes, camera position, camera settings, set dimensions, etc.
• metadata could be collected by different devices including circled take information 104 or other information (e.g., with a PDA 106, laptop 114, processing equipment 108, etc.).
• Color corrections e.g., through laptop manipulation
• camera position e.g., using a camera 12 or 26 or sensors 110 attached to a camera, etc.
• the system can acquire, collect and manage metadata that is relevant from the point ⁇ f grisFof ⁇ d ⁇ ec ⁇ f7a ⁇ cme ⁇ Oamera operator, an editor, a colorist, etc.
• metadata recording devices may include PDAs, cellphones, laptop, sensors, cameras, recorders, etc.
• editing or processing equipment may add metadata to the content or the database.
• the system 100 permits the downloading of metadata recording applications (such as in Java, C++, etc) to any device with Internet access, wireless network access, or other type of connection. In this way, completely different devices (that may be different PDA, camera, computer, etc.) may be used in the data acquisition phase. These different metadata recording devices then may be used by different parties to input metadata about the same event, at the same time.
• a director and a special effects worker may input metadata about a scene at the same time. This metadata is then made available at any other stage through a database 102 or a server (See FIG. 4) for post production, dailies, or any other operation performed during the process.
• Examples of devices that can use the metadata may include a dailies station 108, which may include a processing station 109 and a digital conversion station 22 (for converting an analog film recording), an editorial station 28, color correction station 112, etc.
• metadata information may be reported to and stored in database 102. The information may be reported to the database 102 using a plurality of different devices and a plurality of different modes.
• the data base 102 may include a plurality of security levels and the users of the data base may not be privy to all of the metadata information stored therein. For example, a director may have access to all of the data while a cinematographer may only have access to a portion of the data.
• the data in database 102 may be organized in a plurality of different ways. Some examples of database organization include: organized by date and time, organized by scene or frame number, organized by author or title, etc. In a preferred embodiment, communication with the database is performed over a secured wireless network, although a secured Internet or other network is also adequate. In this way, metadata is easily stored and easily accessible to authorized users. Metadata can be collected using any available device capable of communication with or adapted to communicate with database 102. Referring to FIG.
• Metadata collected from the field or on set is , stored in a database 102 and ' can be accesseti ⁇ by ⁇ ⁇ tl ⁇ er parts of the workflow at any time and place through a network.
• workers are equipped with communication devices 150 for inputting metadata into a database (or alternately recording the metadata with the content recording media (e.g., film, memory, etc.).
• the communication devices 150 may include a PDA 151 , a cellular telephone, 152, a laptop computer 154 or similar devices.
• all other equipment may be provisioned to permit the entry and access of metadata.
• Users of the devices may call up a form or a formatted page and enter data or measurements into the form.
• a form is not necessary and any data entry may be recorded as metadata by simply providing access to memory in the database 102 or to the content media.
• the metadata is recorded to database 102 by transmitting the data to the database 102 along with identification information or at least one of date/time, sender's identification, scene data, or any other acceptable information which may be employed to correlate the metadata to the content being recorded or edited.
• the database 102 organizes the metadata to permit authorized access by one or more devices, which will employ the metadata. Devices that may benefit from access to the metadata include, e.g., color grading equipment 156, editorial equipment 158, daily editing equipment 160, etc. Referring to FIG.
• the metadata recorded in database 102 may also be accessible to authorized users in the workflow. Now any part of the workflow can actually collect metadata, use the metadata and/or transmit the metadata to a metadata server 170 or other user for that metadata to be accessible by any authorized person or device.
• Database 102 may be included with or work in conjunction with one or more servers 170. For example, an authorized film worker may check notes from another worker to determine how a current task would be affected by downloading metadata from server 170. Other interactive features and mechanisms may be employed as well.
• the metadata may be stored with a ranking describing an importance of a metadata message or note. In one embodiment, the metadata notes may automatically appear on a screen or display when a triggering event such as accessing a file is performed.
• One of the metadata servers 170 could act as a master and central server to which the rest of the metadata servers 170 report to and synchronize from. The exchange of metadata between metadata servers 170 and devices 150, 156,
• 158, 160, etc. may be ⁇ perfbrmed through open Tstandard Web Services and protocols (e.g., XML, RPC and SOAP).
• Web services are platform independent so the present invention can work in heterogeneous computing environments (e.g., the PDA could be C++ on Windows CETM; whereas the metadata server 170 could run JavaTM on LinuxTM).
• One illustrative embodiment has been constructed and simulated, and includes a PDA used to record circle take metadata.
• Web services through a wireless connection were employed to send the metadata to a mobile metadata server (a laptop).
• a dailies station accessed the circle take metadata using a web browser.
• the circle take metadata was used by the dailies station to create a CD that distinguished between circle takes and other takes.
• Present principles also provide a schema where the creation of metadata for a scene, may be synchronized between different devices.
• a SMPTE time code may be used to link metadata produced by a PDA to metadata produced by a camera.
• other methods for synchronization may be used, such as, by employing a master clock, and the like.
• Database 102 may include a network of databases that keep the metadata synchronized with each other and accessible by any authorized person and anywhere (even where no Internet connection may be available).
• the database may be distributed among and between the devices in the network.
• the network may be set up for a specific project and the metadata may be collected, managed and stored by a plurality of distributed databases.
• a synchronization protocol e.g., time stamping and a system of unique identifiers may be put in place to provide authorization/access control and permit updated information to be accessible and apparent to users.
• the time stamps or unique identifiers may be employed to link content with respective metadata and vice versa.

Landscapes

• Engineering & Computer Science (AREA)
• Theoretical Computer Science (AREA)
• Multimedia (AREA)
• Data Mining & Analysis (AREA)
• Databases & Information Systems (AREA)
• Physics & Mathematics (AREA)
• General Engineering & Computer Science (AREA)
• General Physics & Mathematics (AREA)
• Library & Information Science (AREA)
• Television Signal Processing For Recording (AREA)
• Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
• Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Priority Applications (5)

Applications Claiming Priority (2)

Publications (1)

Family

ID=38092550

Family Applications (1)

Country Status (7)

Cited By (6)

Families Citing this family (16)

Citations (4)

Family Cites Families (47)

• 2006
  • 2006-06-08 JP JP2008543263A patent/JP2009517971A/ja not_active Withdrawn
  • 2006-06-08 EP EP06772521A patent/EP1955193A4/en not_active Withdrawn
  • 2006-06-08 WO PCT/US2006/022255 patent/WO2007064357A1/en not_active Ceased
  • 2006-06-08 CA CA002631803A patent/CA2631803A1/en not_active Abandoned
  • 2006-06-08 BR BRPI0619082-0A patent/BRPI0619082A2/pt not_active IP Right Cessation
  • 2006-06-08 US US12/085,983 patent/US20090083282A1/en not_active Abandoned
  • 2006-06-08 CN CNA2006800506676A patent/CN101356524A/zh active Pending

Patent Citations (4)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events