WO2003096682A9 - Systemes, procedes et programme informatique permettant l'amelioration de la feuille de presence, la saisie automatique au clavier, l'execution automatique en temps reel d'inserts en direct de distribution de contenu stocke recycle, la production en diffusion simultanee automatique a rapport de forme multiple, et interface - Google Patents

Systemes, procedes et programme informatique permettant l'amelioration de la feuille de presence, la saisie automatique au clavier, l'execution automatique en temps reel d'inserts en direct de distribution de contenu stocke recycle, la production en diffusion simultanee automatique a rapport de forme multiple, et interface

Info

Publication number
WO2003096682A9
WO2003096682A9 PCT/US2003/014427 US0314427W WO03096682A9 WO 2003096682 A9 WO2003096682 A9 WO 2003096682A9 US 0314427 W US0314427 W US 0314427W WO 03096682 A9 WO03096682 A9 WO 03096682A9
Authority
WO
WIPO (PCT)
Prior art keywords
production
show
icon
keyer
video
Prior art date
Application number
PCT/US2003/014427
Other languages
English (en)
Other versions
WO2003096682A1 (fr
Inventor
Alex Holtz
Robert J Snyder
John R Benson
William H Couch
Marcel Larocque
Richard Todd
Charles M Hoeppner
Keith Gregory Tingle
Kevin K Morrow
Maurice Smith
Original Assignee
Parkervision Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US10/208,810 external-priority patent/US20030001880A1/en
Priority claimed from US10/247,783 external-priority patent/US11109114B2/en
Application filed by Parkervision Inc filed Critical Parkervision Inc
Priority to EP03724519A priority Critical patent/EP1552685A4/fr
Priority to AU2003230350A priority patent/AU2003230350A1/en
Publication of WO2003096682A1 publication Critical patent/WO2003096682A1/fr
Publication of WO2003096682A9 publication Critical patent/WO2003096682A9/fr

Links

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34—Indicating arrangements 
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/034—Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/268—Signal distribution or switching
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00—Record carriers by type
    • G11B2220/20—Disc-shaped record carriers
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00—Record carriers by type
    • G11B2220/20—Disc-shaped record carriers
    • G11B2220/25—Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
    • G11B2220/2508—Magnetic discs
    • G11B2220/2516—Hard disks
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00—Record carriers by type
    • G11B2220/40—Combinations of multiple record carriers
    • G11B2220/41—Flat as opposed to hierarchical combination, e.g. library of tapes or discs, CD changer, or groups of record carriers that together store one title

Definitions

  • the present invention relates generally to video production, and more specifically, to a system, method and computer program product for automating the execution of a live or live-to-tape video show.
  • the present invention also relates generally to media production, and more specifically, to keying a video production.
  • the present invention also relates generally to production of live and as-live shows, and more particularly relates to production of live and as-live shows using live segments and re-purposed archived materials.
  • the present invention also relates generally to media production, and more specifically, to automating production devices during a media production.
  • a live or live-to-tape video show such as a network news broadcast, talk show, or the like
  • the video production environment is comprised of many diverse types of video production devices, such as video cameras, microphones, video tape recorders (VTRs), video switching devices, audio mixers, digital video effects devices, teleprompters, and video graphic overlay devices, etc.
  • VTRs video tape recorders
  • audio mixers audio mixers
  • digital video effects devices teleprompters
  • video graphic overlay devices etc.
  • the basics of video production techniques is described in "Television Production Handbook," Zettl, 1997 Wadsworth Publishing Company, which is incorporated herein by reference.
  • the video production devices are manually operated by a production crew (which does not include the performers and actors, also known as the "talent") of artistic and technical personnel working together under the direction of a director.
  • a standard production crew is made up of nine or more individuals, including camera operators (usually one for each camera, where there are usually three cameras), a video engineer who controls the camera control units (CCUs) for each camera, a teleprompter operator, a character generator operator, a lighting director who controls the studio lights, a technical director who controls the video switcher, an audio technician who controls an audio mixer, tape operator(s) who control(s) a bank of NTRs, and a floor director inside the studio who gives cues to the talent.
  • the director coordinates the entire production crew by issuing verbal instructions to them according to a script referred to as a director's rundown sheet.
  • a director's rundown sheet a script referred to as a director's rundown sheet.
  • each member of the production crew is equipped with a headset and a microphone to allow constant communication with each other and the director through an intercom system.
  • the real time nature of the execution of the show creates great stress for the director, the production crew, and the talent. People is extremely concerned about failure.
  • the real time nature of the execution of the show also necessitates re-creation of the format, including transitions and special effects, for the show.
  • Producing live or live-to-tape video shows is very expensive because of the large size of the video production crew.
  • the compensation to the individuals that make up the production crew is substantial, and can run in the range of several Million dollars per year for the entire crew.
  • the compensation for a member of a production crew is commensurate with the video market of the station.
  • the level of compensation for the top markets is substantially higher than for the lesser markets, and the compensation for network affiliates is higher than independent broadcasters and cable networks.
  • Activating an icon means selecting or triggering the icon.
  • buttons are an icon that is intended to represent an electrical push-button appearing as part of a graphical user interface. Moving a mouse pointer over the graphical button and pressing one of the physical mouse buttons starts some software action.
  • Execution of a show means the implementation of the steps necessary to broadcast the show or record it in any tangible medium of expression.
  • Frame a frame is one-thirtieth of a second.
  • Graphical Controls are one or more icons used for controlling a video production device.
  • Hot-key is a programmable icon.
  • Icon means a small picture intended to represent something in a graphical user interface. When an icon is clicked on with a mouse, for example, some action is performed. Icons are usually stored as bitmaps, but of course can be stored using other formats.
  • Pre-production is the planning process whereby the video director plans the steps necessary to execute the show.
  • Show is a live or live-to-tape production.
  • Show template is a stored file of a transition macro that can be used in whole or in part as a starting point to produce another show.
  • Transition macro means a set of video production commands, where each video production command is transmitted from a processing unit to a video production device.
  • Transition macro also refers to a set of icons that have been dragged and dropped (i.e., assembled) onto the control lines of a transition macro time sheet.
  • Video production command is any command or instruction that controls a video production device.
  • the concept of video keying enables two video sources to be combined into a composite video image by selectively switching between the two sources.
  • a video keyer switches between the two sources in accordance with a switching signal.
  • the switching signal is derived from a video source rather than a fixed pattern generator.
  • An internal key typically uses a luminance level of the video to create the switch. This is practical for superimposing black-and-white graphics or text onto the video.
  • luminance keyers and chroma keyers represent two commonly known keyers.
  • a monochrome key signal is used to determine when to switch. These simple keyers switch between two sources based on the level of the key signal in relation to key level and/or clip controls.
  • the key signal can be derived from an overall brightness level (i.e., luminance key), color or hue information (i.e., chroma key), or a combination of both.
  • Linear keyers provide a full range of transparency, which allows natural and pleasing compositing of images.
  • the key signal is used to effectively dissolve between two video sources, one representing a background image and the other representing a foreground image. If the value of the key signal is zero or black, the foreground image is completely transparent and thus cannot be seen over the background image. If the key signal has the absolute value of one- hundred units or white, the foreground image is completely opaque and thus the background image cannot be seen under the foreground image.
  • the foreground image achieves an increasing degree of translucence as the key signal approaches the absolute value. Accordingly, the background image becomes less visible through the foreground image as the absolute value of the key signal is approached.
  • An advantage of using a linear keyer is that it can maintain the proper levels of anti-aliased images (especially graphics) when creating a composite image.
  • keyers are used to create lower thirds on a video shot.
  • graphic titles are retrieved from a character generator, and located or “keyed” at the lower third portion of a television screen.
  • keyers are used to create "over-the-shoulder” (OTS) boxes.
  • OTS boxes can be used to enhance the presentation of an on-camera shot of the news anchor by highlighting a graphic, picture, or text to support the topic being discussed.
  • a director for a newscast would setup a keyer on a "mixed effect" bank (M/E).
  • the director would select an "unoccupied" keyer that would receive video input from the camera that is recording the news anchor. This video input would serve as the background video. The director would then select the desired graphic title and/or an OTS video source that would be used as the foreground image. The director would also specify the desired location for placing the graphic title and/or OTS over the background video.
  • the director After the keyer has been setup on M/E, the director would preview the composite view (i.e., the key shot with the lower third or OTS) to check for accuracy. Once the director is satisfied with the result, the composite or keyed shot is transitioned to air on a program channel. If another keyed shot is required, the director must select another unoccupied keyer, follow the same process from M/E, to preview, to air on the program channel.
  • the composite view i.e., the key shot with the lower third or OTS
  • the director must keep track of the keyers to avoid on-air mistakes. In other words, the director must be able to quickly determine which keyers are keying content for air, which ones are keying content for a preview channel, and which ones are unoccupied.
  • many keyed shots are produced in a short time span, and most of the keyed shots occur back-to-back.
  • a live or live-to-tape video show (such as a network news broadcast, talk show, or the like) is largely a manual process involving a team of specialized individuals working together in a video production environment having a studio and a control room.
  • the video production environment is comprised of many diverse types of video production devices, such as video cameras, microphones, video tape recorders (NTRs), video switching devices, audio mixers, digital video effects devices, teleprompters, and video graphic overlay devices, etc.
  • NTRs video tape recorders
  • audio mixers audio mixers
  • digital video effects devices digital video effects devices
  • teleprompters digital video effects devices
  • video graphic overlay devices etc.
  • the video production devices are manually operated by a production crew (which does not include the performers and actors, also known as the "talent") of artistic and technical personnel working together under the direction of a director.
  • a standard production crew is made up of nine or more individuals, including camera operators (usually one for each camera, where there are usually three cameras), a video engineer who controls the camera control units (CCUs) for each camera, a teleprompter operator, a character generator operator, a lighting director who controls the studio lights, a technical director who controls the video switcher, an audio technician who controls an audio mixer, tape operator(s) who control(s) a bank of NTRs, and a floor director inside the studio who gives cues to the talent.
  • the director coordinates the entire production crew by issuing verbal instructions to them according to a script refened to as a director's rundown sheet.
  • each member of the production crew is equipped with a headset and a microphone to allow constant communication with each other and the director through an intercom system.
  • the video produced by crew is delivered or transmitted to a master control system that, in turn, broadcasts the video over traditional mediums to a television set.
  • Traditional mediums include the appropriate ranges of the frequency spectrum for television, satellite communications, and cable transmissions.
  • the global Internet and other computer networks present an alternative distribution medium for video productions and like.
  • a news automation systems is a network-based service that aggregates stories from news services, such as AP, Konas, and CNN services, police and fire information systems, and field reporters.
  • a news automation system allows a producer or director to develop a rundown sheet and always know the status of stories during the rundown assembly process.
  • the director must be able to quickly adjust the rundown to avoid errors on the air.
  • a significant problem with today's conventional production environment is the director must be able to quickly assign sources while executing the show.
  • production equipment may fail to operate or members of the crew or talent may miss their cues. The director must be able to quickly react to these dynamic events. Therefore, a need exists to develop a technology that addresses these concerns.
  • the present invention solves at least some of the above identified problems in conventional systems by providing an integrated video production system, method and computer program product (refened to collectively as
  • video production system for purposes of brevity) for automating the execution of a live or live-to-tape video show.
  • the video production system is integrated such that a single person (“a video director") has control over all video production devices used in executing the show.
  • Such devices include, but are not limited to, video cameras, robotic pan tilt heads, video tape players and recorders (NTRs), video servers and virtual recorders, character generators, still stores, digital video disk players (DVDs), digital video effects (DNE), audio mixers, audio sources (e.g., CD's and DAT's), video switchers, and teleprompting systems.
  • the automation capability provided by the video production system allows the video director to pre-produce a live show (such as a news show or talk show), preview the show in advance of "air time", and then, with a touch of a button or other trigger, execute the live show. Consequently, a live show or live-to-tape show can be executed more cost efficiently, with greater control over logistics and personnel, with enhanced functionality and transitions, in less time and with less stress, and with fewer people and fewer human enors than was previously possible.
  • the present invention also allows the video director to reuse formats of prior shows by leveraging show templates.
  • a video production system having a processing unit in communication with and/or controlling one or more of the video production devices mentioned above.
  • the processing unit displays on a monitor or other display device a graphical user interface (GUI) that consists of graphical controls for controlling the video production devices that it is in communication with.
  • GUI graphical user interface
  • the graphical controls are made up of icons that the video director activates to control a video production device.
  • the video director uses a keyboard and mouse or other input device or interface (including voice activated, touch screen, heads up display, etc.) to activate the icons, and thereby remotely control the video production devices. In this manner, a director is given control over video production devices used in executing a show.
  • the processing unit also enables the video director to automate the execution of a show.
  • the video director pre- produces the show to create a director's rundown-sheet, creates a transition macro (or multiple transition macros), which specifies one or more video production commands, and instructs the processing unit to execute the transition macro.
  • Executing a transition macro means transmitting the one or more video production commands that are specified by the transition macro to the appropriate video production devices.
  • a video production device Upon receiving a video production command, a video production device performs the function conesponding to the received command.
  • the processing unit provides automated control of the video production devices, and thereby provides a system for automating the execution of a show in real time. This feature provides the director with the advantage of not having to rely on a production crew to execute a show. The cost and time savings this feature provides are therefore substantial.
  • the invention may include a timer and means for associating a timer value with each video production command specified by the transition macro, thereby creating a timer driven transition macro.
  • a video production command is transmitted to a video production device only when the timer reaches the timer value associated with the video production command.
  • An advantage of this feature is that the video production commands are scheduled according to the timer.
  • the timer is activated by the video director activating a timer start icon displayed by the processing unit or is activated by the processing unit receiving a timer start command from an external system, such as a teleprompting system.
  • the timer can also be stopped at any point in time, thereby providing the video director with control over the execution of a transition macro.
  • the processing unit is programmed to provide a graphical user interface (GUI) that enables the director to easily create timer driven transition macros via a hierarchical time sheet.
  • the hierarchical time sheet includes a plurality of control lines and a possible plurality of hierarchical group layers. Each of the control lines conesponds to a video production device in a prefened embodiment.
  • the video director creates a transition macro by defining one or more hierarchical group layer GUIs, where the group layer GUIs may include an object group layer GUI, a TME group layer GUI, a page group layer GUI, a story layer GUI and a show layer GUI.
  • a show is the container for everything, which can be divided into various story layers.
  • a story can contain multiple page layers, a page layer can contain multiple TME layers, and a TME layers can contain multiple object layers.
  • a method, system and computer program product are provided to implement parallel automated keying for one or more media productions (such as, news programs, situation comedies, concerts, movies, video rentals, radio broadcast, animation, etc.).
  • a plurality of automated keyers are programmable to key one or more layers on a media production.
  • multiple keyers are serially positioned to composite multiple keyer layers.
  • two or more keyers are positioned to composite productions for output on two separate channels, such as a program channel or a preview channel.
  • the automated keyers are placed in a fixed anangement comprising two groups.
  • a first group of keyers are serially positioned to support multiple keyer layers.
  • the total number of automated keyers placed in series depends on tlie maximum number of keyer layers established for the keyer system.
  • a second group of keyers are placed in parallel to support multiple outputs. The total number of parallel keyers placed depends on the maximum number of channels established for the keyer system.
  • an automated router comprises a plurality of automated keyers.
  • the automated router is responsive to control signals that instruct the automated keyers to float.
  • the automated keyers are programmable to be grouped in serial and parallel variable anangements and assigned to multiple flow paths to output composite productions to multiple channels (e.g., program and preview).
  • the automated router can be instructed to allow two keyer layers to be composited and transitioned between a preview and program channel.
  • the automated router is instructed to route a video shot having no keyer layers, a single keyer layer, or multiple keyer layers.
  • a user interface allows a director, or other personnel, to configure the attributes or properties for the key effects.
  • the director specifies a background media source, a fill source, and a key source.
  • the fill source specifies a device and/or file for the content that will be keyed on the background media production.
  • the key source is associated with the fill source and specifies the shape and position of the key fill on the background media production.
  • the three sources are recorded to a configuration file.
  • one or more automation control icons are placed on a graphical user interface to configure the key effects. As such, the director operates an input device to open an automation control icon that produces a dialogue box.
  • the dialog box is responsive to receiving the background, fill, and key information.
  • the automation control icon is associated with a set of computer readable broadcast instructions. When the automation control icon is activated by a timer associated with the user interface, the associated broadcast instructions are executed to transmit commands to an automated keyer that implements the key effects.
  • the broadcast instructions are created from the Transition MacroTM multimedia production control program developed by ParkerNision, Inc. (Jacksonville, FL) that can be executed to control an automated multimedia production system.
  • the Transition MacroTM program is described in the pending U.S. application entitled "System and
  • the automated keyers of the present invention can be implemented in a manual media production environment as well as an automated media production environment.
  • An automated multimedia production environment includes a media production processing device that automatically or semi- automatically commands and controls the operation of a variety of media production devices, including an automated keyer. Therefore in an embodiment, the media production processing device sends control signals to the automated router to implement the serial and parallel variable arrangements and assigned flow paths, as previously discussed.
  • the present invention also includes a system and method for monitoring, updating, and altering the operating states of the automated keyers.
  • the operating states are monitored to determine if a keyer is cunently keying content for a program channel, keying content for a preview channel, or unoccupied. Hence prior to implementing the key effects from the configuration file, the operating states are monitored to select an unoccupied keyer.
  • an automation control icon when the icon is activated, the associated broadcast instructions call or implement a routine to automatically select an automated keyer. Afterwards, keyer control commands are transmitted to send the configuration data (i.e., background, fill, and key source) to the selected keyer to composite the predefined key effects.
  • only an unoccupied keyer is selected.
  • a keyer operating in a preview state is chosen if no unoccupied keyers are cmrentry available.
  • the present invention includes mechanisms that allow a director to approve or reject the selection of a keyer before the keyer is placed in operation.
  • the present invention provides methodologies and/or techniques for automatically selecting a keyer and compositing predefined keyer layer(s).
  • the composite media production is routed over a preview channel so that the director can review the production. If the key effects are approved, the director steps or transitions the composite media production from preview to program. As a result, the director is not required to keep track of the keyer operating states when keying and reviewing a media production during a live production.
  • the present invention is directed to a system, method, and computer program product for producing a show.
  • the invention is directed to a production system having a first production path, a second production path, and a control system that causes the first production path to generate a show in a first aspect ratio
  • the invention is directed to producing a show from live material and from archived material.
  • This aspect of the invention operates by producing a first show comprising a plurality of stories, segmenting the first show, and storing the show segments in an archive. Then, the invention produces a second show using live portions as well as show segments retrieved from the archive.
  • the invention is also directed to a media manager that interacts with a server.
  • the server is integrated with the production system.
  • a method, system, and computer program product overcomes the above problems by providing a director control interface that serves as a link between a newsroom information management system and a production control system.
  • a newsroom information management system includes a news automation system, such as those available from iNEWSTM, Newsmaker, Comprompter, and the Associated Press.
  • a production control system includes an automated production control environment, such as the embodiments described in the pending U.S. application entitled "Method, System and Computer Program Product for Producing and Distributing Enhanced Media Downstreams" (U.S.
  • the director control system extracts production information from a newsroom information management system and populates a production control system.
  • the director control interface enables the director to build a show, but mitigate enors and check for conflicts during the building process.
  • the director control interface automatically selects macro elements, which are executed on the production control system.
  • the director can override the selection process and choose the macro elements.
  • the director control interface monitors the newsroom information management system for rundown changes, evaluates the changes, and updates the production control system either automatically or with approval from the director.
  • the director control interface is compatible with any type newsroom information management system as long as it can extract the requisite production information.
  • FIG. 1 illustrates an embodiment of an integrated, fully automated video production system.
  • FIG. 2 illustrates an interactive graphical user interface (GUI) for the fully automated video production system according to an embodiment of the present invention.
  • GUI graphical user interface
  • FIG. 3 illustrates a block diagram of an example computer system useful for implementing the present invention.
  • FIG. 4 illustrates an interactive graphical user interface (GUI) for the fully automated video production system according to an embodiment of the present invention.
  • GUI graphical user interface
  • FIG. 5 illustrates an alternative view of the time sheet GUI of FIG. 4.
  • FIG. 6 illustrates of an encode mark configuration GUI according to an embodiment of the present invention.
  • FIG. 7 illustrates an alternative view of the time sheet GUI of FIG. 4.
  • FIG. 8 illustrates an encode object configuration GUI according to an embodiment of the present invention.
  • FIG. 9 illustrates the hierarchy of the group levels according to an embodiment of the present invention.
  • FIG. 10 further illustrates the group level hierarchy of FIG. 9.
  • FIG. 11 illustrates the object group layer GUI according to an embodiment of the present invention.
  • FIG. 12 illustrates the TME group layer GUI according to an embodiment of the present invention.
  • FIG. 13 illustrates the page group layer GUI according to an embodiment of the present invention.
  • FIG. 14 illustrates the story group layer GUI according to an embodiment of the present invention.
  • FIG. 15 illustrates an example time sheet row setup dialog according to an embodiment of the present invention.
  • FIG. 16 illustrates an example operation flowchart of the present invention upon receiving a command from the user to exit time sheet row setup dialog in FIG. 15 according to an embodiment of the present invention.
  • FIG. 17 illustrates an example time sheet layout setup dialog according to an embodiment of the present invention.
  • FIG. 18 illustrates an example timeline prep setup dialog according to an embodiment of the present invention.
  • FIG. 19 illustrates another embodiment of the page group layer GUI of the present invention.
  • FIG. 20 illustrates example GUI buttons according to an embodiment of the present invention.
  • FIG. 21 illustrates an example rundown converter dialog according to an embodiment of the present invention.
  • FIG. 22 illustrates an example ETLA search according to an embodiment of the present invention.
  • FIG. 23 illustrates an example graphical time sheet view according to an embodiment of the present invention.
  • FIG. 24 illustrates an operational flow for keying a media production according to an embodiment of the present invention.
  • FIG. 25 illustrates an operational flow for identifying and selecting a keyer according to an embodiment of the present invention.
  • FIG. 26 illustrates an operational flow diagram for identifying and selecting a keyer according to another embodiment of the present invention.
  • FIG. 27 illustrates an operational flow diagram for identifying and selecting a keyer according to another embodiment of the present invention.
  • FIG. 28a illustrates an initial state of two keyers according to an embodiment of the present invention.
  • FIG. 28b illustrates a queue for two unoccupied keyers according to an embodiment of the present invention.
  • FIG. 28c illustrates program and preview states of two keyers according to an embodiment of the present invention.
  • FIG. 29a illustrates an initial state of three keyers according to an embodiment of the present invention.
  • FIG. 29b illustrates a queue for three unoccupied keyers according to an embodiment of the present invention.
  • FIG. 29c illustrates program and preview states of keyers according to another embodiment of the present invention.
  • FIG. 29d illustrates program and preview states of keyers according to another embodiment of the present invention.
  • FIG. 30a illustrates an initial state of a plurality of keyers according to an embodiment of the present invention.
  • FIG. 30b illustrates a queue for a plurality of keyers according to an embodiment of the present invention.
  • FIG. 30c illustrates a program state of keyers according to an embodiment of the present invention.
  • FIG. 30d illustrates a preview state of keyers according to an embodiment of the present invention.
  • FIG. 30e illustrates an unoccupied state of keyers according to an embodiment of the present invention.
  • FIG. 31 illustrates a keyer system according to an embodiment of the present invention.
  • FIG. 32 illustrates a keyer system according to another embodiment of the present invention.
  • FIG. 33 illustrates a user interface for a show rundown according to an embodiment of the present invention.
  • FIG. 34 illustrates a user interface for keying a media production according to an embodiment of the present invention.
  • FIG. 35 illustrates a video image keyed according to an embodiment of the present invention.
  • FIG. 36 illustrates a display for a quad box application according to an embodiment of the present invention.
  • FIG. 37 is an example production system useful for simultaneously generating outputs in native 4:3 format and native 16:9 format.
  • FIGS. 38 and 39 are example flowcharts depicting the operation of the invention when producing shows using live content and re-purposed archived materials.
  • FIG. 40 is an example production system for producing shows using live content and re-purposed archived materials.
  • FIG. 41 is an example user interface for the production system of FIG. 4.
  • FIG. 42 is a block diagram of a media manager according to an embodiment of the invention.
  • FIG. 43 illustrates a director control interface according to an embodiment of the present invention.
  • FIG. 44 illustrates a director control interface according to another embodiment of the present invention.
  • FIG. 45 illustrates a director control interface according to another embodiment of the present invention.
  • FIG. 46 illustrates an operational flow for building a director control interface according to an embodiment of the present invention.
  • FIG. 47 illustrates a production control interface according to an embodiment of the present invention.
  • FIG. 48 illustrates a production control interface according to another embodiment of the present invention.
  • FIG. 1 illustrates, according to an embodiment of the present invention, an integrated video production system 100 for automating the execution of a show.
  • Integrated video production system 100 is described in detail in commonly assigned U.S. Patent Application Serial No. 10/200,776, filed July 24, 2002, by Holtz et al, and entitled "Real Time Video Production System and Method," (hereinafter referred to as the '776 application"). The disclosure of the 776 application is incorporated herein by reference as though set forth in its entirety.
  • integrated video production system 100 will be briefly discussed herein with reference to FIG. 1.
  • video production system 100 in a representative embodiment, includes a processing unit 102 in communication with a variety of video production devices.
  • Such video production devices include, but are not limited to, a video switcher 104; a digital video effects device (DVE) 106; an audio mixer 110; a teleprompting system 108; video cameras and robotics (for pan, tilt, zoom, focus, and iris control) 120, 122, 124, and 126; a record/playback device (RPD) 128; and a character generator and/or still store 130.
  • RPD 128 can be a video tape recorder/player (VTR), a video server, a virtual recorder, a digital audio tape (DAT) recorder, or any device that stores, records, generates or plays back via magnetic, optical, electronic, or any other storage media.
  • Lines 170-188 represent logical communication paths between processing unit 102 and the video production devices 104-130 listed above. Each of these components are described in detail in the 776 application.
  • a video director 135 uses processing unit 102 to produce a show, i an embodiment, processing unit 102 displays graphical user interfaces (GUIs) 132 and 133 on display devices 114 and 115, respectively. In another embodiment, processing unit displays GUIs 132 and 133 together on a single display device. GUIs 132 and 133 display graphical controls conesponding to the video production devices 104-130. Video director 135 uses a keyboard 118 and a mouse 116 to interact with the processing unit 102 by manipulating the graphical controls of GUI 132 and 133.
  • GUIs graphical user interfaces
  • GUI 132 includes video switcher graphical controls 202 for controlling video switcher 104 and DVE 106; audio mixer graphical controls 204 for controlling audio mixer 110; RPD graphical controls 206 for controlling up to twelve RPDs; camera graphical controls 205 for controlling one or more cameras that are in communication with processing unit 102; and DVE controls 203 for controlling DVE 106.
  • GUI 132 is described in detail in the 776 application.
  • GUI 133 of FIG. 4 is an user-friendly graphical interface that enables the director (i.e., video director 135 from FIG. 1), or other personnel, to interact with the control system and make timely edits and revisions to the production as it is being filmed, videotaped, or broadcast.
  • the graphical interface is an event-driven, timeline based application.
  • the time sheet of the graphical interface has a timeline and control lines.
  • the control lines are populated with various icons that are linked to the control system.
  • the present invention includes a mechanism that improves the director's ability to change the order and grouping of the selected icons in response to timely changes to the rundown at various levels of granularity.
  • the present invention also includes resynchronization and enor conection routines for the altered time sheet.
  • the enhanced time sheet of the present invention is described next in more detail.
  • FIG. 4 illustrates an embodiment of an interactive time sheet created by a timeline-based application of graphical user interface (GUI) 133, according to an embodiment of the invention.
  • the time sheet includes a horizontal timeline 402 and one or more horizontal control lines 404a-404p.
  • Automation control icons 406a-406t are positioned onto control lines 404a- 404p at various locations relative to timeline 402, and configured to be associated with one or more video production commands and at least one video production device.
  • FIG. 4 illustrates an embodiment of the time sheet after the placement of automation control icons 406a-406t onto control lines 404a-404p.
  • a timer (not shown) is integrated into timeline 402, and operable to activate a specific automation control icon 406a-406t as a timer indicator 408 travels across timeline 402 to reach a location linked to the specific automation control icon 406.
  • video production system 100 would execute the video production commands to operate the associated video production device.
  • label icon 406a permits a director to name one or more segments or portions of a time sheet.
  • the director would drag and drop a label icon 406a onto control line 404a, and double click on the positioned label icon 406a to open up a dialogue box to enter a text description.
  • the text would be displayed on the positioned label icon 406a.
  • Control line 404a is also operable to receive a step mark icon 406b, a general purpose input/output (GPI/O) mark icon 406c, a user mark icon 406d, and an encode mark 406e.
  • Encode mark 406e is described in detail below with reference to FIG. 5.
  • Step mark icon 406b and GPI/O mark icon 406c are associated with time sheet step commands.
  • the time sheet step commands instruct timer indicator or cursor 408 to start or stop running until deactivated or reactivated by the director or another video production device.
  • step mark icon 406b and GPI/O mark icon 406c can be placed onto control line 404a to specify a time when timer indicator 408 would automatically stop running.
  • timer indicator 408 would stop moving across timeline 402 without the director having to manually stop the process, or without another device (e.g., a teleprompting system 108) having to transmit a timer stop command.
  • a step mark icon 406b is activated to stop timer indicator 408, timer indicator 408 can be restarted either manually by the director or automatically by another external device transmitting a step command.
  • step mark icon 406b and GPI/O mark icon 406c may be used to place a logical break between two segments on the time sheet, other words, step mark icon 406b and GPI/O mark icon 406c are placed onto control line 440a to designate segments within a video production.
  • One or more configuration files can also be associated with a step mark icon 406b and GPI/O mark icon 406c to link metadata with the designated segment.
  • Transition icons 406f-406g are associated with automation control commands for controlling video switching equipment.
  • transition icons 406f-406g can be positioned onto control lines 404b-404c to control one or more devices to implement a variety of transition effects or special effects into a video production.
  • Such transition effects include, but are not limited to, fades, wipes, DVE, downstream keyer (DSK) effects, and the like.
  • DVE includes, but is not limited to, warps, dual-box effects, page turns, slab effects, and sequences.
  • DSK effects include DVE and DSK linear, chroma and luma keyers.
  • Keyer control icon 406h is positioned on control line 404d, and used to prepare and execute keyer layers either in linear, luma, chroma or a mix thereof for preview or program output.
  • the keyers can be upstream or downstream of the DVE.
  • Audio icon 406i can be positioned onto control line 404e and is associated with commands for controlling audio equipment, such as audio mixers, digital audio tape (DAT), cassette equipment, other audio sources (e.g., CDs and DATs), and the like.
  • Teleprompter icon 406j can be positioned onto control line 404f and is associated with commands for controlling a teleprompting system to integrate a script into the timeline.
  • Character generator (CG) icon 406k can be positioned onto control line 404g and is associated with commands for controlling a CG or still store to integrate a CG page into the timeline.
  • Camera icons 4061-406n can be positioned onto control lines 404h-404j and are associated with commands for controlling the movement and settings of one or more cameras.
  • VTR icons 406p-406r can be positioned onto control lines 404k-404m and are associated with commands for controlling VTR settings and movement.
  • GPO icon 406s can be positioned onto control line 404n and is associated with commands for controlling GPI or GPO devices.
  • Encode object icon 406t can be positioned onto control line 404p and is associated with encoding commands which are described in detail below with respect to FIG. 7.
  • User mark icon 406d is provided to precisely associate or align one or more automation control icons 406a-406c and 404e-404t with a particular time value. For example, if a director desires to place teleprompter icon 406j onto control line 404f such that the timer value associated with teleprompter icon 406j is exactly 10 seconds, the director would first drag and drop user mark icon 406d onto control line 404a at the ten second mark. The director would then drag and drop teleprompter icon 406j onto the positioned user mark icon 406d. Teleprompter icon 406j is then automatically placed on control line 404f such that the timer value associated with teleprompter icon 406j is ten seconds. In short, any icon that is drag and dropped onto the user mark 406d is automatically placed on the appropriate control line and has a timer value of ten seconds. This feature helps to provide multiple icons with the exact same timer value.
  • the time sheet can be stored in a file for later retrieval and modification. Accordingly, a show template or generic time sheet can be re-used to produce a variety of different shows. A director could recall the show template by filename, make any required modifications (according to a new rundown sheet), and save the time sheet with a new filename.
  • one video production device is telepromptmg system 108 (FIG. 1) that includes a processing unit and one or more displays for presenting a teleprompting script (herein refened to as "script") to the talent
  • teleprompting systeml08 is the SCRIPT ViewerD, available from Parker Vision, Inc.
  • teleprompting system 108 can be used to create, edit, and run scripts of any length, at multiple speeds, in a variety of colors and fonts, hi an embodiment of the present invention, teleprompting system 108 is operable to permit a director to use a text editor to insert video production commands into a script (herein refened to as "script commands").
  • the text editor can be a personal computer or like workstation, or the text editor can be an integrated component of time sheet GUI 133.
  • text window 410 permits a script to be viewed, including script commands.
  • Script controls 412 are a set of graphical controls that enable a director to operate the teleprompting system and view changes in speed, font size, script direction and other parameters of the script in text window 410.
  • the script commands that can be inserted by teleprompting system 108 include a cue command, a delay command, a pause command, a time sheet step command, and an enhanced video command.
  • the present invention is not limited to the aforementioned script commands. As would be apparent to one skilled in the relevant art(s), commands other than those just listed can be inserted into a script.
  • FIG. 5 illustrates the top region of GUI 133 (FIG. 4) to provide a view of control line 404a.
  • Control line 404a is used to enter icons 406a-406d that are associated with step commands and icon alignment commands, as discussed above.
  • Another automation control icon that can be placed on control line 404a is encode mark 406e.
  • encode mark 406e operates like a Web MarkD developed by ParkerVision, Inc. During the encoding process, encode mark 406e identifies a distinct segment within a video production. As timer indicator 408 advances beyond encode mark 406e, the encoding system is instructed to index the beginning of a new segment.
  • each encode mark 406e is established by activating encode mark 406e to open a configuration GUI.
  • FIG. 6 illustrates an embodiment of an encode mark configuration GUI 600.
  • GUI 600 can be used to set the time for initiating the encoding commands associated with encode mark 406e.
  • the time can be manually entered or is automatically entered at the time of placing encode mark 406e on control line 404a.
  • GUI 600 also permits an operator to designate a name for the segment, and specify the segment type classification.
  • Segment type classification includes a major and minor classification.
  • a major classification or topic can be sports, weather, headline news, traffic, health watch, elections, and the like.
  • Exemplary minor classifications or category can be local sports, college basketball, NFL football, high school baseball, local weather, national weather, local politics, local community issues, local crime, editorials, national news, and the like.
  • Classifications can expand beyond two levels to an unlimited number of levels for additional granularity and resolution for segment type identification and advertisement targeting.
  • the properties associated with each encode mark 406e provide a set of metadata that can linked to a specific segment. These properties can be subsequently searched to identify or retrieve the segment from an archive.
  • FIG. 7 illustrates the bottom region of GUI 133 (FIG. 4) to provide a view of control line 404p.
  • Control line 404p is used to enter icons automation control icon 406t that is associated with encoded transmission commands.
  • the encoded transmission commands instructs the encoding system to start or stop the encoding process until deactivated or reactivated by an operator or another video production device.
  • Encode object icons 406t are placed on control line 404p to produce encode objects.
  • encode object icon 406t operates like Web ObjectsTM developed by from ParkerVision, Inc.
  • FIG. 8 illustrates an embodiment of a configuration GUI 800 that can be used to set the searchable properties of each encode object icon 406t.
  • start stream object 802, data object 804 and stream stop object 806 are three types of encode object icons 406t that can be used.
  • Start stream object 802 initializes the encoding system and starts the encoding process. In comparison with encode mark 406e, start stream object 802 instructs the encoding system to start the encoding process to identify a distinct show, whereas encode mark
  • auxiliary information includes graphics or text in a HTML page and is referenced in GUI 800 by its URL address.
  • Stream stop object 806 is used to stop the encoding process and designate the end of a distinct show. Once timer indicator 408 passes the stream stop object 806, the encoding system would start the post-production processes, such as, including indexing segments, cataloging segments, pacing script, and the like.
  • GUI 800 The encoding start and stop times can be manually entered into GUI 800 or automatically updated upon placement of start stream object 802, data object 804 or stop stream object 806 onto control line 404p.
  • GUI 800 also permits one to designate a show identifier, show name or description for the production. Other properties include the scheduled or projected air date and air time for the production.
  • a copyright field is provided to specify any restrictions placed on the use or re-use of a specific show or show segment.
  • a broadcasting studio may not have a license to transmit a specific content on the Internet, but may have permission to provide the content over a private network or the air waves.
  • the content can be restricted for educational uses, single broadcast, transmissions to designated clients, and the like.
  • the appropriate component of system 100 e.g., enhanced video server 115, streaming server 125, LM server 130, etc.
  • timer indicator 408 moves or passes over each encode object icon 406t (i.e., start stream object 802, data object 804 or stop stream object 806), the associated encoding commands are automatically processed.
  • encoding control region 702 provides a set of graphical controls that enable an operator to modify the encoding process.
  • the encoding graphical controls include a ready control 704, start control 706, stop control 708, and data control 710.
  • Ready control 704 has an "activate” state and "de-activate” state.
  • ready control 704 is operable to send "read” or “not read” commands to timer indicator 408 depending on whether ready control 704 is operating in an activate or de-activate state, respectively.
  • timer indicator 408 when ready control 704 is operating in an activate state, timer indicator 408 signals the encoding system to read and process the associated encoding commands as timer indicator 408 passes each encode object icon 406t and encode mark 406e.
  • ready control 704 instructs timer indicator 408 to signal the encoding system to not read the encoding commands associated with each encode object icon 406t and encode mark 406e. Therefore, when ready control 704 is de-activated, ready control 704 allows directors to perform test runs to preview a show prior to the broadcast. A preview mode is desirable to allow directors to check the show to make sure that the conect sources and transitions are selected.
  • Start control 706 is used to initiate the encoding system manually.
  • start control 706 is operable to manually override a deactivate state established by ready control 704 or stop control 708 (discussed below).
  • Start control 706 can be used to manually activate the encoding process to send video streams to streaming server 125 that contain time-sensitive production elements, such as a breaking news element, or other manually prepared video productions.
  • Stop control 708 is operable to deactivate the encoding process and stop transmissions to streaming server 125. Stop control 708 would deactivate an encoding process initiated by either ready control 704 or start control 706. Stop control 708 provides directors with the ability to stop the encoding system manually to avoid airing any unauthorized content as an example.
  • Data control 710 is used to enter auxiliary information and link the information to a specific segment or an entire show.
  • the auxiliary information is entered by typing the URL reference in reference window 712 and activating data control 710. Accordingly, auxiliary information can be entered via the configuration GUI 800 for data object 804 or reference window 712.
  • Data control 710 enables directors to enter URLs at any time during manual operations.
  • GUI 133 of FIG. 4 is a user-friendly graphical interface that enables the director (i.e., video director 135 from FIG. 1), or other personnel, to interact with the control system and make timely edits and revisions to the production as it is being filmed, videotaped, or broadcast.
  • the time sheet includes a horizontal timeline 402 and one or more horizontal control lines 404a-404p.
  • the time sheet section of GUI 133 provides the video director (or user) with a more efficient way of maneuvering around the time sheet. This is accomplished by allowing the user to group and/or manipulate elements (or icons) on different levels, increase the speed at which elements are triggered from the time sheet and increase the user's flexibility to define a custom time sheet view.
  • Hierarchical Grouping a series of layered collections of objects (e.g., icons 406a-406t discussed above) within a system.
  • Object - a single icon or element dropped onto the timeline or time sheet of GUI 133.
  • Example icons are GP I O mark icon 406c, a DVE icon, audio icon 406i, and so forth.
  • TME Transition Macro Elements
  • Page - a collection of one or more TME's on the time sheet.
  • Newsroom systems may define a page as a single line on the rundown or as a unique slug within the rundown.
  • Story a collection of one or more pages on the time sheet.
  • a single line or slug or multiple lines or slugs may make up a story.
  • Input from the user at some point may be entered.
  • Layout maintains user definable time sheet views (visible rows, grouping view), LBN pages, Camera Preset hotkeys, CG/SS hotkeys, the Switcher Layout, Audio Layout (Audio Presets, Page Setup, Aux Setup, Channel Setup), position and visibility of GUI windows.
  • Layer Handles - a graphical bar displayed on the time sheet that conesponds to a "Layer", which gives the ability to grab and maneuver the specific "Layer”.
  • ITME Intelligent Transition Elements
  • Class ID (Major ID) - defines the module with which the present invention will communicate. (DVE, Audio, Keyers, ScriptViewer, Cameras, Machine Control, CG/SS, GPO, Web, etc.). NCS (Newsroom Computer System) - the newsroom management software that creates show rundowns. The rundowns become the running order of stories and events within a show.
  • Rundown Converter the intelligent intermediary between a NCS and video production system 100 (FIG. 1).
  • the present invention defines a hierarchy of at least five (5) group levels for time sheet of GUI 133.
  • the hierarchy of the group levels is illustrated in FIG. 9.
  • FIG. 9 illustrates that the object level is at the bottom of the hierarchy and the show level is at the top of the hierarchy. Moving from the object level to the show level, the other levels include a TME level, a page level and a story level. This hierarchy is further illustrated in FIG. 10.
  • FIG. 10 illustrates that one or more objects (or icons) make up a TME, one or more TMEs make up a page, one or more pages make up a story and one or more stories make up a show.
  • the present invention provides for group level GUIs that illustrate each of these group layers in the time sheet of GUI 133.
  • the group layer GUIs are illustrated in FIGs. 11-14.
  • Object group layer GUI is illustrated in FIG. 11.
  • TME group layer GUI is illustrated in FIG. 12.
  • Page group layer GUI is illustrated in FIG. 13.
  • Story group layer GUI is illustrated in FIG. 14.
  • an object or icon
  • the time sheet it is by default a member of all group layers.
  • the object that is dropped is part of the object, TME, page, story and show layers. Additional objects can be placed within any level above the object level.
  • An object dropped in the previous object layer, TME layer is a member of the first object layer, TME layer, page layer, story layer and show layer.
  • An object dropped in the previous object layer, page layer is a new TME layer, but a member of the first object layer, page layer, story layer and show layer.
  • Objects can be gathered under the TME level, TME's can be gathered under the page level, pages an be gathered under the story level, and everything is under the show level.
  • a show is the container for everything, which can be divided into various stories.
  • a story can contain multiple page layers, a page layer can contain multiple TME layers, and a TME layers can contain multiple object layers.
  • the present invention provides graphical layer handles for easier manipulation of the TME, page and story group layers. Referring to FIG. 12 and example TME layer GUI, two handles are illustrated including handle 1202 and handle 1204. In FIG. 13 and example page layer GUI, two handles are illustrated including handle 1302 and handle 1304. In FIG. 14 and example story layer GUI, one handle 1402 is illustrated.
  • Each handle shown in FIGs. 12-14 is a graphical bar that stretches from the beginning to the end of the layer. In an embodiment of the invention, a handle should not extend beyond the right edge of the layer.
  • the handles in the page layer may be titled with the slug name from the newsroom system for that page. For example, in FIG. 13, the slug name for handle 1302 is "A01-
  • handle 1304 is "A02- America at War.”
  • a TME layer in the time sheet of GUI 133 can be "grabbed” and manipulated from anywhere in the TME layer. Labels can be placed on any control line 404a-404p (FIG. 4) of the time sheet. In an embodiment of the invention, a handle should not extend beyond the right edge of the TME layer.
  • the present invention provides a number of grouping rules.
  • One rule is that the left edge of a TME layer, the page layer and the story layer are the same.
  • Another rule is that like layers do not overlap. For example, a TME layer should not overlap another TME layer.
  • a page layer should not overlap another page layer.
  • a story layer should not overlap another story layer.
  • Another rule is that any object placed in a TME layer is always at least one frame to the right of the left edge of the TME layer.
  • Yet another rule is all prep (pre-process) times to the left of an object extend the TME layer to the left (the number of frame for prep + 1 frame).
  • Another rule is that TME layers are spaced two (2) frames apart by default. The minimum spacing is one frame.
  • the present invention also allows for user definable TME layer spacing settings. Another rule is that page and story layers are spaced three (3) frames apart by default. The minimum spacing is one frame.
  • the present invention also allows for user definable page and story layer spacing settings.
  • the present invention is not limited to the aforementioned rules. As would be apparent to one skilled in the relevant art(s), rules other than those just listed may be enforced by the invention. The time sheet setup provided by the present invention is described next.
  • a goal of the present invention is to provide the user with the maximum flexibility to define the look and layout of the time sheet of GUI 133.
  • the present invention provides this maximum flexibility without negatively affecting the performance of video production system 100 (FIG. 1) and/or requiring the user to make massive manual changes to a large library of
  • the time sheet setup includes, but is not limited to, four dialogs. These dialogs: (1) a timeline speed dialog; (2) a time sheet row setup dialog; (3) a time sheet layout setup dialog; and (4) a time sheet pre-process ("prep") setup dialog. Each of these are described in more detail below.
  • the timeline speed dialog includes a slider control that allows the user to change the speed at which timer indicator 408 travels across timeline 402
  • the time sheet includes a horizontal timeline 402 and one or more horizontal control lines 404a-404p.
  • Automation control icons 406a-406t are positioned onto control lines 404a-404p at various locations relative to timeline 402, and configured to be associated with one or more video production commands and at least one video production device.
  • the present invention provides a time sheet row setup dialog that includes three lists, as described with reference to FIG. 15.
  • the time sheet row setup dialog may be password protected.
  • time sheet row setup dialog 1500 includes three main lists. These three lists include a major LD list 1502, a cunent row order list 1504 and a new row order list 1506. Cunent row order list 1504 includes two columns, a row number 1508 and an icon 1510. New row order list 1506 also includes two columns, a row number 1512 and an icon 1514. Each of these are described in more detail next.
  • Major LO list 1502 contains icons representing each class LD (or major LD) with which a row can be assigned (e.g., class Ids for TME building).
  • Cunent row order list 1504 includes the row number 1508 and icon 1510 columns.
  • New row order list 1506 includes the row number 1512 and icon 1514 columns.
  • the user may drag icons from the major LD list 1502 and drop them on the new row order list 1506.
  • the user may drag icons from the cunent row order list 1504 and drop them on the new row order list 1506.
  • the user may also create a row when an icon is dragged from the major LD list 1502 and dropped on the new row order list 1506.
  • the icon is automatically placed in the first available list index of column icon 1504 and the row number is assigned based on its position in the list.
  • the icon When a user drags an icon (or item) from the cunent row order list 1504 and drops it on the new row order list 1506 (and not on an existing icon in new row order list 1504), the icon is placed at the same list index as the list index in the cunent row order list 1504. In addition, the icon is automatically "mapped" cunent row order to new row order.
  • At least one list icon for each active TME building class ID should be created (e.g., DNE, audio, keyers, script viewer, cameras, machine control, CG/SS, GPO, web, and so forth).
  • the present invention allows the user to replace a row in time sheet row setup dialog 1500 if an icon from major ID list 1502 is dropped on an assigned list icon that is not "mapped.” Here, the dropped icon replaces the existing icon.
  • a warning dialog may appear to inform the user that mapped icon cannot be replaced.
  • the present invention allows the user to delete a row in time sheet row setup dialog 1500 by right clicking on a icon in column icon 1514 in new row order list 1506 and then by executing a "delete row command.”
  • a row is deleted, all non-mapped icons below the deleted row are re-ordered by filling in the available non-mapped rows.
  • the user can insert a row in time sheet row setup dialog 1500 by right clicking on a icon and then by executing a "insert row command.”
  • all non-mapped icons re-order down filling in the available non-mapped rows.
  • a warning message may appear to warn the user that mapped rows cannot be moved.
  • the user can move rows in time sheet row setup dialog 1500 by holding the left button of the mouse to drag an icon.
  • the dragged icon is dropped onto another non-mapped row, the icon dropped (if not mapped) and all non-mapped icons below it re-order.
  • the dragged icon replaces the dropped icon. If a list icon is dragged and dropped onto an empty row, then that icon is placed on that row.
  • the present invention also allows for row mapping in time sheet row setup dialog 1500.
  • icons are dragged from cunent row order list 1504 to new row order list 1506, the mapping is automatic since the row placement is the same.
  • the user may hold the left button of the mouse down to drag an icon from the cunent row order list 1504 and drop it on the row in the new row order list 1506 that the user wishes to associate the icon with.
  • the color of the row number entry that is affected is changed to red (or any other predetermined color) and this indicates it is no longer available for selection.
  • the present invention then draws a line from the cunent row order list icon to the new row order list icon to indicate the mapping relationship. Once an icon in either list is mapped, that icon is no longer available to be mapped to any other icon.
  • any mapped icon from the cunent row order list 1504 or the new row order list 1506 and right mouse click to select the "re-map row command."
  • the line connecting the two icons is erased and the color of the affected row number entry is changed from red to black (or any other predetermined color).
  • the relationship between the two icons is severed and each icon is available to be re-mapped.
  • step 1602 An example operation of the present invention upon receiving a command from the user to exit time sheet row setup dialog 1500 is illustrated in the flowchart of FIG. 16.
  • step 1602 the user sends a command to exit the time sheet row setup dialog 1500. Control then passes to step 1604.
  • step 1604 the present invention determines whether changes were made to the lists in the time sheet row setup dialog 1500.
  • the lists include major LD list 1502, cunent row order list 1504 and new row order list 1506. If the outcome of step 1604 is negative, then control then passes to step 1606 where the time sheet row setup dialog 1500 is closed. At this point the flowchart in FIG. 16 ends. Alternatively, if the outcome of step 1604 is positive, then control passes to step 1608.
  • step 1608 the present invention checks a 'new row grid' to ensure that at least one row in the lists of time sheet row setup dialog 1500 has been created for every active TME building class LD. Control then passes to step 1610.
  • step 1610 the present invention checks the row mapping to ensure all cunent row order list icons (i.e., column icon 1510) have been mapped to new row order list icons (i.e., column icon 1514). Control then passes to step 1612. In step 1612, if all cunent row order list icons have been mapped to new row order list icons, then control passes to step 1606 where the time sheet row setup dialog 1500 is closed. The flowchart in FIG. 16 ends at this point. Alternatively, control passes to step 1614. In step 1614, a warning message is given that not all rows have been mapped.
  • the TME library may be affected if all current row order list icons are not either mapped or deleted.
  • control passes to step 1616.
  • step 1616 if the user wants to delete all unmapped cunent row order list icons, the control passes to step 1618 where all unmapped cunent row order list icons are deleted and the flowchart in FIG. 16 ends. Alternatively, control passes to step 1620.
  • step 1620 the user is returned to the time sheet row setup dialog 1500 to map any unmapped cunent row order list icons.
  • FIG. 16 ends at this point.
  • the present invention assigns a new row setup GUID. Once the new row setup GUID is assigned, the present invention opens a dialog to update the TME library. The update begins and the TME Library is searched. Each object, using the "new row order" map, replaces the old row number with the new row number and replaces the old Row Setup GULD with the new Row Setup GUID. If the old row number was not mapped to the New Row Order, then the object is deleted from the TME. Upon completion of the TME Library update, the user is prompted, "Do you wish to update another TME Library?"
  • the time sheet layout setup dialog of the present invention allows the user to define: (1) the spacing of TMEs, pages and stories; (2) visible rows on the time sheet of GUI 133; (3) the layering view of the object, TME, page and story group levels; (4) the LBN pages loaded; (5) the camera preset hot keys loaded; (6) the CG/SS hot keys loaded; (7) the switcher layout; (8) the audio layout (audio presets, page setup, aux setup, channel setup); (9) the position and visibility of the different GUI windows, and so forth.
  • the present invention is not limited to the aforementioned features of the time sheet layout setup dialog.
  • Time sheet layout setup dialog 1700 includes a table 1702 entitled "row view" that includes a three-column list.
  • the three-column list includes a hide row 1704, a row number 1706 and an icon 1708.
  • Dialog 1700 also includes a check box 1710 to allow the user to save the layout with a default window position, i addition, dialog 1700 includes a check box 1712 to allow the user to save the layout with the cunent window positions. Dialog 1700 also includes a check box 1714 to allow the user to save the layout.
  • the present invention allows the user to check the "hide row” box (in hide row 1704) for each row (in row number 1706) the user wishes to hide in the time sheet of GUI 133.
  • the user can un-check the "hide row” box for each row the user wants visible in the time sheet of GUI 133.
  • dialog 1700 includes a check box 1710 to allow the user to save the layout with a default window position, a check box 1712 to allow the user to save the layout with the cunent window positions, and a check box 1714 to allow the user to save the layout.
  • a switcher module can load a switcher setup file
  • an audio module can load an audio setup file
  • a LBN module can load LBN pages
  • a camera preset module can load camera preset pages, and so forth.
  • video production system 100 FIG. 1
  • default setup files are loaded for each module.
  • a setup file for each module's current setup is saved with the same name as the layout file name.
  • the current row view is saved with the layout and, depending on which option is selected (Save Layout with default window positions or Save Layout with cunent window positions), the modules (position and visibility) is saved with the layout.
  • the user may recall a layout by selecting a File/Load Layout menu.
  • the invention allows the user to locate and select a layout to load.
  • the fourth dialog included in the time sheet setup is described next.
  • the timeline prep setup allows the user to assign the left edge trigger for prep (pre-process) objects or icons.
  • An embodiment of the timeline prep setup dialog 1800 is shown in FIG. 18 and includes a text box 1802 and a combo box 1804.
  • Text box 1802 contains the prep number (the number of frames to the left of the icon in time sheet of GUI 133 that pre-process will occur).
  • Combo box 1804 contains a list of icons that are defined to have prep (pre-process) attributes. One prep number can be assigned for all prep objects by selecting "ALL" in the first selection in the list. Examples of prep icons include, but are not limited to, a digital video effects device (DVE) icon (not shown in FIG. 4) and the keyer control icon 406h (FIG. 4). Time sheet views of the present invention are described next.
  • DVE digital video effects device
  • the time sheet includes a horizontal timeline 402 and one or more horizontal control lines 404a-404p.
  • Automation control icons 406a-406t are positioned onto control lines 404a- 404p at various locations relative to timeline 402, and configured to be associated with one or more video production commands and at least one video production device.
  • the time sheet of GUI 133 provides user selectable and definable views of the time sheet (e.g., user layouts).
  • the present invention provides at least two different view property types, including grouping views and visible rows.
  • the user can resize the time sheet window to see more rows.
  • three rows in the time sheet are fixed.
  • a GPI-Slug row is fixed at the top of the time sheet window.
  • the layer handles are fixed at the bottom of the time sheet window. (See, for example, FIG. 12 and example TME layer GUI that illustrates two handles, handle 1202 and handle 1204, located at the bottom of the time sheet window.)
  • the TME label row is typically fixed above the group handle row. This example embodiment of fixed rows is not meant to limit the invention.
  • time sheet rows typically have a height of 32 pixels. Typically, sixteen (16) rows can be seen in the default window size of the time sheet. If there are more visible rows than can be seen in the time sheet window, then the time sheet window can be scrolled from top to bottom with a scroll bar. All rows in the time sheet scroll except for the fixed rows.
  • This example embodiment of the present invention is not meant to limit the invention. As would be apparent to one skilled in the relevant art(s), other time sheet views other than those listed could be provided.
  • the number and position of rows can be assigned. Each assigned row can be visible or hidden from view.
  • the visible rows are assigned in time sheet setup and stored with the user layout.
  • the present invention allows the user at any time to see all rows in the time sheet. The user can right mouse click anywhere on the time sheet to see the popup menu. Depending on the cunent view, either "Show Hidden Rows” or "Hide Rows” will be available for selection. If rows are hidden and the user selects "Show All Rows," all rows are painted to the time sheet in GUI 133. If all rows are visible in the time sheet and rows are selected by the user to be hidden in time sheet setup, and the user selects "Hide Rows,” then only viewable rows are painted to the time sheet of GUI 133.
  • the time sheet of the present invention provides user-selectable layering views. The different views of the time sheet are based on the layer levels described above with reference to FIGs. 10-14.
  • FIG. 10 illustrates that one or more objects make up a TME, one or more TMEs make up a page, one or more pages make up a story and one or more stories make up a show.
  • the present invention provides for group level GUIs that illustrate each of these group layers in the time sheet of GUI 133.
  • the group layer GUIs are illustrated in FIGs. 11-14.
  • Object group layer GUI is illustrated in FIG. 11.
  • TME group layer GUI is illustrated in FIG. 12.
  • Page group layer GUI is illustrated in FIG. 13.
  • Story group layer GUI is illustrated in FIG. 14.
  • FIG. 19 illustrates another embodiment of the page group layer GUI.
  • the objects or icons are always visible on the time sheet, but the colored grouping levels seen on the time sheet will change with each view (TME, page or story). For example, the TME view will show the TME layer, the page view will show the page layer, and the story view will show the story layer. Operation of the time sheet is described next. G. Time Sheet Operation
  • FIG. 4 Various automation control icons 406a-406t were described above with reference to FIG. 4. These icons included label icon 406a, step mark icon 406b, general purpose input/output (GPI/O) mark icon 406c, user mark icon 406d, encode mark 406e, transition icons 406f-406g, keyer control icon 406h, audio icon 406i, teleprompter icon 406j, character generator (CG) icon 406k, camera icons 4061-406n, VTR icons 406p-406r, GPO icon 406s and encode object icon 406t. Additional embodiments of some of these icons will be described next, along with new icons not described with reference to FIG. 4.
  • GPI/O (general purpose input/output) mark icon 406c is associated with time sheet step commands.
  • the time sheet step commands instruct timer indicator 408 to start or stop running until deactivated or reactivated by the director or another video production device.
  • the default GPI number is one.
  • a GPI/O mark icon property page includes a time control with the GPI/O mark timeline position number.
  • the timeline position number is in time. The time is typically in hours/minutes/seconds/frames (hh/mm/ss/ff).
  • the GPI/O mark icon property page also includes a combo box to select the triggering GPI/O number.
  • the jump mark icon (not shown in FIG. 4) is similar to step mark icon 406b.
  • timer indicator 408 hits a jump mark icon it jumps to the next
  • a GPI mark property page includes a time control with the jump mark timeline position number.
  • the timeline position number is in time. The time is in hours/minutes/seconds/frames (hh/mm ss/ff) .
  • a DVE (digital video effects device) mark icon has three triggers that include a prep (pre-process), a trans (process) and a post (post-process).
  • Prep pre-process occurs (a user definable number of frames) to the left of the left edge of the DVE mark icon.
  • Trans processing occurs at the left edge of the DVE mark icon.
  • the user definable prep number can be a global prep number or individually assigned number for each time sheet icon type. Typically, the minimum number is two (2) frames. The typical default prep number is ten (10) frames.
  • DVE mark icon pre-process only occurs if the previous DVE mark icon, for the same DVE, has completed its duration. The prep commands are buffered. When the previous DVE mark icon completes its transition, the prep commands are sent.
  • the items that are prepped may include: DVE process effects for the assigned DVE button; video switches for the assigned fields (program, preview, auxl, aux2, preview keyers fill, preview keyers hole); and preview keyers turn (on or off) at prep.
  • the DVE trans occurs at the left edge of the DVE mark icon. The DVE trans can only occur after prep is completed. A left mouse double click on the DVE mark icon opens the DVE property page. d. Keyer Icon
  • Keyer icons have three triggers, prep (pre-process) and trans (process) and (post process).
  • Prep occurs a user definable number of frames to the left of the left edge of the keyer icon.
  • Trans occurs at the left edge of the keyer icon.
  • the items that at prep include video switches for the assigned fields (aux keyers background, aux keyers fill, aux keyers hole, DSK keyers fill, DSK keyers hole).
  • the items that occur at trans include: aux keyers turn (on or off) at trans; DSK keyers turn (on or off) at trans and video switches to the aux video outs occur at trans.
  • audio icon 406i can be positioned onto control line 404e and is associated with commands for controlling audio equipment, such as audio mixers, digital audio tape (DAT), cassette equipment, other audio sources (e.g., CDs and DATs), and the like. Audio icons trigger on the left edge of the audio icon. A left mouse double click on the audio icon opens the audio property page.
  • audio equipment such as audio mixers, digital audio tape (DAT), cassette equipment, other audio sources (e.g., CDs and DATs), and the like.
  • Audio icons trigger on the left edge of the audio icon. A left mouse double click on the audio icon opens the audio property page.
  • Script viewer icons trigger on the left edge of the script viewer icon.
  • a left mouse double click on the script viewer icon opens the script viewer property page.
  • CG/SS icons trigger on the left edge of the CG/SS icon.
  • a left mouse double click on the CG/SS icon opens the CG/SS property page.
  • Machine control icons trigger on the left edge of the machine control icon.
  • a left mouse double click on the machine control icon opens the machine control property page.
  • Camera preset icons trigger on the left edge of the camera preset icon.
  • a left mouse double click on the camera preset icon opens the camera preset property page.
  • GPO icon 406 is associated with commands for controlling GPI or GPO devices.
  • GPO icons trigger on the left edge of the GPO icon.
  • a left mouse double click on the GPO icon opens the GPO property page.
  • a timer (not shown) is integrated into timeline 402, and operable to activate a specific automation control icon 406a-406t as a timer indicator or cursor 408 travels across timeline 402 to reach a location linked to the specific automation control icon
  • the timer indicator may be controlled via GUI controls, keyboard controls, GPI inputs and an optional shot box.
  • Cursor controls include play, cue, stop, next/previous GPI, next/previous TME, next page, and next story. Each of these are described next with example GUI buttons in FIG. 20. It is important to note that the example GUI buttons in FIG. 20 are for illustration purposes only and are not meant to limit the invention. a. Play
  • Timer indicator 408 starts when a GUI Play Button 2002 is pressed. Timer indicator 408 may also start when the (Alt and Spacebar keys) on the keyboard are pressed. When timer indicator 408 stops at a GPI mark, timer indicator 408 starts when it receives a GPI input. Timer indicator 408 also starts when a ShotBox Play Button is pressed.
  • Timer indicator 408 jumps back to the beginning of timeline 402 when the Alt key on the keyboard and a GUI Cue Button 2004 are pressed. Timer indicator 408 jumps back to the beginning of timeline 402 when the Alt C keys on the Keyboard are pressed. When timer indicator 408 is cued, it automatically stops before jumping back to the beginning of timeline 402.
  • Timer indicator 408 stops when a GUI Stop Button 2006 is pressed. Timer indicator 408 stops when the Alt S key on the Keyboard is pressed.
  • Timer indicator 408 stops at GPI marks.
  • Timer indicator 408 only skips to the next GPI mark when timer indicator 408 is stopped.
  • timer indicator 408 jumps to the next GPI mark on timeline 402. None of the timeline icons jumped over are executed.
  • the Previous G Button 2016 is pressed, timer indicator 408 jumps to the previous GPI mark on timeline 402. None of the timeline icons (or objects) jumped over are executed.
  • ShotBox will have Next and Previous Buttons to advance timer indicator 408 to the next or previous GPI mark.
  • Timer indicator 408 only skips to the next TME when timer indicator 408 is stopped.
  • timer indicator 408 jumps to the left edged of the next TME on timeline 402. None of the timeline icons jumped over are executed.
  • timer indicator 408 jumps to the left edge of the previous TME on timeline 402. None of the timeline icons jumped over are executed.
  • the ShotBox will have Next and Previous Buttons to advance timer indicator 408 to the next or previous TME.
  • Timer indicator 408 only skips to the next page when timer indicator
  • timer indicator 408 is stopped.
  • timer indicator 408 jumps to the left edged of the next page on timeline 402. None of the timeline icons jumped over are executed.
  • timer indicator 408 jumps to the left edge of the previous page on timeline 402. None of the timeline icons jumped over are executed.
  • the ShotBox will have Next and Previous Buttons to advance timer indicator 408 to the next or previous page.
  • Timer indicator 408 only skips to the next story when timer indicator 408 is stopped.
  • timer indicator 408 jumps to the left edged of the next story on timeline 402. None of the timeline icons jumped over are executed.
  • timer indicator 408 jumps to the left edge of the previous story on timeline
  • the ShotBox will have Next and Previous Buttons to advance timer indicator 408 to the next or previous story.
  • the timeline speed is adjustable by the user within a range.
  • the timeline speed can be adjusted only when timer indicator 408 is stopped.
  • the spacing relationship between timeline icons has a direct relationship to timer indicator 408 speed. When the timeline speed is adjusted, the spacing of timeline icons must be adjusted as well.
  • the timeline speed dialog can be accessed from the timeline setup dialog.
  • the dynamic time sheet feature of the present invention increases the amount of information with regard to the relationship between icons or group levels on the time sheet.
  • features of the present invention that relate to the dynamic time sheet include, but are not limited to, dynamic links, intelligent transition macro elements (ITME), TME replacement, auto-channel, global macro changes, and conflict identification.
  • ITME intelligent transition macro elements
  • TME replacement
  • auto-channel auto-channel
  • global macro changes global macro changes
  • conflict identification Each of these features are described next with reference to a Newsroom Computer System (NCS).
  • NCS Newsroom Computer System
  • newsroom management software creates show rundowns. This rundown becomes the running order of stories and events within a show.
  • a rundown converter is the intelligent intermediary between a NCS and video production system 100 (FIG. 1).
  • the NCS is utilized for illustration purposes only and is not meant to limit the invention.
  • a dynamic link is maintained with the NCS rundown.
  • the time sheet of the present invention is updated with the changes.
  • the rundown converter module will maintain the link between the NCS rundown and the time sheet.
  • the first rundown convert occurs when the user checks a show in the rundown converter dialog.
  • a dynamic link is maintained between the rundown converter module, the NCS and the time sheet until the rundown is unchecked.
  • the dynamic time sheet has three modes of operation, including an automatic time sheet update mode, a manual time sheet update mode, and a no time sheet update mode. Each of these modes are discussed next.
  • the rundown converter module may be set to update the time sheet automatically.
  • rundown converter automatically updates the time sheet.
  • the rundown converter module may be set to update the time sheet manually.
  • rundown converter alerts the time sheet that a change has been made, but the time sheet is not updated until the user accepts the changes.
  • no time sheet update mode no changes or alerts are sent to the time sheet.
  • the present invention provides a rundown converter dialog that consists of a tree view and a setup menu.
  • An example rundown converter dialog is shown in FIG. 21.
  • the rundown server setup dialog is used to build the list of available rundowns in the NCS.
  • TME Transition Macro Elements
  • ITME are TME's with built in link rules of operation. These relational instructions, in addition to icon mapping, are used by an interface to the time sheet to make the necessary changes to appropriate linked icons.
  • the time sheet of the present invention can use the same set of build rules used by TME builder. 3. TME Replacement
  • TME GUID When a TME is saved, a TME GUID is stored with the TME. If the user wishes to replace all TMEs with the same TME GUID, the user may right click on the mouse and select "Replace TME.” A dialog opens to select the TME to replace the existing TME and all TMEs on the time sheet with the same TME GUID.
  • the auto-channel feature of the present invention automatically assigns server channels from a pool of server channels. Each time a server load command is encountered, the auto-channel module would find the next available server channel and make the necessary changes within the appropriate icons based on the ITME instructions. Auto-channel can only pool channels from the same device. Multiple channels may be connected to the same media. When setting up the port for a server device, it can be designated as a pooled device. When the time sheet encounters a pooled device load command identified by its GULD, the auto-channel module would assign the next available channel for that device. Each time a channel is assigned, the interface increments to the next channel. When the last channel in the pool of assigned channels is assigned, the interface resets to the first channel. When the channel is assigned, the auto-channel module uses the ITME link instructions to populate the appropriate time sheet icons.
  • Another feature of the dynamic time sheet of the present invention is the ability to make global changes across the time sheet. This involves replacing a non-linked source with another source, wherever encountered on the time sheet. An example of a desire for a global change would occur if
  • the present invention provides a set of global rules that comprise known production or system violations that produce on-air mistakes. For example, if a camera is on-air and the time sheet encounters a camera preset that is different from the last camera preset issued for that camera, then an enor message should be given. In another example, if a tape or sever machine is on-air and the time sheet encounters a tape or server cue command, then an enor message should be given. A further example is if a CG channel is on-air and the time sheet encounters a CG command for that CG channel, then an enor message should be given. These global rules are provided for illustration purposes only and are not meant to limit the invention.
  • ELA Enhanced Time Sheet Look Ahead
  • the ETLA (enhanced time sheet look ahead) feature of the time sheet is designed to act on (e.g., select time sheet icons) as soon as those icons are free from their cunent operation.
  • the ETLA operation is seamless to the end user, because the operational rules are built into the time sheet.
  • Some of the benefits of the ETLA feature of the present invention includes icon status for future conflict (identification or resolution); it guarantees no unwanted on-air cueing; it provides for a tighter, faster show pace due to pre-load media; and it provides for a visually clearer time sheet due to better-defined group level separation.
  • ETLA Enhanced Time sheet Look Ahead
  • ETLA the process in which the time sheet searches ahead to the right of the timer indicator looking for ETLA icons to trigger.
  • ETLA Search the point at which the time sheet begins looking for the next ETLA icon to trigger. Done - when an icon is no longer on-air or needed for a particular
  • TME or story There are multiple levels of Done. They include: TME Done - when timer indicator 408 steps past the first GPI Mark in the next TME; Page Done - when timer indicator 408 steps past the first GPI Mark in the next page; and Story Done - when timer indicator 408 steps past the first GPI mark in the next story.
  • ETLA icons include, but are not limited to, a camera preset icon, a still store load icon, a VTR cue icon and a server load icon.
  • the ETLA Search is done at different levels, with a set of boundaries. The boundaries are determined by which time sheet groups levels (TME, Story) the ETLA icons reside.
  • the first ETLA search begins when timer indicator 408 stops at the first GPI mark on the time sheet. Each time timer indicator 408 advances past the first GPI mark of a new TME, a search begins.
  • the first occurrence of each ETLA icon i.e., camera preset, still store load, VTR cue, server load
  • VTR cue, server load i.e., camera preset, still store load, VTR cue, server load
  • an ETLA icon is part of the TME group when the ETLA search begins, then that ETLA icon type is not searched for until timer indicator 408 passes the first GPI mark of the next TME.
  • the ETLA search does not extend beyond the cunent story.
  • the page group level if an ETLA icon is part of the page level when the ETLA search begins, then that ETLA icon type is not searched for until timer indicator 408 passes the first GPI mark of the next page.
  • the story group level if an ETLA icon is part of the story level when the ETLA search begins, then that ETLA icon type is not searched for until timer indicator 408 passes the first GPI mark of the next story.
  • an ETLA search will look for ETLA icons until it reaches the end of the show level.
  • ETLA rules For example, one ETLA rule states that no ETLA icon is triggered (executed) if the icons associated source is on-air. Another rule is that all ETLA icons are triggered (executed) on left edge of the icon, if the (Preset, ID, Timecode, Clip ID) is different from the last loaded (Preset, ID, Timecode, Clip ID) for that device or device channel and the icons associated source is not on-air.
  • the first search begins when timer indicator 408 stops at the first GPI mark on the time sheet.
  • timer indicator 408 passes the first GPI mark of a new TME.
  • LBN insertion when the LBN is dropped on the time sheet, the search begins to the right of timer indicator 408.
  • time sheet jump when timer indicator 408 is moved by jumping to the next (TME, Page, Story) or time sheet bar jumping, the search begins to the right of timer indicator 408.
  • the ETLA search begins.
  • the first occunence of each ETLA icon type, to the right of timer indicator 408, is searched for on the time sheet.
  • the boundaries of the search for each ETLA icon is set by the group level of each icon. Since timer indicator 408 rests in the first TME and the camera preset ETLA icon is part of that TME, that icon is not searched for on the rest of the time sheet at this point.
  • the first ETLA icon found to the right of timer indicator 408, not in the cunent TME, is the "VT1 Load Clip" icon. Since this is the next occurrence of this icon and "NIT" is not on-air, the clip is loaded.
  • the next ETLA icon found to the right of timer indicator 408 is the camera 3 preset. The camera 3 preset is sent and the search ends for this icon type.
  • the next ETLA icon found to the right of timer indicator 408, is the "VT2 Load Clip” icon. Since this is the next occunence of this icon and "NT2" is not on-air, the clip is loaded. The search ends for this icon type.
  • the graphical time sheet view 2300 in FIG. 23 is a different way of representing the events on the time sheet. Instead of rows and icons, the time sheet would consist of a graphical representation of the events output. For example if the event was an OTS (Over the shoulder) TME, then the graphical representation would contain an image to represent the camera shot position and an image to represent the OTS Graphic. Control icons to control the different icons make up an event. For example, a V - button may be used to control the video switching, an A- button may be used to control the audio switching, a P - button may be used to control the camera preset, and a M - button may be used to control the device of the OTS.
  • OTS Over the shoulder
  • Control icons to control the different icons make up an event. For example, a V - button may be used to control the video switching, an A- button may be used to control the audio switching, a P - button may be used to control the camera preset, and a M - button may be used to control the device of the O
  • the computer system 300 includes one or more processors, such as processor 304.
  • the processor 304 is connected to a communication infrastructure 306 (e.g., a communications bus, crossover bar, or network).
  • a communication infrastructure 306 e.g., a communications bus, crossover bar, or network.
  • Computer system 300 can include a display interface 302 that forwards graphics, text, and other data from the communication infrastructure 306 (or from a frame buffer not shown) for display on the display unit 330.
  • Computer system 300 also includes a main memory 308, preferably random access memory (RAM), and can also include a secondary memory
  • the secondary memory 310 can include, for example, a hard disk drive 312 and/or a removable storage drive 314, representing a floppy disk drive, a magnetic tape drive, an optical disk drive, etc.
  • the removable storage drive 314 reads from and/or writes to a removable storage unit 318 in a well-known manner.
  • Removable storage unit 318 represents a floppy disk, magnetic tape, optical disk, etc. which is read by and written to removable storage drive 314.
  • the removable storage unit 318 includes a computer usable storage medium having stored therein computer software and/or data.
  • secondary memory 310 can include other similar means for allowing computer programs or other instructions to be loaded into computer system 300.
  • Such means can include, for example, a removable storage unit 322 and an interface 320. Examples of such can include a program cartridge and cartridge interface (such as that found in video game devices), a removable memory chip (such as an EPROM, or PROM) and associated socket, and other removable storage units 322 and interfaces 320 which allow software and data to be transfened from the removable storage unit 322 to computer system 300.
  • Computer system 300 can also include a communications interface 324.
  • Communications interface 324 allows software and data to be transfened between computer system 300 and external devices. Examples of communications interface 324 can include a modem, a network interface (such as an Ethernet card), a communications port, a PCMCIA slot and card, etc.
  • Software and data transfened via communications interface 324 are in the form of signals 328 which can be electronic, electromagnetic, optical or other signals capable of being received by communications interface 324. These signals 328 are provided to communications interface 324 via a communications path (i.e., channel) 326. This channel 326 carries signals 328 and can be implemented using wire or cable, fiber optics, a phone line, a cellular phone link, an RF link and other communications channels.
  • “computer usable medium” are used to generally refer to media such as removable storage drive 314, a hard disk installed in hard disk drive 312, and signals 328. These computer program products are means for providing software to computer system 300. The invention is directed to such computer program products.
  • Computer programs are stored in main memory 308 and/or secondary memory 310. Computer programs can also be received via communications interface 324. Such computer programs, when executed, enable the computer system 300 to perform the features of the present invention as discussed herein. In particular, the computer programs, when executed, enable the processor 304 to perform the features of the present invention. Accordingly, such computer programs represent controllers of the computer system 300.
  • the software can be stored in a computer program product and loaded into computer system 300 using removable storage drive 314, hard drive 312 or communications interface 324.
  • the control logic when executed by the processor 304, causes the processor 304 to perform the functions of the invention as described herein.
  • the invention is implemented primarily in hardware using, for example, hardware components such as application specific integrated circuits (ASICs).
  • ASICs application specific integrated circuits
  • the invention is implemented using a combination of both hardware and software.
  • Another aspect of the invention involving an autokeying method, system and computer program product is described next with reference to FIGs. 24-36. L. Autokeying
  • the present invention comprises various techniques and/or methodologies for monitoring, altering, and updating the operating state of a plurality of keying systems.
  • the operating state determines, inter alias, if a keying system is currently keying content for air, keying content for preview, or not keying content. If a keying system is not keying content, the keying system is deemed to be "unoccupied" and available for use.
  • the present invention further describes techniques and/or methodologies for automatically selecting a keyer to key layers on a media production.
  • the term "media production” includes the production of any and all forms of media or multimedia in accordance with the method, system, and computer program product of the present invention.
  • a media production includes, but is not limited to, video of news programs, television programming (such as, documentaries, situation comedies, dramas, variety shows, interviews, or the like), sporting events, concerts, infomercials, movies, video rentals, or any other content.
  • a media production can include streaming video related to corporate communications and training, educational distance learning, or home shopping video-based "e” or "t” - commerce.
  • Media productions also include live or recorded audio (including radio broadcast), graphics, animation, computer generated, text, and other forms of media and multimedia.
  • a media production can be live, as-live, or live-to-tape.
  • a media production is recorded and immediately broadcast over traditional airwaves or other mediums (e.g., cable, satellite, etc.) to a television or the like.
  • the media production can be encoded for distribution over a computer network, hi an embodiment, the computer network includes the Internet, and the media production is formatted in hypertext markup language (HTML), or the like, for distribution over the
  • the present invention is not limited to the Internet.
  • a system and method for synchronizing and transmitting traditional and network distributions are described in the pending U.S. application entitled “Method, System, and Computer Program Product for Producing and Distributing Enhanced Media” (U.S. Appl. Ser. No. 10/208,810), which is incorporated herein by reference in its entirety.
  • the term "as-live” refers to a live media production that has been recorded for a delayed broadcast over traditional or network mediums. The delay period is typically a matter of seconds and is based on a number of factors. For example, a live broadcast may be delayed to grant an editor sufficient time to approve the content or edit the content to remove obj ectionable subj ect matter.
  • live-to-tape refers to a live media production that has been stored to any type of record playback device (RPD), including a video tape recorder/player (VTR), video recorder/server, virtual recorder (VR), digital audio tape (DAT) recorder, or any mechanism that stores, records, generates, or plays back via magnetic, optical, electronic, or any other storage media.
  • RPD record playback device
  • VTR video tape recorder/player
  • VR virtual recorder
  • DAT digital audio tape
  • live-to-tape represents only one embodiment of the present invention.
  • the present invention is equally applicable to any other type of production that uses or does not use live talent (such as cartoons, computer-generated characters, animation, etc.). Accordingly, reference herein to "live,” “as-live,” or “live-to-tape” is made for illustration purposes, and is not limiting. Additionally, traditional or network distributions can be live or repurposed from previously stored media productions.
  • the present invention provides methods for keying a media production for distribution over traditional or network mediums.
  • the keyed media production can also be saved to a storage medium for subsequent retrieval, hi an embodiment, parallel automated keyers are used to allow multiple media productions to be keyed and outputted to a program or preview channel.
  • the operating state is monitored, updated, and altered to simplify the keyer operations and thereby reduce the burden on the video director, so that the director can focus attention on the "on-air" product.
  • the present invention enables a director, or other personnel, to select a key to preview before the key appears in a program channel when a transition occurs. The director no longer has to determine which keyer is being used on-air to determine which keyer is available for the program channel.
  • flowchart 2400 represents the general operational flow of an embodiment of the present invention. More specifically, flowchart 2400 shows an example of a control flow for automating parallel keyers according to the present invention, hi other words, the control flow provides an example of compositing one or more keys or keyer layers on two or more media productions at the same time.
  • an automated keying system comprises one or more keyers, which can be internal or external to a media production switcher.
  • the keyers can be luma keyers, chroma keyers, linear keyers, or any combination thereof.
  • the configuration parameters are written to a configuration file, as described in greater detail below.
  • the configuration parameters specify attributes or properties for the desired key effects for a media production.
  • one configuration parameter is the background media source.
  • the director identifies the media production that will be keyed according to the present invention. For example if the media production is a live or as-live signal, the director would select an input port (e.g., "input 1") to the keying system and a video source (e.g., "camera 1").
  • the director would select an input port (e.g., "input 2"), a source (e.g., "virtual recorder 1”), and a filename.
  • an input port e.g., "input 2”
  • a source e.g., "virtual recorder 1”
  • a second configuration parameter is a fill source.
  • the fill source specifies a device and/or file for media or multimedia content that will be keyed on the background media production.
  • the key fill comprises data, graphics, text, title, captioning, matte color, photographs, still stores, video, animation, or any other type of media or multimedia.
  • the director indicates the source and content (e.g., template, filename, etc.) of the fill. Therefore, the source can be a graphic device, character generator, video server, file server, or the like.
  • the key source is associated with the fill source and specifies the shape and position of the key fill on the background media. For example, a key can be located in the lower- third region of the background, in the upper-third as commonly used for over- the-shoulder keying, or the like.
  • the key source in essence, is used to cut a hole in the background media.
  • the key source can come from the same device that provides the key source or another device, which feeds the key source to the keyer switcher to cut the key hole.
  • the configuration parameters are accessed, and at step 2412, an unoccupied keyer is selected to receive the configuration parameters.
  • the cunent state of all keyers are monitored to determine if the keyers are cunently in use. If a keyer is not being used, this unoccupied keyer is identified and selected.
  • the configuration parameters are executed to route the specified background media, fill, and key sources to the selected keyer.
  • the configuration parameters also instruct the selected keyer to automatically produce a composite shot or image displaying the desired key effects, namely the predefined background media, key and fill.
  • FIG. 35 illustrates an example of a composite shot 3500 according to an embodiment of the present invention.
  • a background video 3502 can include a video of a news anchor coming from a camera in a television studio.
  • the key signal can come from a graphic device and is fed into a production switcher to cut a hole in background video 3502.
  • a fill video 3504 is used to fill the hole to complete composite shot 3500.
  • Fill 3504 can be a second video that is fed into the production switcher from the graphic device or another source.
  • fill video 3504 is displayed in an over-the- shoulder (OTS) box.
  • the OTS box includes the fill video 3504 along with an additional graphic, picture, or text (collectively shown as 3506) to support the topic being discussed by the news anchor.
  • the key signal can also instruct the production switcher to receive graphic titles 3508 from a character generator, and key the titles 3508 at the lower third portion of the on-camera shot of the news anchor.
  • the keyed titles 3508 can be translucent (such as, the CBSTM icon) or opaque (i.e., "Technology News") with respect to background video 3502.
  • the composite shot is fed over a preview channel to a display or storage medium.
  • the director reviews the composite shot on a preview display for accuracy. If the composite shot requires any modifications, the director can reset the configuration parameters at step2403. On the other hand if the composite shot is approved, the control flow passes to step 2424.
  • the director steps or transitions the composite shot from preview to program output.
  • the program output takes the composite media production to air and/or to a storage medium.
  • flowchart 2409 represents the general operational flow of an embodiment of keyer selection step 2409. More specifically, flowchart 2409 shows an example of a control flow for identifying and selecting an unoccupied keyer according to the present invention.
  • each keyer is monitored to determine if the keyer is compositing a media production over a program channel, compositing a media production over a preview channel, or not being used at all.
  • each keyer is monitored to determine whether or not the keyer is being used without regard to whether the keyer is in a preview or program state. If the keyer is not being used, it is deemed as being available and is denoted as being in an "unoccupied" state.
  • the keyer states are evaluated. If no keyers are in an unoccupied state, the control flow passes back to step 2503 and the keyer states are monitored until a keyer becomes available. In an embodiment, a message is sent to the director and the director is granted an option to manually change the state of an occupied keyer (i.e., program or preview state). If one or more unoccupied keyers are found, the control flow passes to step 2509. All unoccupied keyers are queued and selected on a first-in-first-out (FIFO) basis. Hence as future keyers become available, the keyers are placed at the bottom of the queue. As needed, keyers are selected from the top of the queue to perform the keying operations.
  • FIFO first-in-first-out
  • the present invention implements a FLFO routine to select keyers from a queue, other selection techniques and methodologies can be used as long as an available keyer can be automatically chosen with little or no user interaction.
  • the control flow ends as indicated at step 2595.
  • FIG. 25 only unoccupied keyers are selected.
  • the director can be granted an option to select an occupied keyer if no unoccupied keyers are available.
  • a preview keyer can be identified and selected automatically. The capability of selecting a preview keyer is described with reference to FIG. 26, where flowchart 2409 represents the general operational flow of another embodiment of keyer selection step 2409. More specifically, flowchart 2409 shows another example of a control flow for identifying and selecting an unoccupied keyer according to the present invention.
  • the control flow of flowchart 2409 begins at step 2601 and passes immediately to step 2503.
  • the operating states are monitored or updated to determine whether the keyers are in a program, preview, or unoccupied state as previously discussed.
  • the keyer states are evaluated. If an unoccupied keyer is found, the control flow passes to step 2609. In no unoccupied keyer is found, the control flow passes to step 2606.
  • the keyer states are evaluated to determine if any keyer is cunently compositing video for a preview channel. If no keyer is in a preview state, the control flow passes back to step 2503. If at least one preview keyer is found, the control flow passes to step 2609.
  • a keyer identified from step 2506 or step 2606 is selected.
  • the keyers are queued according to their operating state (e.g., unoccupied, preview, etc.).
  • the queues are emptied on a FIFO basis, or the like.
  • flowchart 2409 represents the general operational flow of another embodiment of keyer selection step 2409. More specifically, flowchart 2409 shows another example of a control flow for identifying and selecting an unoccupied keyer according to the present invention.
  • the control flow of flowchart 2409 begins at step 2701 and passes immediately to step 2503.
  • step 2503 the operating states are monitored or updated as previously discussed.
  • step 2506 the keyer states are evaluated. If an unoccupied keyer is found, the control flow passes to step 2703.
  • an unoccupied keyer is chosen from an unoccupied queue using FIFO or the like, as discussed above.
  • step 2606 the keyer states are evaluated to determine if any preview keyers are found. If no keyer is in a preview state, the control flow passes back to step 2503. If at least one preview keyer is found, the control flow passes to step 2706.
  • a keyer is chosen from a preview queue using FLFO or the like.
  • the director is sent a message and given the option of approving or rejecting the chosen keyer. If approval is denied, the control flow passes back to step 2503. Otherwise, the control flow passes to step 2712.
  • the chosen keyer from step 2709 or step 2703 is identified and implemented as the selected keyer. Once a selection has been made, the control flow ends as indicated at step 2795.
  • Flowchart 2409 shows that the director approves or rejects the keyer chosen at step 2706 (i.e., a preview keyer). This gives the director control over whether a currently keyed production should be interrupted or cancelled. This can be an effective mechanism for incorporating a late-breaking news segment, or some other type of unforeseeable event, into a live production.
  • the director may approve or reject the keyer chosen at either step 2706 (i.e., a preview keyer) or step 2703 (i.e., an unoccupied keyer). Therefore, the rationale for approving a chosen keyer is not limited to whether to interrupt a cunently keyed production.
  • the keyers of the present invention are queued and emptied on a FLFO basis. This routine is explained with reference to FIGs. 28-30, which illustrate the queuing and selecting process for different quantities of keyers. Specifically, FIGs. 28a-28c provide an example using two keyers. FIGs. 29a-29d provide an example using three keyers. Finally, FIGs. 30a-30e provide an example using a plurality of keyers.
  • the present invention is not restricted to the quantity of keyers.
  • FIGs. 28a-28c illustrate various keyer states for two keyers (i.e., KI and K2) that are queued and selected for a program and preview channel, according to the present invention.
  • FIG. 28a shows keyer KI and keyer K2 in an initial state. At this point in time, both keyers are unoccupied. As such, keyer KI and keyer K2 are placed in an availability queue as shown in FIG. 28b.
  • keyer KI is selected from the availability queue, and is being used to key program output. Keyer K2 is selected to key a preview channel.
  • FIGs. 29a-29d illustrate another example of keyers being setup in a queue and selected for compositing a media production.
  • FIG. 29a shows three keyers (i.e., KI, K2, and K3) in an initial unoccupied state.
  • FIG. 29b shows keyer KI, keyer K2, and keyer K3 after they have been placed in an availability queue, h
  • FIG. 29c the availability queue has been emptied, using FIFO, to place keyer KI in a program state and keyer K2 in a preview state.
  • the director has selected keyer K3 to preview a second keyed shot.
  • the keyer state of keyer K3 is monitored by placing it at the bottom of the preview queue. As such, if the preview queue is searched to select a keyer, as discussed with reference to FIGs. 26 and 27, keyer K2 would be the first keyer selected from the top of the preview queue.
  • FIGs. 30a-30e illustrates another embodiment of the present invention that supports a plurality of keyers Kl-Kn.
  • FIG. 30a shows keyers Kl-Kn in their initial unoccupied states.
  • FIG. 30b shows the unoccupied keyers Kl-Kn in an availability queue.
  • FIG. 30c shows that first keyers KI and then keyer K4 have been selected and transitioned to a program state.
  • FIG. 30d shows that first keyer K3, then keyer K5, and finally keyer K6 are operating in a preview state.
  • the cunent status of the availability queue includes keyers K7-Kn and K2. Keyer K2 is at the bottom of the availability queue because it was previously selected for preview or program, but currently, is no longer in use.
  • keyer K2 goes to the bottom because the availability queue is emptied according to a FLFO routine as previously discussed.
  • the present invention allows one or more keyers to be programmed ahead of time without having to consider the source of a cunent media production or whether a keyer is being used.
  • the present invention also allows automatic preparation of the next composited media production that will be taken to air. When it is time for the next shot and if the next shot requires a keyed image, the control flow of FIG. 24 is repeated for the next shot. If a keyed image is not required, the automated keyers are deactivated, and the background media production continues to be processed through the keyer system but without any video manipulation.
  • FIG. 31 illustrates a keyer system 3100 according to an embodiment of the present invention.
  • Keyer system 3100 includes an input router 3102, a plurality of keyers K1-K4, and a video switcher 3104.
  • Input router 3102 receives the background, fill, and key sources as discussed above.
  • Input router 3102 routes the sources an appropriate keyer K1-K4 that has been selected, as discussed above.
  • Keyers K1-K4 can be internal or external to video switcher 3104.
  • Keyers K1-K4 can be a luminance keyer, chroma keyer, linear keyer, or a combination thereof.
  • keyer system 3100 enables a media production to be configured with two keyer layers.
  • Keyers KI and K2 provide a first keyer layer.
  • a second keyer layer is provided by keyers K3 and K4.
  • Keyers KI and K3 provide a composite shot to a program input port 3106 of video switcher 3104, and keyers K2 and K4 provide a composite shot to a preview input port 3108 of video switcher 3104.
  • composited shots are always "automatically” sent to a preview channel. Once the background, key, and fill sources are selected and composited on preview, the director “steps” or “transitions” the shot from a preview output 3112 to a program output 3110.
  • keyer system 3100 is setup on “preview” to see a “composite” view prior to taking the shot to air.
  • the preview process provides assurance that the composite shot meets the director's approval prior to "transitioning" to air on the "program” channel.
  • keyer system 3100 shows two keyer layers being composited on a background, system 3100 also allows a single key on both program 3106 and preview 3108 inputs to switcher 3104. Since the fixed architecture of FIG. 31 shows two keyers serially positioned, a keyed production having a single key would pass through the second keyer (i.e., K3 or K4) without being keyed.
  • Control signals 3120 are transmitted from a media production processing device, which is described below with reference to FIG. 33.
  • Control signals 3120 provide instructions to various components of system 3100, such as instructions to switch between program output 3110 and preview output 3112.
  • Control signals 3120 also enable a keyer K1-K4 to be manipulated and switched remotely via communications from a user interface.
  • FIG. 32 illustrates another embodiment of keyer system 3100.
  • keyers K1-K4 reside within a router 3206 that allows keyers K1-K4 to "float.”
  • keyers K1-K4 can be grouped in serial and parallel variable a ⁇ angements and assigned to the appropriate signal flow path to program 3110 and preview 3112 channels automatically, hi an embodiment, keyer system 3100 is programmed through software to key two layers back-to- back between preview and program over and over again, h another embodiment, the director programs keyer system 3100 to go from an "on- camera" shot with no keyer layers to one with four keyer layers.
  • the operating states of floating keyers K1-K4 can be monitored and, thus programmed, without the director having to track which keyer is being used for what effect to make sure they do not impact the composite picture on the program channel.
  • the logic in the software always knows which keyers K1-K4 are on program and which ones are available for the user.
  • keyers K1-K4 always route the signals to "preview" during the automation process.
  • input router 3102 allows auxiliary pairs of background, fill, and key signals to go into the floating keyer router 3206.
  • the auxiliary inputs allow the director to composite images with keys for insertion in dual, tri or quad box applications.
  • FIG. 36 shows an example of a quad box display 3600 for a quad box application according to an embodiment of the present invention.
  • Quad box display 3600 provides sufficient auxiliary sets 3602-3608 of background, fill, and key signals (i.e., four sets) for up to a four- channel digital video effect (DVE) boards.
  • DVE digital video effect
  • the present invention can support more or less channels of DVE and is not to be considered a limitation.
  • the architecture can support more or less floating keyers K1-K4. As shown in FIGs. 30a-30e, the architecture of the present invention can be modified to support a plurality of keyers Kl-Kn.
  • the architecture illustrated in FIG. 32 provides the flexibility for multiple variations of production compositing. From simple keyer layers on an "on-camera” shot, to multiple keyer layers back-to-back, and all the way to being able to composite keyer layers within inserts of a DVE double, tri, quad, or greater sized box application.
  • the present invention can be implemented in a manual media production environment as well as an automated media production environment.
  • an automated multimedia production environment includes a centralized media production processing device that automatically or semi-automatically commands and controls the operation of a variety of media production devices in analog and/or digital video environments.
  • the term “media production device” includes video switcher (such as, switcher 3110), digital video effects device (DVE), audio mixer, teleprompting system, video cameras and robotics (for pan, tilt, zoom, focus, and iris control), record/playback device (RPD), character generator, still store, studio lighting devices, news automation devices, master control/media management automation systems, commercial insertion devices, compression/decompression devices (codec), virtual sets, or the like.
  • RPD includes VTRs, video recorders/servers, virtual recorder (VR), digital audio tape (DAT) recorder, or any mechanism that stores, records, generates or plays back via magnetic, optical, electronic, or any other storage media.
  • the media production processing device receives and routes live feeds (such as, field news reports, news services, sporting events, or the like) from any type of communications source, including satellite, tenestrial (e.g., fiber optic, copper, UTP, STP, coaxial, hybrid fiber-coaxial (HFC), or the like), radio, microwave, free-space optics, or any other form or method of transmission, in lieu of, or in addition to, producing a live show within a studio.
  • tenestrial e.g., fiber optic, copper, UTP, STP, coaxial, hybrid fiber-coaxial (HFC), or the like
  • radio microwave, free-space optics, or any other form or method of transmission
  • an automated media production processing device is configurable to convert an electronic show rundown into computer readable broadcast instructions, which are executed to send control commands to the media production devices.
  • An exemplary embodiment of an electronic rundown is described in greater detail below with reference to FIG. 33.
  • An electronic show rundown is often prepared by the show director, a web master,
  • the director prepares the rundown to specify element-by-element instructions for producing a live or non-live show.
  • An electronic rundown can be a text-based or an object-oriented listing of production commands. When activated, electronic rundown is converted into computer readable broadcast instructions to automate the execution of a show without the need of an expensive production crew to control the media production devices.
  • the broadcast instructions are created from the Transition MacroTM multimedia production control program developed by ParkerVision, Inc. (Jacksonville, FL) that can be executed to control an automated multimedia production system.
  • the Transition MacroTM program is described in the pending U.S. application entitled “System and Method for Real Time Video Production and Multicasting" (U.S. Appl. Ser. No. 09/634,735), which is incorporated herein by reference as though set forth in its entirety.
  • the Transition MacroTM program is an event-driven application that allows serial and parallel processing of media production commands to automate the control of a multimedia production environment.
  • Each media production command is associated with a timer value and at least one media production device.
  • FIG. 33 illustrates an embodiment of an object-oriented, electronic show rundown created by an event-driven application on a graphical user interface (GUI) 3300.
  • the electronic rundown includes a horizontal timeline 3302 and one or more horizontal control lines 3304a-3304p.
  • Automation control icons 3306a-3306t are positioned onto control lines 3304a-3304p at various locations relative to timeline 3302, and configured to be associated with one or more media production commands and at least one media production device.
  • a timer (not shown) is integrated into timeline 3302, and operable to activate a specific automation control icon 3306a-3306t as a timer indicator 3308 travels across timeline 3302 to reach a location linked to the specific automation control icon 3306a-3306t.
  • the media production processing device would execute the media production commands to operate the associated media production device.
  • label icon 3306a permits a director to name one or more elements, segments, or portions of the electronic rundown.
  • the director would drag and drop a label icon 3306a onto control line 3304a, and double click on the positioned label icon 3306a to open up a dialogue box to enter a text description.
  • the text would be displayed on the positioned label icon 3306a.
  • exemplary label icons 3306a have been generated to designate "CUE,” “OPEN VT 3,” “C2 TI T2,” etc.
  • Control line 3304a is also operable to receive a step mark icon 3306b, a general purpose input/output (GPI/O) mark icon 3306c, a user mark icon 3306d, and an encode mark 3306e.
  • Step mark icon 3306b and GPI/O mark icon 3306c are associated with rundown step commands.
  • the rundown step commands instruct timer indicator 3308 to start or stop running until deactivated or reactivated by the director or another media production device.
  • step mark icon 3306b and GPI/O mark icon 3306c can be placed onto control line 3304a to specify a time when timer indicator 3308 would automatically stop running.
  • timer indicator 3308 would stop moving across timeline 3302 without the director having to manually stop the process, or without another device (e.g., a teleprompting system (not shown)) having to transmit a timer stop command.
  • a step mark icon 3306b is activated to stop timer indicator 3308, timer indicator 3308 can be restarted either manually by the director or automatically by another external device transmitting a step command.
  • step mark icon 3306b and GPI/O mark icon 3306c are used to place a logically break between two elements on the electronic rundown.
  • step mark icon 3306b and GPI/O mark icon 3306c are placed onto control line 1140a to designate segments within a media production.
  • One or more configuration files can also be associated with a step mark icon 3306b and GPI/O mark icon 3306c to link metadata with the designated segment.
  • Encode mark 3306e can also be placed on control line 3304a.
  • encode mark 3306e is generated by the Web MarkTM software application developed by ParkerVision, Inc.
  • Encode mark 3306e identifies a distinct segment within the media production produced by the electronic rundown of GUI 3300.
  • timer indicator 3308 advances beyond encode mark 3306e, an encoding system is instructed to index the beginning of a new segment.
  • the encoding system automatically clips the media production into separate files based on the placement of encode mark 3306e. This facilitates the indexing, cataloging and future recall of segments identified by the encode mark 3306e.
  • Encode mark 3306e allows the director to designate a name for the segment, and specify a segment type classification. Segment type classification includes a major and minor classification.
  • a major classification or topic can be sports, weather, headline news, traffic, health watch, elections, and the like.
  • An exemplary minor classification or category can be local sports, college basketball, NFL football, high school baseball, local weather, national weather, local politics, local community issues, local crime, editorials, national news, and the like.
  • Classifications can expand beyond two levels to an unlimited number of levels for additional granularity and resolution for segment type identification and advertisement targeting.
  • the properties associated with each encode mark 3306e provide a set of metadata that can be linked to a specific segment. These properties can be subsequently searched to identify or retrieve the segment from an archive.
  • Transition icons 3306f-3306g are associated with automation control commands for controlling video switching equipment.
  • transition icons 3306f-3306g can be positioned onto control lines 3304b-3304c to control one or more devices to implement a variety of transition effects or special effects into a media production.
  • Such transition effects include, but are not limited to, fades, wipes, DVE, downstream keyer (DSK) effects, and the like.
  • DVE includes, but is not limited to, warps, dual-box effects, page turns, slab effects, and sequences.
  • DSK effects include DVE and DSK linear, chroma and luma keyers (such as, K1-K4 and Kl-Kn, discussed above).
  • Keyer control icon 3306h is positioned on control line 3304d, and used to prepare and execute keyer layers either in linear, luma, chroma or a mix thereof for preview or program output.
  • the keyers can be upstream or downstream of the DVE.
  • Audio icon 3306i can be positioned onto control line 3304e and is associated with commands for controlling audio equipment, such as audio mixers, digital audio tape (DAT), cassette equipment, other audio sources (e.g., CDs and DATs), and the like.
  • Teleprompter icon 3306j can be positioned onto control line 3304f and is associated with commands for controlling a teleprompting system to integrate a script into the timeline.
  • Character generator (CG) icon 3306k can be positioned onto control line 3304g and is associated with commands for controlling a CG or still store to integrate a CG page into the timeline.
  • Camera icons 33061-3306n can be positioned onto control lines 3304h-3304j and are associated with commands for controlling the movement and settings of one or more cameras.
  • VTR icons 3306p-3306r can be positioned onto control lines 3304k-3304m and are associated with commands for controlling VTR settings and movement.
  • GPO icon 3306s can be positioned onto control line 3304n and is associated with commands for controlling GPI or GPO devices.
  • Encode object icons 3306t are placed on control line 3304p to produce encode objects, and is associated with encoding commands.
  • encode object icons 3306t are produced by the Web ObjectsTM software application developed by ParkerVision, Inc. When activated, an encode object icon 3306t initializes the encoding system and starts the encoding process. A second encode object icon 3306t can also be positioned to terminate the encoding process.
  • Encode object icon 3306t also enables the director to link context-sensitive or other media (including an advertisement, other video, web site, etc.) with the media production, hi comparison with encode mark 3306e, encode object icon 3306t instructs the encoding system to start and stop the encoding process to identify a distinct show, whereas encode mark 3306e instructs the encoding system to designate a portion of the media stream as a distinct segment.
  • the metadata contained in encode object icon 3306t is used to provide a catalog of available shows, and the metadata in encode mark 3306e is used to provide a catalog of available show segments.
  • User mark icon 3306d is provided to precisely associate or align one or more automation control icons 3306a-3306c and 3306e-3306t with a particular time value. For example, if a director desires to place teleprompter icon 3306j onto control line 3304f such that the timer value associated with teleprompter icon 3306j is exactly ten seconds, the director would first drag and drop user mark icon 3306d onto control line 3304a at the ten second mark. The director would then drag and drop teleprompter icon 3306j onto the positioned user mark icon 3306d. Teleprompter icon 3306j is then automatically placed on control line 3304f such that the timer value associated with teleprompter icon 3306j is ten seconds. In short, any icon that is drag and dropped onto the user mark 3306d is automatically placed on the appropriate control line and has a timer value of ten seconds. This feature helps to provide multiple icons with the exact same timer value.
  • the electronic rundown can be stored in a file for later retrieval and modification. Accordingly, a show template or generic electronic rundown can be re-used to produce a variety of different shows. A director could recall the show template by filename, make any required modifications (according to a new electronic rundown), and save the electronic rundown with a new filename.
  • one media production device is a teleprompting system (not shown) that includes a processing unit and one or more displays for presenting a teleprompting script (herein refened to as "script") to the talent, hi an embodiment, the teleprompting system is the SCRIPT ViewerTM, available from ParkerVision, Inc.
  • a teleprompting system can be used to create, edit, and run scripts of any length, at multiple speeds, in a variety of colors and fonts.
  • the teleprompting system is operable to permit a director to use a text editor to insert media production commands into a script (herein refened to as "script commands").
  • the text editor can be a personal computer or like workstation, or the text editor can be an integrated component of electronic rundown GUI 3300.
  • text window 3310 permits a script to be viewed, including script commands.
  • Script controls 3312 are a set of graphical controls that enable a director to operate the teleprompting system and view changes in speed, font size, script direction and other parameters of the script in text window 3310.
  • the script commands that can be inserted by the teleprompting system include a cue command, a delay command, a pause command, a rundown step command, and an enhanced media command.
  • enhanced media commands permit the synchronization of auxiliary information to be linked for display or referenced with a script and video. This allows the display device to display streaming video, HTML or other format graphics, or related topic or extended-play URLs and data.
  • the present invention is not limited to the aforementioned script commands. As would be apparent to one skilled in the relevant art(s), commands other than those just listed can be inserted into a script.
  • GUI 3300 enables the director to automate the control of the media production devices.
  • GUI 3300 also enables the director to establish the configuration parameters, described above, for implementing the keying effects according to the present invention.
  • transition icons 3306f-3306g can be positioned onto control lines 3304b-3304c to setup DSK effects as well as other transition effects. If the director operates an input device to double click on a positioned transition icon 3306f-3306g, a dialogue box is opened to allow the director to specify a background, fill, and key source for the configuration parameters. This can be explained with reference to FIG. 34.
  • FIG. 34 shows a portion of the electronic rundown of GUI 3300.
  • the activation of a transition icon 3306f-3306g generates a dialogue box 3402.
  • Dialogue box 3402 allows the directors to set the transition properties, including the configuration . parameters for key effects.
  • Dialogue box 3402 includes time field 3404, which denotes the start and stop time value for implementing the key effects. The time value in time field 3404 conesponds to the timer values on timeline 3302.
  • Dialogue box 3402 also includes a program background field 3406, a preview background field 3408, and an auxiliary background field 3410.
  • Program background field 1205, preview background field 3408, and auxiliary background field 3410 identify the background source of the media production to be keyed.
  • program background field 3406, preview background field 3408, and auxiliary background field 3410 identify the input port(s) that input router 3102 uses to receive the program routed video outputs, preview routed video outputs, and auxiliary routed video outputs, respectfully, for router 3206.
  • a program fill field 3414 identifies a program fill source that is keyed on the program background media.
  • a preview fill field 3416 identifies a preview fill source that is keyed on the preview background media.
  • an auxiliary fill field 3412 identifies an auxiliary fill source that is keyed on the auxiliary background media.
  • program fill field 3414, preview fill field 3416, and auxiliary fill field 3410 identify the input port(s) that input router 3102 uses to receive the program routed fill outputs, preview routed fill outputs, and auxiliary routed fill outputs, respectfully, for router 3206.
  • a program key field 3420 identifies a program key source that is associated with program fill field 3414.
  • a preview key field 3422 identifies a preview key source that is associated with preview fill field 3416.
  • an auxiliary key field 3418 identifies an auxiliary key source that is associated with auxiliary fill field 3412. Referring back to FIG. 32, program key field 3420, preview key field 3422, and auxiliary key field 3418 identify the input port(s) that input router 3102 uses to receive the program routed key outputs, preview routed key outputs, and auxiliary routed key outputs, respectfully, for router 3206.
  • transition icons 3306f-3306g transmit commands that process the predefined fill and key attributes to composite the associated graphic layers within the specified media stream. More specifically, the broadcast instructions conesponding to a positioned transition icon 3306f- 3306g are executed as timer 3308 reaches the timer value on timeline 3302 that matches the time value (i.e., time field 3404) specified for the positioned transition icon 3306f-3306g.
  • the broadcast instructions are programmed to select the conect keyer (e.g., K1-K4).
  • the broadcast instructions call or implement routine that determines which keyer is cunently available, as discussed above with reference to FIGs. 24-27.
  • transition icons 3306f-3306g are assigned to the keyer.
  • the keyed output is placed on a preview bus. This allows the director to review a keyer layer prior to broadcasting the show.
  • the automation supported by the broadcast instructions also allow the director to concentrate on the quality aspect of the show instead of trying to determine which keyer is cunently available and where it is routed.
  • GUI 3300 is described with reference to an automated production environment, it should be understood that a similar user interface could be used for a manual production environment.
  • control lines 3304b-3304c would execute broadcast instructions to select a keyer and assign the keyer attributes.
  • the remaining control lines 3304a and 3304d-3304p would not transmit control commands to automate the control of other media production devices.
  • the media production devices would be manually controlled.
  • FIGs. 24-32 and 33-36 are conceptual illustrations allowing an easy explanation of the present invention. It should be understood that embodiments of the present invention could be implemented in hardware, finnware, software, or a combination thereof. In such an embodiment, the various components and steps would be implemented in hardware, firmware, and/or software to perform the functions of the present invention. That is, the same piece of hardware, firmware, or module of software could perform one or more of the illustrated blocks (i.e., components or steps).
  • the present invention just described can be implemented in one or more computer systems capable of carrying out the functionality as described above with reference to FIG. 3.
  • Another aspect of the present invention involving systems, methods and computer program products for automated real-time execution of live inserts of repurposed stored content distribution, and multiple aspect ratio automated simulcast production is described next with reference to FIGs. 37-42.
  • the invention is directed to a method, system, and computer program product for simulcasting digital video through outputs having differing format requirements.
  • the present invention allows broadcasters to automate and produce a simulcast of dual 4:3 and 16:9 aspect ratio "live” or "as-live” programming.
  • the present invention allows automatic adjustments to be made to character generators, still stores, transition effects, etc., such that the production can be synchronized and transmitted over parallel mediums with non-substantial delay.
  • Overview The market for digital television continues to evolve as broadcasters transition from transmitting an analog NTSC signal to digital signals as mandated by the Federal Communications Commission (FCC).
  • FCC Federal Communications Commission
  • the mass majority of the installed television sets in the United States today have a 4:3 aspect ratio. New digital sets will come with the wider 16:9 aspect ratio similar to the format used in motion pictures
  • the broadcaster will be challenged to deliver several different types of programming solutions as follows: 4:3 original ("native") output "letter boxed" to fit a 16:9 digital television set.
  • the letter box could be "black” or contain text, data or graphic content.
  • 4:3 and 16:9 formats from a single user interface to avoid duplicating both equipment and personnel resources.
  • the simultaneous native output of both formats allow the broadcaster to design a "look and feel" that better enables them to take advantage of both 4:3 and 16:9 aspect ratios without negatively impacting one over the other.
  • the invention is applicable to formats other than 4:3 and 16:9, and is also applicable to the processing of greater than two formats, as will be appreciated by persons skilled in the relevant arts based on the teachings contained herein. Detailed Description
  • FIG. 37 is a block diagram of a production system 3702 according to an embodiment of the invention.
  • the production system 3702 includes a user interface 3706, to enable interaction with users 3704. Through the user interface 3706, users 3704 can design and produce shows, such as but not limited to live and as-live shows.
  • the production system 3702 includes a control system 3708, which controls the production system 3702 (and components thereof) in the manner described herein.
  • the control system 3708 is implemented using a computer operating according to software.
  • Such software when stored on a computer readable medium (such as a CD, tape, hard drive, signals traveling over a wired or wireless medium, etc.), is refened to as computer program product.
  • the invention is directed to such computer program products, as well as methods embodied in such computer program products, and systems inco ⁇ orating such computer program products.
  • the control system 3708 is implemented using predominately hardware (such as hardware state machines or application specific processors).
  • the production system 3702 includes a number of production paths 3710A and 3710B.
  • such production paths 3710A and 3710B include a 4:3 production path 3710A and a 16:9 production path 3710B.
  • 4:3 production path 3710A and 16:9 production path 3710B are provided for illustrative purposes only, and are not limiting.
  • the invention is applicable to other formats. Also, the invention can accommodate more than two production paths.
  • the production system 3702 also includes a number of sources 3714, which may be cameras, tape machines, still stores, etc.
  • the sources 3714 provide material for the show to the production paths 3710A and 3710B, either directly or via the control system 3708.
  • control system 3708 controls the 4:3 production path 3710A to generate a show in a native 4:3 format, to thereby generate a native 4:3 output 3712A. Also, the control system 3708 controls the 16:9 production path 3710B to generate a show in a native 16:9 format, to thereby generate a native 16:9 output 3712B. hi an embodiment, the control system 3708 simultaneously controls the 4:3 production path 3710A and the 16:9 production path 3710B such that the native 4:3 output 3712A and the native 16:9 output 3712B are synchronized with each other, hi practice, the outputs
  • the production system 3702 is similar to that described in "Real Time Video Production System and Method," Serial No. 09/215,161, filed December 18, 1998, now U.S. Patent No. 6,452,612, issued September 17, 2002, referenced above (although the invention can be implemented using any production system having the functionality described herein).
  • the production system 3702 is modified to include multiple production paths 3710A and 3710B, and the control system 3708 is modified to control the multiple production paths 3710A and 3710B. Further information regarding the production system 3702 is provided below. Transition Macros for Controlling Multiple Production Paths
  • a transition macro is a set of video production commands, where each video production command is transmitted from a processing unit to a video production device.
  • a user designs a production by combining one or more transition macros in a script. Execution of the transition macros cause the production system 3702 to produce the show in accordance with the script. Transition macros are described in great detail in U.S. Patent No. 6,452,612,
  • transition macros as controlling elements in a single production path.
  • transition macros control elements in multiple production paths 3710A and 3710B.
  • a given transition macro controls elements in both the 4:3 production path 3710A and the 16:9 production path 3710B (although some transition macros may still be limited to a subset of the production paths 3710A and 3710B).
  • This feature of the invention is further described below.
  • Material for Multiple Formats In an embodiment, the production system 3702 includes material in the native formats for each of the system 3702's production paths 3710A and 3710B.
  • the production system 3702 includes a 4:3 version of the still, and a 16:9 version of the still.
  • the production paths 3710A, 3710B may each include a dedicated still store, or may share a still store.
  • Another example relates to cameras.
  • the 4:3 production path 3710A includes 4:3 format cameras
  • the 16:9 production path 3710B includes 16:9 format cameras.
  • Such duplicity is generally (but not always) the case for the production paths 3710A and 3710B, to enable generation of the outputs 3712A and 3712B in the multiple native formats.
  • ME mixed effect
  • the production system 3702 includes ME banks dedicated for the 4:3 production path 3710A, and other ME banks dedicated for the 16:9 production path 3710B.
  • a number of methods for acquiring materials for the production are used, depending on a number of factors such as cost, availability, material types, as well as other implementation dependent factors.
  • field acquisitions will originally be in 16:9 format, since that format will capture more data (when compared to 4:3).
  • the 16:9 raw footage will then be used to create 4:3 format material (via appropriate cropping, for example).
  • the result will be two separate files, one in 16:9 format, and one in 4:3 format. Since both files were created prior to production, it is possible to optimize both for their respective uses (i.e., one for producing a 4:3 output, and one for producing a 16:9 output).
  • field acquisitions are obtained in multiple original formats.
  • the production paths 3710A and 3710B include components that are dedicated to their operation.
  • each production path 3710A and 3710B may include a dedicated component, or they may share a single component.
  • the production paths 3710A and 3710B may each include character generator (CG) and still store components, or they may share the same character generator (CG) and still store components.
  • all files are identified as being in either 4:3 format or 16:9 format (for example, each file may include meta data that denotes the applicable format).
  • 4:3 production path 3710A accesses material, it ensures that it accesses files tagged as being in the 4:3 format.
  • 16:9 production path 3710B accesses material, it ensures that it accesses files tagged as being in the 16:9 format.
  • control is achieved through operation of the control system 3708, and/or through appropriate coding of transition macros.
  • control system 3708 includes a keyer for the 4:3 production path 3710A, and a second keyer for the 16: 9 production path
  • the output signals 3712A and 3712B comprise a composite of signals from multiple sources.
  • the output signals 3712A and 3712B may comprise a first video signal having a hole, or "key,” cut therein. A second video signal is then inserted inside the key.
  • the output signals 3712A and 3712B are thus a composite of the first video signal and the second video signal.
  • the production system 3702 includes video switchers to implement keying.
  • the video switchers switch between multiple video sources (i.e., the first and second video signals from the above example).
  • the switching operation of the video switchers is controlled by the control system 3708, which is operating according to commands / instructions contained in transition macros.
  • a given transition macro includes commands for both the 4:3 format and the 16:9 format.
  • the icon for a particular transition macro relating to keying In an embodiment, the user 3704 need pay no concern to whether the icon relates to the 4:3 format or the 16:9 format. Instead, the icon is associated with a transition macro that includes video commands to perform the keying function for both the 4:3 format and the 16:9 format, such that the outputs 3712A and
  • the control system 3708 independently adjusts effects (such as DVE transitions like cuts, fades, wipes, etc.) for the desired look in a particular format (i.e., 4:3 or 16:9).
  • a particular "cut" transition macro includes commands to effect the cut effect for the 4:3 format, and includes other commands to effect the cut effect for the 16:9 format.
  • Such commands access either 4:3 format source materials, or 16:9 source materials, depending on whether the commands are for the 4:3 format or the 16:9 format.
  • Such commands also have appropriate duration settings so the native 4:3 output 3712A is synchronized with the native 16:9 output 3712B.
  • Source Management achieves source management for to simultaneously generate the 4:3 output 3712 A and the 16:9 output 3712B.
  • the invention synchronizes and manages dual output control of video server ports for proper ingestion and processing in the system.
  • the invention performs automated format detection to properly address source material that does not meet one or the other format. Therefore, the invention utilizes a number of processes to
  • control system 3708 must ensure that source materials are served to the 4:3 production path 3710A and the 16:9 production path 3710B such that the 4:3 output 3712A is synchronized with the 16:9 output 3712B.
  • the control system 3708 issues control signals to simultaneously activate servers in the two production paths 3710A, 3710B.
  • the production paths 3710A, 3710B each have dedicated servers.
  • the production paths 3710A, 3710B share servers.
  • the control system 3708 communicates with a shared server(s) to server materials to the production paths 3710A, 3710B in a synchronous manner.
  • Exact synchronization between the outputs 3712A and 3712B is not necessary.
  • the goal of the invention is to align the outputs 3712A and 3712B with one another so differences are not easily discernable to the human eye.
  • the invention also performs automated format detection to properly address source material that does not meet one or the other format. For example, suppose in a show a particular source was available only in 4:3 fo ⁇ nat. In order to use this source in both the 4:3 production path 3710A and the 16:9 production path 3710B, the source would have to be converted to the 16:9 format. Accordingly, the invention automatically determines whether a given source is only available in certain formats (or, equivalently, whether a given source is not available in any formats of interest). The invention then automatically converts the source to the other formats, using any well known technique. Such conversion can be performed either pre-production, or during production.
  • the invention addresses camera sources properly according to the respective formats (4:3 or 16:9).
  • both 4:3 cameras and 16:9 cameras are utilized to produce the native 4:3 output 3712 A and the native 16:9 output 3712B.
  • only cameras of a single format are used, such as 16:9 cameras.
  • the video output of such cameras are then adjusted (cropped) to form the 4:3 source material.
  • source materials in both the 16:9 format and the 4:3 format are made available to the production paths 3710A, 3710B. Cropping of the 16:9 video material into the 4:3 format takes into consideration the parameters of the 4:3 format, as well as the parameters of the show being produced.
  • the video materials to form the 4:3 output 3712A and the 16:9 output 3712B is enhanced, thereby increasing the quality of these output signals 3712A and 3712B.
  • the script calls for a video signal to appear above and to the right of the anchor's shoulders.
  • the 16:9 original video signal can be cropped into the 4:3 format so that all the pertinent information will be conveyed in both the 16:9 output 3712B, as well as the 4:3 output 3712 A.
  • the user interface 3706 enables users 3704 to create scripts that, when executed by the control system 3708, simultaneously generates the 4:3 output 3712A and the 16:9 output 3712B.
  • Such dual format operation of the invention is transparent to the user 3704.
  • the user 3704 does not need to explicitly design the script to achieve such dual format broadcasts.
  • the invention utilizes transition macros that are coded for both formats, as described above.
  • the invention also supports "hot keys" that are coded for both formats.
  • the invention supports Late Breaking News keys, which when activated by the user 3704 inserts into the script commands to accommodate a late breaking news segment.
  • Hot keys are described in greater detail in U.S. Patent No. 6,452,612, referenced above. According to the invention, such hot keys are associated with transition macros having instructions for both the 4:3 format and the 16:9 format.
  • a method, system, and computer program product are provided for segmenting and marking digital video productions, such that all or segments of the production can be retrieved for a repurposed distribution over traditional mediums or computer networks, such as the Internet.
  • the present invention includes methodologies for removing or editing keyers, character generators, etc.
  • the present invention enables one to change the order of the repurposed distribution or add segments from another production.
  • the present invention also enables the insertion of advertisements and other information into the repurposed video stream.
  • Overview Cable 24 hour news channels have found a niche for consumers looking for real time news information at the local/regional level.
  • the 24- hour news channel model serves the community looking for updated news around the clock without having to wait for specific times as is typical of traditional broadcast local news.
  • Traditional local broadcasters deliver live newscasts daily in the morning (5:00AM - 7:00AM), afternoon (11:00AM -
  • local broadcasters will be able to participate in this market trend through the appropriate use of allocated digital bandwidth.
  • the local broadcaster will be able to divide their digital bandwidth into multiple standard definition television (SDTV) channels that allows them to develop new applications.
  • SDTV standard definition television
  • Local broadcasters in mid to large markets will take advantage of these channel opportunities to provide for new revenue applications such as 24-hour local news, local sports, local shopping and local education programming.
  • a cable or local broadcaster can produce live content in the first l/2hour followed by a "repurposed” 1/2 hour on the back with live inserts for stories or events that require real time updates such as traffic and weather reports along with breaking news stories of events occurring in real time.
  • This is managed manually since the intelligence does not exist to automate this process. The manual process does not allow for true automated live inserts without many resources to manage the process.
  • 24-hour programming channels can cost effectively produce content while the market develops. This will require a design that integrates the automated production environment with storage equipment intelligently including, the ability to edit stories in real time during the production process while automatically maintaining a database and daily schedule at both the micro (story level) and macro (show level) resolution.
  • FIG. 40 is a production system 4002 according to an embodiment of the invention.
  • the production system 4002 includes a user interface 4006 for enabling interaction with users 4004.
  • the production system 4002 also includes a control system 4008 which is similar to the control system 3708 described above.
  • the control system 4008 controls the production system
  • the production system 4002 includes a number of sources 4010, including a story archive 4012 and other production devices 4014.
  • the story archive 4012 is a database having stored therein previously produced stories
  • the production devices 4014 are any known device for producing a show, such as a video switcher, camera, audio control, still store, tape machine, etc.
  • the production system 4002 further includes one or more switchers 4016, which receives sources 4010 and is controlled by the control system 4008.
  • the switchers 4016 generate an output 4018, which in an embodiment represents a live or as-live show.
  • the production system 4002 may be implemented using a production system as described in U.S. Patent No. 6,452,612, referenced above.
  • FIG. 38 is a flowchart 3802 representing the operation of the production system 4002 according to an embodiment of the invention.
  • the user 4004 interacts with the user interface 4006 to generate a script for the show that is to be produced. Such operation is described in detail in U.S. Patent No. 6,452,612, referenced above.
  • step 3806 the production system 4002 produces the show according to the script generated in step 3804. Such operation is described in detail in
  • step 3808 the production system 4002 segments the show
  • the show is segmented according to content. Specifically, in an embodiment, the show is segmented according to story. Accordingly, in step 3808, the production system 4002 divides the show into its component stories.
  • step 3810 these stories are stored in the story archive 4012, and indexed (or otherwise marked or tagged) for later retrieval.
  • the production system 4002 performs step 3808 by recording the beginning and end of each story in the show, and/or the duration of each story. This information is stored, for example in the story archive 4012, along with the show. Also stored is the story type or category of each story. Subsequently, the production system 4002 can uniquely access any story in the show using this information (meta data). It is noted that a "story” can be any portion of the show. Further description regarding the segmentation of a show is provided in "Method, System and Computer Program Product for Producing and Distributing Enhanced Media Downstreams," Serial No. 09/836,239, filed April 18, 2001, Attorney Docket No. 1752.0200000, referenced above.
  • step 3812 the production system 4002 generates additional programming, such as a new live or as-live show, using a combination of live inserts and archived material from the story archive 4012.
  • the live inserts are generated using the production devices 4014.
  • the material from the story archive 4012 may be modified, if necessary, using the production devices 4014.
  • the additional programming is comprised of only material from the story archive 4012, although such materials may be modified to some extent.
  • the operation of step 3812 is shown in greater detail in FIG. 39, which shall now be considered.
  • the user 4004 interacts with the production system 4002 via the user interface 4006 to create or modify a listing for a Cunent Show.
  • the Cunent Show is a new show being designed for production using live inserts and material from the story archive 4012.
  • the listing lists the components of the Cunent Show.
  • FIG. 41 shows a Cunent Show Listing 4106 having 6 components / segments / stories: a traffic report 4120A, a weather report 4120B, sports spotlight 4120C, a live 10:15AM insert 4118B, a bridge collapse story 4120E, and an entertainment segment 4120F.
  • FIG. 41 illustrates an example user interface 4102 (provided by the user interface 4006 shown in FIG. 40) for enabling the user 4004 to create and modify the Cunent Show Listing 4106.
  • the user 4004 can drag and drop live segments from the live segment window 4104, and/or archived stories from the archived video window 4108.
  • the user 4004 can use well known computer pointing techniques to anange and order the components of the Cunent Show.
  • Other user interfaces could alternatively be used, such as those described in U.S. Patent No. 6,452,612 and/or pending U.S. application Ser. No. 09/836,239, referenced above.
  • step 3904 the production system 4004 maps the Cunent Show Listing 4106 to a production system script that comprises transition macros. Scripts and transition macros are described in detail in U.S. Patent No. 6,452,612, as well as other patents and patent applications referenced above.
  • step 3906 the production system 4004 produces the Cunent Show according to the Cunent Show Listing 4106 and/or the script (from step 3904).
  • Step 3906 includes steps 3908, 3910, and 3912, which shall now be described.
  • step 3908 the production system 4004 retrieves and modifies, as necessary, archived materials from the story archive 4012, in accordance with the Cunent Show Listing 4106. Such retrieved materials are inserted into the output 4018 via the switcher 4016.
  • Step 3908 involves automatic "downstream” keyer changes for "as live” replay of the retrieved materials (as necessary).
  • the retrieved materials include a "bug” (for example, a time and temperature overlay on top of the video).
  • the production system 4004 would cause the keyer (one of the production devices 4014) to either eliminate the bug, or update the bug with the cunent time and temperature.
  • step 3908 is achieved by modifying the retrieved materials, in the manner just described. In an alternative embodiment, this is achieved by not recording the bug in the materials when the materials were originally produced (in step 3806). In this embodiment, the bug is inserted into the output 4018 in real-time.
  • the production system 4004 generates live segments in accordance with the Cunent Show Listing 4106. Such live segments are inserted into the output 4018 via the switcher 4016.
  • the user interface 4102 includes a Time Over/Under for Cunent V 2 Hour timer 4114, which indicates the amount of time that the show is over/under given the stories already aired and the stories that are yet to be aired, and a Time Left for Cunent V2 Hour timer 4116, which indicates the time remaining in the 30 minute show (these counters 4114, 4116 are based on a 30 minute show). These counters 4114, 4116 are used by the director 4004 to ensure that the show fits into the allotted time (i.e., 30 minutes in the example of FIG. 41). The director 4004 can control the length of any live segments to ensure that the show fits within the 30 minute slot. Alternatively, the director 4004 can select other archived materials from the story archive
  • the production system 4002 inserts advertisements into the output stream 4018.
  • the ads are "searched” to import the right ad with the conect duration, and possibly content. In other words, based on the scheduled "break" length, and/or the content of stories around the break, commercials of conesponding duration will be accessed and inserted into the output stream 4018.
  • the production system 4002 keeps track of the overage or underage, and may adjust the duration of commercial breaks to compensate for such overage/underage. If the duration(s) of the commercial breaks change, then the production system 4002 selects and inserts into the output stream 4018 combination(s) of commercials that fit the duration of the breaks. Other aspects involving the selection of commercials are described in
  • FIG. 42 is a block diagram showing a media manager 4202 and a server 4204 according to an embodiment of the invention.
  • the media manager 4202 and server 4204 are optionally part of the production systems 3702, 4002 shown in FIGS. 37 and 40, for example.
  • the media manager 4202 manages the selection, play out status, play out channel assignment of both video clips and graphic files from the server 4204.
  • the media manager 4202 / server 4204 combination has a number of features:
  • the combination combines the management of a video server, still store, and character generator under one software interface.
  • the media may consist of video and key.
  • the key can be linked with the video for play out.
  • the server 4204 is an integrated server that is capable of internally keying media, with key signals, and outputting the composite media out a single channel.
  • Clip & Graphic Selection The Media Manager 4202 interfaces with user interfaces 3706, 4006 to allow the user 3704, 4004 to brow a low- resolution image of video clips and graphic files available in the server 4204. These clip or graphic Id's can then be assigned to a particular story within the rundown.
  • Non-integrated servers may only be able to export a list of clip or graphic id's available for selection.
  • the Media Manager 4202 updates the status of a clip assigned to a particular story. When a clip is assigned to a particular story within the rundown, the Media Manager 4202 tracks the air readiness of that particular clip. If a predefined graphic Id were entered into the rundown that does not exist, Media Manager 4202 would notify the rundown that the graphic requested is not air ready. When the production system 3702, 4002 monitors a rundown, a list of clips and graphics is generated under each story slug. If a clip or graphic is not air ready, the text is colored red. The status of the clip or graphic is automatically updated, until the rundown is unmonitored. When a list item that is colored red, becomes air ready, the text is changed to black.
  • the server 4204 is an integrated server.
  • the media manager 4202 communicates and interacts with the server 4204 in the server 4204' s native language, such that the media manager 4202 is capable of accessing additional functionality of the server 4204.
  • the media manager 4202 manages the play-out of server clips and still devices.
  • the media manager 4202 controls what channels (ports) 4206 of the server 4204 these play out, and will ascertain if the clip exists or does not exist.
  • the media manager 4206 automatically assigns the channel that it will be played out on, from the pool of channels that exist. This process is called auto-channeling.
  • the media manager 4202 automatically finds the next unused port 4206 of the server 4204, and uses that port 4206 to output the media from the server 4204. In other words, the port 4206 of the server 4204 need not be hard-coded into the "load media" command.
  • the media manager 4202 can operate with non- integrated, commercially available servers. In this case, it is necessary to produce a configuration file or otherwise inform the media manager 4202 of the number and configuration of the server's ports / channels.
  • Another aspect of the present invention director interface for production automation control is described next with reference to FIGs. 43-48.
  • the present invention provides a director control interface for extracting production information from a newsroom information management system (such as, a news automation system available from iNEWSTM,
  • a producer creates a rundown to select the stories that will be featured on the show.
  • the producer can save the rundown to a rundown file within a newsroom information management system, which allows other personnel involved with the production to gain access to the rundown.
  • An example of a system that integrates a newsroom rundown with a production control system is described in the pending U.S. application entitled “Method, System and Computer Program Product for Full News Integration and Automation in a Real Time Video Production Environment” (U.S. Appl. Ser. No. 09/822,855), which is incorporated herein by reference in its entirety.
  • the director for the show uses the producer's rundown file as the basis for creating a director's rundown sheet.
  • the director's rundown sheet comprises multiple elements for producing a show.
  • An element therefore, comprises a group of commands for instructing a production crew to operate the production equipment and thereby, produce a segment or special effects for a show.
  • An example is a voice-over (VO) element.
  • VO voice-over
  • several commands are required to execute a VO element or line item on the director's rundown.
  • commands are required for a video switcher, audio mixer, teleprompter, and a record/playback device (RPD), such as a videotape recorder/player (VTR) or video server. These commands are "grouped" together to define the VO element.
  • an element represents a group of commands for automating the control of production equipment without significant human interactions.
  • An example of an automated production control environment is described in the aforementioned U.S. application 09/822,855 as well as pending U.S. application entitled “System and Method for Real Time Video Production and Multicasting" (U.S. Appl. Ser. No. 09/634,735), which is incorporated herein by reference in its entirety.
  • an automated production can be managed and controlled by an automation control program, such as the
  • an automation control program includes several groupings of commands, representing a macro element or group of macro elements. Accordingly, the director would create a macro element, comprising all the production commands necessary to represent an element on the show rundown.
  • the macro element is executable to control the designated production devices, and thereby, produce a show segment or special effect, such as an introduction, package and tag segment (LNTRO/PKG/TAG), a voice over segment (VO), a sound-on-tape segment (SOT), an over-the- shoulder segment (OTS), a VO/SOT combination, an on camera segment (ON-CAM), or other types of elements or segments of a show.
  • media production includes the production of any and all forms of media or multimedia in accordance with the method, system, and computer program product of the present invention.
  • a media production includes, but is not limited to, video of news programs, television programming (such as, documentaries, situation comedies, dramas, variety shows, interviews, or the like), sporting events, concerts, infomercials, movies, video rentals, or any other content.
  • a media production can include streaming video related to corporate communications and training, educational distance learning, or home shopping video-based "e” or "t” - commerce.
  • Media productions also include live or recorded audio (including radio broadcast), graphics, animation, computer generated, text, and other forms of media and multimedia.
  • a media production can be live, as-live, or live-to-tape.
  • a media production is recorded and immediately broadcast over traditional airwaves or other mediums (e.g., cable, satellite, etc.) to a television or the like.
  • the media production can be encoded for distribution over a computer network.
  • the computer network includes the Internet, and the media production is formatted in hypertext markup language (HTML), or the like, for distribution over the World Wide Web.
  • HTML hypertext markup language
  • the present invention is not limited to the Internet.
  • a system and method for synchronizing and transmitting traditional and network distributions are described in the pending U.S. application entitled “Method, System, and Computer Program Product for Producing and Distributing Enhanced Media” (U.S. Appl. Ser. No. 10/208,810), which is incorporated herein by reference in its entirety.
  • as-live refers to a live media production that has been recorded for a delayed broadcast over traditional or network mediums.
  • the delay period is typically a matter of seconds and is based on a number of factors. For example, a live broadcast may be delayed to grant an editor sufficient time to approve the content or edit the content to remove objectionable subject matter.
  • live-to-tape refers to a live media production that has been stored to any type of record playback device (RPD), including a video tape recorder/player (VTR), video recorder/server, virtual recorder (VR), digital audio tape (DAT) recorder, or any mechanism that stores, records, generates, or plays back via magnetic, optical, electronic, or any other storage media.
  • RPD record playback device
  • VTR video tape recorder/player
  • VR virtual recorder
  • DAT digital audio tape
  • live-to-tape represents only one embodiment of the present invention.
  • the present invention is equally applicable to any other type of production that uses or does not use live talent (such as cartoons, computer-generated characters, animation, etc.). Accordingly, reference herein to "live,” “as-live,” or “live-to-tape” is made for illustration purposes, and is not limiting.
  • a macro element is imported, or integrated, into an automation control program, such as the Transition MacroTM multimedia production control program developed by ParkerVision, Inc. (Jacksonville, FL) that can be executed to control an automated multimedia production system.
  • an automation control program such as the Transition MacroTM multimedia production control program developed by ParkerVision, Inc. (Jacksonville, FL) that can be executed to control an automated multimedia production system.
  • the Transition MacroTM program is described in the pending U.S. application entitled "System and Method for Real Time Video Production and
  • an automated multimedia production environment includes a centralized media production processing device that automatically or semi- automatically commands and controls the operation of a variety of media production devices in analog and/or digital video environments.
  • the term "media production device” includes video switcher, digital video effects device (DVE), audio mixer, teleprompting system, video cameras and robotics (for pan, tilt, zoom, focus, and iris control), record/playback device (RPD), character generator, still store, studio lighting devices, news automation devices, master control/media management automation systems, commercial insertion devices, compression/decompression devices (codec), virtual sets, or the like.
  • RPD includes VTRs, video recorders/servers, virtual recorder (VR), digital audio tape (DAT) recorder, or any mechanism that stores, records, generates or plays back via magnetic, optical, electronic, or any other storage media.
  • the media production processing device receives and routes live feeds (such as, field news reports, news services, sporting events, or the like) from any type of communications source, including satellite, tenestrial
  • a director control interface links a rundown file from a newsroom information management system with a production control system.
  • the director control interface serves as a management tool for extracting the requisite information from a newsroom rundown file (e.g., the producer's rundown) and populating the production control system with the appropriate macro elements. Therefore, the director control interface of the present invention is compatible with any type of newsroom information management system as long as it can extract the requisite production information.
  • FIG. 43 illustrates a director control interface 4300 according to an embodiment of the present invention.
  • Director control interface 4300 includes a plurality of page control lines 4301(a)-4301(n). Each page control line
  • Control columns 4302-4318 includes production information that has been selected from the newsroom rundown file or inputted by the director.
  • Control columns 4302-4318 includes auto-build column 4302, group column 4303, page column 4304, slug column 4305, on-cam column 4306, camera column 4307, shot type column 4308, VT/NR column 4309, v-source column 4310, SS column 4311, effects column 4312, order column 4313, TME column 4314, layer column 4315, Web ID column 4316, Web segment column 4317, and Web URL column 4318.
  • Auto-build column 4302 is associated with commands for selecting one or more macro elements that, when executed, control a production control system and produce one or more segments of a media production.
  • auto-build column 4302 automatically builds effects column 4312 based on the information in the other control columns 4302-4318.
  • Group column 4303 allows the director to select and group together multiple page control lines 4301(a)-4301(n).
  • Page control lines 4301(a)-4301(n) can be grouped under one story level. Therefore, multiple stories (identified by slug column 4305) can be grouped under a single story level.
  • the grouped page control lines 4301(a)-4301(n) can be moved, deleted, or cached as a group.
  • a single control line 4301(a)-4301(n) or a group of control lines 4301(a)-4301(n) can be stored to a cache button (not shown) that is displayed on director control interface 4300. All data associated with the cached page control line 4301(a)-4301(n) is also stored to the cache button.
  • one or more cache buttons allow the director to float stories and then re-insert them as needed. When activated, a cache button inserts pages or stories stored at the cache button into the page control lines 4301(a)-4301(n) and pushes everything else down.
  • Page column 4304 includes an alpha-numeric designator or page number for each page control line 4301(a)-4301(n).
  • a collection of one or more pages i.e., page control line 4301(a)-4301(n)
  • each control line 4301(a)-4301(n) is sequentially designated as Al, A2, A3, A4, A5, A6, B0, Bl, B2, etc.
  • the first character in page column 4303 identifies a specific block within a media production.
  • a newscast for example, is typically assembled into blocks known as A, B, C, and D blocks.
  • a show block can be used identify segments of a media production that can be used to sell advertisements.
  • Slug column 4305 identifies a unique story slug for each page control line 4301(a)-4301(n).
  • the story slug is unique because the information provided in slug column 4305 does not change and therefore, is a constant descriptor of each control line 4301(a)-4301(n). This can be explained with reference to FIG. 44 and FIG. 45.
  • FIG. 44 Another embodiment of director control interface 4300 is shown in FIG. 44 and FIG. 45.
  • the first control line 4301(a)-4301(n) on director control interface 4300 is "A01 - Shooting”. Specifically, page column 4304 reads “A01,” and slug column 4305 reads “Shooting.”
  • FIG. 45 shows another embodiment of director control interface 4300, where the producer has moved the "Shooting" slug to another position.
  • the slug is now positioned after the control line 4301(a)-4301(n) that has a page column 4304 reading "A05” and a slug column 4305 reading "Touchdown Club.”
  • a new control line 4301(a)-4301(n) has been created and given the designator "A05.5" in page column 4304.
  • the new control line 4301(a)-4301(n) would receive the story slug "Shooting", its script, and all of its production commands, and the previous control line 4301(a)-4301(n) having the value "A01" in page column 4304 no longer exists.
  • the slug value in slug column 4305 is unique, and becomes a key field for synchronizing director control interface 4301 with the newsroom rundown, as discussed in greater detail below.
  • on-cam column 4306 indicates the talent(s) that will speak or read the story identified by slug column 4305.
  • a camera preset and/or audio preset can be established for recording a news anchor.
  • On-cam column 4306 allows one or more anchor names to be associated with a preset position. For example, a "News Set” may consist of Talent Position 1, Talent Position 2, Talent Position 3, and Talent Position 4. The anchor name "Deb” can be assigned to Talent Position 1 , the anchor name "Tom” can be assigned to Talent Position 2.
  • Director control interface 4300 has the ability to equate the names placed in on-cam column 4305 with the talent positions on the "News Set.”
  • Camera column 4307 indicates the camera source for recording story identified in slug column 4305.
  • a primary and secondary camera can be selected.
  • a drop-down list of available cameras can be reviewed for camera selection. The list depends on the talent position and/or desired special effects or shot types.
  • Shot type column 4308 includes instructions for framing a camera shot.
  • the framing can be a straight shot, over-the-shoulder (OTS) shot, wide shot, or the like.
  • OTS over-the-shoulder
  • a dialog box can be opened to display a list of user-defined shot type names that can be selected for entry.
  • VT/NR column 4309 specifies the type of element or segment being produced for the story identified in slug column 4305.
  • a segment type includes an L ⁇ TRO/PKG/TAG, VO, SOT, OTS, VO/SOT combination, O ⁇ -CAM, or the like.
  • a dialog box is opened to display a list of user-defined segment type names that can be selected for entry.
  • V-source column 4310 identifies a machine source and filename.
  • Machine source includes a RPD as described above.
  • the filename can be expressed as a time code, server clip identifier, or the like.
  • V-source column 4310 can include one or more filenames for one or more machine sources.
  • SS column 4311 identifies a source and address for a still store or character generator (CG) device.
  • SS column 4311 can include one or more sources and/or addresses to a single or multiple store or CG devices.
  • Effects column 4312 indicates the type of transition effects or special effects that are needed for the story identified in slug column 4305.
  • the effects include, but are not limited to, fades, wipes, DVE, downstream keyer (DSK) effects, or the like.
  • DVE includes, but are not limited to, wa ⁇ s, dual-box (double box) effects, page turns, music, slab effects, and sequences.
  • DSK effects include DVE and DSK linear, chroma and luma keyers.
  • a dialog box is opened to display a list of user-defined effect names that can be selected for entry. An effect can be assigned to an entire page control line 4301(a)-4301(n).
  • Such global effects include a double box, bump, or the like.
  • An effect can also be assigned to a specific layer of a page control line 4301(a)-4301(n).
  • a second level entry grid can be opened to allow a director to assign an effect to a particular production layer (e.g., camera, tape, still store, etc.).
  • Order column 4313 indicates the order in which events will occur while producing the story identified in slug column 4305. For example, if a page control line 4301(a)-4301(n) includes a camera shot, tape, and still store. Order column 4313 can specify the order as being (CAM, VT, SS), (VT, SS, CAM), (CAM, SS, VT), or the like.
  • TME column 4314 includes an association name or acronym for an association file, which conesponds to one or macro elements for producing a segment of a media production.
  • a tool window is opened to allow the director to search for an association name to select the conect macro element. If auto-build column 4302 is activated, TME column 4314 is left blank and the macro element(s) is automatically selected, as discussed below.
  • Layer column 4315 includes instructions for keying or compositing layers over a backgound image.
  • layer column 4315 specifies the source(s) for a background, key hole, and key fill.
  • Layer column 4315 can also specify a keyer(s), DVE(s), DVE channels, or other related production values.
  • Web ID column 4316 includes post-production distribution instructions for the story identified in slug column 4305.
  • a media production can be encoded for distribution over a computer network, such as the global Internet.
  • Web LD column 4316 enables the director to associate the story of slug column 4305 with a scheduled network distribution.
  • a combo box is opened to list the available shows for encoding. The director selects one of the available shows to associate with the story identified in slug column 4305.
  • Web segment column 4317 identifies a classifier for the story identified in slug column 4305.
  • the director can select the classifier from a combo box listing all show segment classifications, hi an embodiment, the director can choose from a library of major and minor classifications.
  • a major classification or topic can be sports, weather, headline news, traffic, health watch, elections, or the like.
  • An exemplary minor classification or category can be local sports, college basketball, NFL football, high school baseball, local weather, national weather, local politics, local community issues, local crime, editorials, national news, or the like. Classifications can expand beyond two levels to an unlimited number of levels for additional granularity and resolution for segment type identification and advertisement targeting.
  • Web URL column 4318 allows the director to enter auxiliary information for the story identified in slug column 4305. Auxiliary information enhances the value of the story by making available graphics, extended play segments, opinion research data, URLs, advertisements, or the like. Web URL column 4318 includes a filename, path, URL, or like address to auxiliary information that is linked to director control interface 4300.
  • Director control interface 4300 also includes an import activator 4319, link activator 4320, air activator 4321, start time field 4322, end time field 4323, and over/under field 4324.
  • Import activator 4319 instructions director control interface 4300 to import the production information into a production control system.
  • Link activator 4320 instructs director control interface 4300 to monitor the newsroom rundown for changes.
  • Air activator 4321 allows the director to approve a page control line 4301(a)-4301(n) to be executed on a production control system. Once the production control system starts to execute the macro elements imported from director control interface 4300, start time field 4322 displays the time the show begins. End time field 4323 displays the projected completion time for the show.
  • Over/under field 4324 displays a contemporaneous difference between an updated projected completion time and the originally projected completion time displayed in end time field 4323.
  • Each story identified at slug column 4305 has an estimated story time.
  • the story time for the previous story replaces the estimated time for the previous story with the actual time for the previous story.
  • the updated projected completion time is a measure of the actual duration of all executed stories plus an estimated duration for the stories remaining to be executed.
  • the updated projected completion time minus the value of end time field 4323 equals the over/under time reported in over/under field 4324.
  • director control interface 4300 includes a next story button (not shown) and next page button (not shown).
  • the next story button skips to the next story on director control interface 4300. As such, the cunent event is not executed.
  • the next page button skips to the next page number (page column 4304), so that the cunent event is not executed. As discussed above, several pages may compose a single story.
  • flowchart 4600 describes an example of a control flow for building director control interface 4300. Specifically, flowchart 4600 describes an operational flow for setting production values and macro elements for execution on a production control system, according to an embodiment of the present invention.
  • the control flow of flowchart 4600 begins at step 4601 and passes immediately to step 4603.
  • the director identifies or selects the production information for building a director's rundown for a show.
  • the production information is based on industry standard terms. Therefore, the present invention can be implemented in various environments without requiring the director to learn a specific jargon.
  • the production infonnation is collected from a newsroom information management system. As discussed above, a producer selects stories for a show and saves the selections to a newsroom rundown file. Portions of the production information are imported into director control interface 4300 from a newsroom rundown, hi an embodiment, dialog is opened to select a path to the newsroom rundown. Thus, the dialog would contain a tree of rundown files and dates prepared and saved by the producer.
  • the newsroom rundown populates the page control lines 4301(a)-4301(n) of director control interface 4300.
  • the field values in page column 4304, slug column 4305, and on-cam column 4306 are extracted from the newsroom rundown.
  • the director has the option of extracting additional field values (such as, tape, stills, OTS, etc.), as needed to build each story.
  • the director must also specify or confirm a running order of stories by block, page number, and unique slug name.
  • director control interface 4300 has two modes of operation. In manual mode, the director manually selects macro elements for a story. In auto-build mode, director control interface 4301 automatically builds macro elements for a story. The mode determines the type of production information that must be extracted from the newsroom rundown or completed by the director.
  • Auto-build column 4302 must be activated.
  • Page column 4304, slug column 4305, on-cam column 4306, camera column 4307, shot type column 4308, v-source column 4310, SS column 4311, effects column 4312, Web LD column 4316, Web segment column 4317, and Web URL column 4318 must be completed with the requisite data.
  • Auto-build column 4302 must be deactivated.
  • Page column 4304, slug column 4305, on-cam column 4306, camera column 4307, shot type column 4308, VT/NR column 4309, v-source column 4310, SS column 4311, effects column 4312, order column 4313, TME column 4314, layer column 4315, Web LD column 4316, Web segment column 4317, and Web URL column 4318 must be completed.
  • step 4606 one or more macro element files are identified or selected for each story that is uniquely identified at slug column 4305. If manual mode is set at step 4603, the director would input the association names for the appropriate macro element file. If, however, auto-build mode is set at step 4603, functions or routines associated with auto-build column 4302 are executed to select the appropriate macro element files.
  • a library of macro elements is indexed by production field values. The auto-build functions or routines are executed to search the macro element library to find macro element files having production field values that match the production information specified in page control lines 4301(a)- 4301(n).
  • each combination of production values has a default macro element file. Some combinations have a secondary choice, third choice, etc.
  • Auto-building is performed on one page control line 4301(a)-4301(n) at a time. At times, a previous page control line 4301(a)-4301(n) may need to be changed due to selections made on a cunent page control line 4301(a)- 4301 (n). For example, assume there are two DVE devices designated as DVE1 and DVE2. Further assume that DVE1 is the only available DVE that can implement a page turn effect. If fo ⁇ r keyer layers are used on one page control line 4301(a)-4301(n), an auto-build default macro element may be built for DVE1.
  • the auto-build functions or routines must go back to the previous page control line 4301(a)-4301(n) and build effects on DVE2 to allow DVE1 to page turn DVE2 off to transition to the next page control line 4301(a)-4301(n).
  • the auto-build functions or routines selects macro element files based on a user-defined macro element type. The director specifies the type of macro element file that is desired to be built. The auto- build functions or routines identify the appropriate search fields and query the macro element library for the appropriate macro elements.
  • the present invention supports four macro element types, which include a camera macro element type, tape/server macro element type, still store macro element type, effects macro element type.
  • Each macro element type is associated with a combination of different control columns 4302-4318.
  • a camera macro element type is associated with on-cam column 4306, shot type column 4308, camera column 4307, and effects column 4312.
  • a tape/server macro element type is associated with on-cam column 4306, VT/NR column 4309, v-source column 4310, and effects column 4312.
  • a still store macro element type is associated with on-cam column 4306, SS column 4311, v-source column 4310, and effects column 4312.
  • an effects macro element type is associated with a camera macro element type, tape/server macro element type, or still store macro element type.
  • an effects macro element type can be a separate macro element type (e.g., Double Box, Bumps, etc.).
  • step 4609 the page control lines 4301(a)-4301(n) are checked for enors.
  • director control interface 4300 includes a status column (not shown) that indicates the cunent state of each page control line 4301(a)- 4301 (n). If the production information is complete for a particular page control line 4301(a)-4301(n), a status light for the status column turns green. If anything is missing, the status light is red. Additionally, if a page control line 4301(a)-4301(n) does not have sufficient information to auto-build a macro element, the status light turns red and/or TME column 4314 turns red.
  • the status light turns red and/or v-source column 4310 or SS column 4311 turns red.
  • director control interface 4300 detects and/or resolves conflicts while it executes the enor checking process. For example, when a macro element is automatically assigned to a page control line 4301(a)-4301(n), the macro element(s) assigned to the previous page control line 4301(a)-4301(n) is checked for conflicts. If a conflict exists, the conflict is resolved by selecting an alternate macro element. If no alternate macro element is available or has been specified, the story is flagged and/or TME column 4314 turns red.
  • Conflict checking can also be executed for macro elements selected in manual mode.
  • macro elements assigned in TME column 4314 for each page control lines 4301(a)-4301(n) are checked for conflicts with macro elements assigned in a preceding and subsequent page control lines 4301(a)-4301(n).
  • a dialog box is opened to create a list of macro elements that cannot go back to back.
  • the dialog box can also include an option for assigning an alternate macro element to be inserted if a conflict arises. Therefore, back-to-back conflicting macro elements are flagged, and if an alternate macro element has been assigned, the alternate macro element is inserted. If an alternate macro element has not been assigned, the status light would turn red and/or TME column 4314 would turn red to flag the director.
  • shot type column 4308 is checked for conflicts.
  • a conflict may arise if two page control lines 4301(a)-4301(n) specify instructions for back-to-back camera shots that have different field values in shot type column 4308.
  • CAMl has been assigned as a primary camera
  • CAM 2 has been assigned as a secondary camera for two macro element files.
  • the macro element files are associated with two adjacent page control lines 4301(a)-4301(n).
  • an association name for the first macro element file is referenced in TME column 4314 for the first control lines 4301(a)-4301(n).
  • an association name for the second macro element file is referenced in TME column 4314 for the second page control line 4301(a)-4301(n).
  • CAMl has been assigned to execute an OTS camera shot for the first macro element.
  • a different shot type is specified in shot type column 4308 for CAMl in the second macro element. Since CAMl has been selected to record two distinct back-to-back shot type, it would be difficult to produce a smooth transition between the two macro elements.
  • the secondary camera CAM2 is selected for the second macro element. If no secondary camera had been assigned, the status light would turn red and/or camera column 4307 and TME column 4314 would turn red.
  • step 4612 the director imports the production information from director control interface to a production control system.
  • Techniques and/or methodologies for importing a newsroom rundown to populate a control interface for a production control system is described in the aforementioned U.S. application entitled “Method, System and Computer Program Product for Full News Integration and Automation in a Real Time Video Production Environment” (U.S. Appl. Ser. No. 09/822,855).
  • FIG. 47 illustrates a production control interface 4700 for a production control system, according to an embodiment of the present invention.
  • Production control interface 4700 includes a plurality of control lines 4701(a)- 4701(b). As shown, control lines 4701(a)-4701(n) have not been populated with production information from director control interface 4300.
  • the director can activate an icon, use a pull-down menu, or the like to execute an import function.
  • import window 4702 activated from a pull-down tab, identifies the ready-to-air rundown to be converted into macro elements.
  • FIG. 48 illustrates another embodiment of production control interface 4700.
  • control lines 4701(a)-4701(n) have been populated with macro element files following the conversion process.
  • macro element files 4804(a)-4804(e) are associated with production commands for five elements from a show rundown.
  • different colors can be assigned to each macro element file 4804(a)-4804(e) to allow the director to quickly and visually identify the type of element (e.g., VO, INTRO, SOT, or the like).
  • control passes to step 4615 after the production information has been imported into a production control system (such as, production control interface 4700).
  • director control interface 4300 monitors the newsroom rundown for changes (e.g., from the producer). If changes are detected, the present invention provides mechanisms for updating director control interface 4300 and/or production control interface 4700.
  • the field value in slug column 4305 is unique, and represents a key field for synchronizing director control interface 4301 with a newsroom rundown.
  • the slug field is a key for searching the records of the newsroom rundown on a periodically scheduled basis. The records matching the slug key are compared with the production information conesponding to the page confrol line 4301(a)-4301(n) having the same slug value in its slug column 4305.
  • link activator 4320 instructs director control interface 4300 to monitor the newsroom rundown for changes.
  • Link activator 4320 also enables the director to specify the linking mode for conecting or synchronizing director control interface 4320.
  • four linking modes are supported by the present invention.
  • the linking modes include fully linked, timeline approval only, timeline and director interface approval, and fully manual. — Ill —
  • director control interface 4300 In a fully linked mode, changes that are made on the newsroom rundown are automatically updated on director control interface 4300. After director control interface 4300 has been updated, the changes are evaluated for conflicts. If auto-build has been activated, association names for the macro elements files are selected or updated (if required) in TME column 4314. Production control interface 4700 is also updated.
  • director control interface 4300 If the mode has been set for timeline approval only, changes that are made on the newsroom rundown are automatically updated on director control interface 4300. After director control interface 4300 has been updated, the changes are evaluated for conflicts. If auto-build has been activated, TME column 4314 is updated, if required, with the proper association names for macro element files. However, production control interface 4700 is not automatically updated. The director is alerted that changes have been made to director control interface 4300. The director is granted an option to accept the changes and update production control interface 4700.
  • the changes that are made on the newsroom rundown are not automatically made on director control interface 4300.
  • the changes must first be approved by the director.
  • director control interface 4300 has been properly updated, the director must grant authorization to update production control interface 4700.
  • director control interface 4300 In fully manual mode, the changes that are made on the newsroom rundown are automatically updated on director control interface 4300.
  • the director must manually review TME column 4314 and select or update the association names for macro elements, if necessary.
  • the director must re-import the production information from director control interface 4300 to production control interface 4700 to inco ⁇ orate the changes.
  • changes in the newsroom rundown ripples to director confrol interface 4300 and production confrol interface 4700 changes in the newsroom rundown ripples to director confrol interface 4300 and production confrol interface 4700.
  • An anchor read ripple represents an example.
  • a producer may change the talent that has been assigned to read a story or stories.
  • instructions associated with director control interface 4300 re-assigns the macro elements for each story line that has changed.
  • the macro element is compared to the previous macro element for conflicts and the next macro element for conflicts. This process continues down the rundown until no conflicts are found or no macro elements are changed.
  • the director can impose changes onto director control interface 4300 by inserting or deleting page control lines 4301(a)-4301(n). These changes must also be synchronized with production control interface 4700 and the newsroom rundown. For instance, if stories are deleted from director control interface 4300 and not from the newsroom rundown, director control interface 4300 is no longer synchronized with the newsroom rundown and the link between the two is suspended. If link activator 4320 is activated to un-suspend the link, the two rundowns are compared and warnings are issued of any mismatch. The director can decide to accept the newsroom rundown changes or not. If the director chooses to not accept the changes, the link is once again suspended.
  • director control interface 4300 If the director inserts cache pages back into director control interface 4300, the stories are inserted on director control interface 4300, but not on the newsroom rundown. Consequently, director control interface 4300 is no longer synchronized with the newsroom rundown, and the link between the two is suspended. If link activator 4320 is activated to un-suspend the link, the rundowns are compared and warnings are issued of any mismatch. The director can decide to accept the newsroom rundown changes or not. If the director chooses to not accept the changes, the link is again suspended.
  • control flow ends as indicated at step 495.
  • FIGs. 43-48 are conceptual illustrations allowing an easy explanation of the present invention. It should be understood that embodiments of the present invention could be implemented in hardware, firmware, software, or a combination thereof. In such an embodiment, the various components and steps would be implemented in hardware, firmware, and/or software to perform the functions of the present invention. That is, the same piece of hardware, firmware, or module of software could perform one or more of the illustrated blocks (i.e., components or steps).
  • the present invention can be implemented in one or more computer systems capable of carrying out the functionality described above with reference to FIG. 3.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Circuits (AREA)

Abstract

L'invention porte sur un procédé et un système de contrôle d'un studio de production pour la production d'un spectacle télévisé. Ce procédé consiste à envoyer des commandes de contrôle à plusieurs dispositifs de production vidéo depuis une unité de traitement ; à associer au moins une icône représentant des boutons de contrôle du dispositif de production vidéo à au moins une commande de contrôle ; à créer, au moyen d'une interface utilisateur hiérarchique, une macro de transition en plaçant au moins un icone sur une feuille de présence ; et à exécuter, au moyen de l'interface utilisateur hiérarchique, la macro de transition afin de contrôler la pluralité des dispositifs de production vidéo au cours du spectacle télévisé. L'invention se rapporte aussi à un procédé et un système de contrôle d'une pluralité d'incrusteurs automatiques afin de produire une production multimédia composite. Ce procédé consiste à exécuter une première commande de production afin de déterminer la disponibilité de la pluralité des incrusteurs ; à sélectionner un incrusteur disponible en réponse à l'étape (1) ; et à transmettre une commande de contrôle qui, lors de son exécution, demande à l'incrusteur disponible de produire la production multimédia composite en réponse à la réception d'une source de production multimédia et d'une source de remplissage. L'invention a également trait à un système de production comprenant un premier trajet de production, un second trajet de production, et un système de contrôle qui pousse le premier trajet de production à générer un spectacle dans un premier rapport de forme, et qui pousse le second trajet de production à générer le spectacle dans un second rapport de forme. L'invention se rapporte aussi à un système et un procédé de production d'un spectacle. Le procédé consiste à identifier des informations de production afin de créer un sommaire du spectacle ; à sélectionner au moins un élément macro associé aux informations de production ; à importer l'élément macro dans un système de contrôle de production, et à exécuter l'élément macro afin de produire le spectacle.
PCT/US2003/014427 2002-05-09 2003-05-09 Systemes, procedes et programme informatique permettant l'amelioration de la feuille de presence, la saisie automatique au clavier, l'execution automatique en temps reel d'inserts en direct de distribution de contenu stocke recycle, la production en diffusion simultanee automatique a rapport de forme multiple, et interface WO2003096682A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP03724519A EP1552685A4 (fr) 2002-05-09 2003-05-09 Systemes, procedes et programme informatique permettant l'amelioration de la feuille de presence, la saisie automatique au clavier, l'execution automatique en temps reel d'inserts en direct de distribution de contenu stocke recycle, la production en diffusion simultanee automatique a rapport de forme multiple, et interface
AU2003230350A AU2003230350A1 (en) 2002-05-09 2003-05-09 Video production system for automating the execution of a video show

Applications Claiming Priority (14)

Application Number Priority Date Filing Date Title
US37867202P 2002-05-09 2002-05-09
US37867102P 2002-05-09 2002-05-09
US37865602P 2002-05-09 2002-05-09
US37865702P 2002-05-09 2002-05-09
US37865502P 2002-05-09 2002-05-09
US60/378,657 2002-05-09
US60/378,656 2002-05-09
US60/378,672 2002-05-09
US60/378,655 2002-05-09
US60/378,671 2002-05-09
US10/208,810 US20030001880A1 (en) 2001-04-18 2002-08-01 Method, system, and computer program product for producing and distributing enhanced media
US10/208,810 2002-08-01
US10/247,783 US11109114B2 (en) 2001-04-18 2002-09-20 Advertisement management method, system, and computer program product
US10/247,783 2002-09-20

Publications (2)

Publication Number Publication Date
WO2003096682A1 WO2003096682A1 (fr) 2003-11-20
WO2003096682A9 true WO2003096682A9 (fr) 2004-02-26

Family

ID=29424931

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2003/014427 WO2003096682A1 (fr) 2002-05-09 2003-05-09 Systemes, procedes et programme informatique permettant l'amelioration de la feuille de presence, la saisie automatique au clavier, l'execution automatique en temps reel d'inserts en direct de distribution de contenu stocke recycle, la production en diffusion simultanee automatique a rapport de forme multiple, et interface

Country Status (3)

Country Link
EP (1) EP1552685A4 (fr)
AU (1) AU2003230350A1 (fr)
WO (1) WO2003096682A1 (fr)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6972828B2 (en) 2003-12-18 2005-12-06 Eastman Kodak Company Method and system for preserving the creative intent within a motion picture production chain
EP1555772A3 (fr) 2004-01-15 2013-07-17 Yamaha Corporation Procédé de télécommande des dispositifs externes
WO2006103578A1 (fr) * 2005-03-29 2006-10-05 Koninklijke Philips Electronics N.V. Procede et dispositif permettant de produire des images video multiples
AU2008354379A1 (en) 2008-04-11 2009-10-15 Thomson Licensing Auto channel assignment for live productions
US8332754B2 (en) 2009-11-04 2012-12-11 International Business Machines Corporation Rendering sections of content in a document
US8886681B2 (en) * 2010-08-20 2014-11-11 Andrea Keating Data analytics system
CN102256050B (zh) * 2011-08-22 2013-07-17 北京东方艾迪普科技发展有限公司 一种演播室视景智能控制播出系统和方法
US11871138B2 (en) * 2020-10-13 2024-01-09 Grass Valley Canada Virtualized production switcher and method for media production
CN116996631B (zh) * 2023-09-26 2023-12-08 牡丹江师范学院 一种制作实时显示演唱视频的系统及方法

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5231499A (en) * 1991-02-11 1993-07-27 Ampex Systems Corporation Keyed, true-transparency image information combine
JP3320197B2 (ja) * 1994-05-09 2002-09-03 キヤノン株式会社 画像編集装置及びその方法
WO1996032722A1 (fr) * 1995-04-08 1996-10-17 Sony Corporation Systeme de mise en forme
US6134380A (en) * 1997-08-15 2000-10-17 Sony Corporation Editing apparatus with display of prescribed information on registered material
US6452612B1 (en) * 1998-12-18 2002-09-17 Parkervision, Inc. Real time video production system and method
WO2001011627A1 (fr) * 1999-08-06 2001-02-15 Avid Technology, Inc. Generation et utilisation polyvalente de prereglages d'arbre d'effets
DE60131251T2 (de) * 2000-01-14 2008-04-10 Thomson Licensing System zur echtzeit-videoproduktion

Also Published As

Publication number Publication date
EP1552685A4 (fr) 2006-06-07
AU2003230350A1 (en) 2003-11-11
EP1552685A1 (fr) 2005-07-13
WO2003096682A1 (fr) 2003-11-20

Similar Documents

Publication Publication Date Title
US10546612B2 (en) Systems, methods, and computer program products for automated real-time execution of live inserts of repurposed stored content distribution
US20040027368A1 (en) Time sheet for real time video production system and method
US8661366B2 (en) Building macro elements for production automation control
US7835920B2 (en) Director interface for production automation control
US6952221B1 (en) System and method for real time video production and distribution
US7024677B1 (en) System and method for real time video production and multicasting
US8560951B1 (en) System and method for real time video production and distribution
US8006184B2 (en) Playlist for real time video production
KR100473720B1 (ko) 시스템 스트림 재생 제어정보 편집장치 및 그 방법과 그 방법을기록한 기록매체
US20020054244A1 (en) Method, system and computer program product for full news integration and automation in a real time video production environment
US20110107368A1 (en) Systems and Methods for Selecting Ad Objects to Insert Into Video Content
EP1262063B1 (fr) Systeme destines a une production et a une diffusion selective de video en temps reel
US20030214605A1 (en) Autokeying method, system, and computer program product
US7649573B2 (en) Television production technique
WO2003096682A9 (fr) Systemes, procedes et programme informatique permettant l'amelioration de la feuille de presence, la saisie automatique au clavier, l'execution automatique en temps reel d'inserts en direct de distribution de contenu stocke recycle, la production en diffusion simultanee automatique a rapport de forme multiple, et interface
CA2523947C (fr) Construction de macro-elements pour la production de commande d'automatismes
US20080231758A1 (en) Television Production Technique
Leirpoll et al. Multi-Camera Editing

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PH PL PT RO RU SC SD SE SG SK SL TJ TM TN TR TT TZ UA UG UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
COP Corrected version of pamphlet

Free format text: PAGES 19/50, 35/50, 45/50 AND 49/50, DRAWINGS, REPLACED BY NEW PAGES 19/50, 35/50, 45/50 AND 49/50;DUE TO LATE TRANSMITTAL BY THE RECEIVING OFFICE

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2003724519

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2003724519

Country of ref document: EP

NENP Non-entry into the national phase in:

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP