Classifications

• • G—PHYSICS
  • G11—INFORMATION STORAGE
  • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
  • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
  • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
  • G11B27/34—Indicating arrangements 
• • G—PHYSICS
  • G11—INFORMATION STORAGE
  • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
  • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
  • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
  • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
• • G—PHYSICS
  • G11—INFORMATION STORAGE
  • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
  • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
  • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
  • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
  • G11B27/034—Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N5/00—Details of television systems
  • H04N5/222—Studio circuitry; Studio devices; Studio equipment
• • G—PHYSICS
  • G11—INFORMATION STORAGE
  • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
  • G11B2220/00—Record carriers by type
  • G11B2220/40—Combinations of multiple record carriers
  • G11B2220/41—Flat as opposed to hierarchical combination, e.g. library of tapes or discs, CD changer, or groups of record carriers that together store one title

Definitions

• the present invention relates generally to an audio/video data management and editing system, and more particularly, to a method and apparatus for editing and managing multimedia data in a multimedia production environment.
• the video production process included the generation and editing of tape-based video for broadcast using videotape retrieved from a videotape archive or produced from one or more sources (i.e., cameras, either studio or field recorded).
• the text production process includes the scripting and editing of text gathered from several sources including a text archive.
• the graphics production process includes the generation and editing of graphics data gathered from several sources.
• Existing news broadcast systems provide the capability for the integration of the video production process, the graphics production process and the on-air operations to provide complete management of audio and video elements of the news program from acquisition, through editing, distribution and on-air play.
• An integrated process in accordance with one such system includes a disk-based video production process integrated with a media production process and on air operations.
• the use of disk-based digital audio/video storage systems, digital networks, and digital nonlinear editing systems has allowed for successful integration of the video production, graphics production and on-air operations.
• Several products are available from Avid Technology, Inc., Tewksbury, MA, for providing such an the integrated system.
• a journalist workstation allows a user of the workstation to access multimedia assets stored in a multimedia archive.
• a user of the journalist workstation can create a story board of a multimedia product for broadcast.
• the story board may include frames of low resolution video from several different sources, text from several sources such as news wire copy, archived text, and text created by the user while creating the story board, graphics, audio, still pictures, and any other form of multimedia data.
• the created story board includes a list of events, such as film clips, text, graphics, audio and still pictures which are to be displayed during specified portions of a broadcast.
• each of the events are forwarded to an associated device that is capable of displaying that event.
• the video clips are forwarded as a list of events to a video playback unit
• the text is forwarded to a text display unit
• the still pictures are forwarded to a still picture unit, and so on.
• Each of these units is individually controlled by a broadcast person.
• the selected events are integrated with live action.
• the integration of events is typically controlled by a director, with the director controlling the operations of each of the broadcast persons at each of the display devices.
• One drawback of such a production system is that the increased manpower required to control the sequence of events requires close synchronization by the director and introduces opportunities for error.
• a machine control subsystem is used to provide centralized control during broadcast in a news production system.
• a director workstation is coupled to a server, which is in turn coupled to any number of external devices that may be used during broadcast to air and display video or audio images.
• the director workstation uses a graphical user interface to display a list of events that are to occur during the production. The events include all events that are to be aired by any of the coupled devices.
• a director at the workstation may then control the production of all of the types of events from a centralized control station. To select an event or a sequence of events for production, the director may simply select the event from an event list, and the event will be broadcast without the director having to know particular characteristics of the device to display the event.
• the director workstation is coupled to a server.
• the server includes device manager software for interfacing with and controlling the operation of all of the externally coupled devices. By providing a centralized communication pathway between the director workstation and the devices, the server may forward status information about the devices to the director workstation to facilitate redirection of resources by the director.
• One aspect of the invention is a news production system including a workstation coupled to a network for receiving a list of events to be broadcast during a newscast. At least one server is coupled to the workstation for controlling a plurality of different types of devices. The server also receives commands from the workstation identifying at least one event for broadcasting on one of the different types of devices.
• Figure 1 is a block diagram of a news production system incorporating the present invention
• Figure 2 illustrates an exemplary graphical user interface for use in providing centralized control during broadcast in the news production system of Figure 1.
• Figure 1 illustrates one embodiment of a digital multimedia newsroom production system 10 that is shown to include three major subsystems, a video production system 12, a client server/core newsroom system 14 and an operations system 18.
• the components of the core newsroom system and the are interconnected using a digital network 20.
• the digital network 20 is implemented using an Ethernet network having a data rate greater than or equal to 100 Mb/s.
• the network 20 couples the three operative components 12, 14 and 16 together via bridges 22 and 24. The operation of each of the subsystems 12, 14 and 16 of the system are described in greater detail below.
• the video production system 12 provides audio/video capture, media data editing, and management and control of high quality multimedia data suitable for broadcast.
• Multimedia data is defined as any form of information that can be represented in a digital form.
• the video production system includes a capture manager 24 coupled to control a news cutter/media recorder 23.
• a media recorder is the Avid Media RecorderTM available from Avid Technology Inc., Tewksbury, Massachusetts.
• the capture manager controls the conversion of the NTSC or PAL video into digital form, and forwards the converted data to an encoding station 26.
• the video data is compressed in either JPEG or MPEG format the compressed audio/video is forwarded over network 20 via bridge 22 to a number of news servers 42a-42c in server subsystem 14.
• An asset manager 27 controls the indexing and storage of the compressed video data.
• a storage array 30 is also included for retaining archived audio/video data. Access to images stored in RAID array 30 is controlled via a browse server 32.
• a digital playback system 31 is coupled via a switch 38 to components in the video subsystem.
• the digital playback system 31 is a digital, disk-based playback system that manages the broadcast to air of multimedia data produced and stored within the video production system.
• the digital playback system plays materials stored either locally, at storage devices 30, or on the media server 42a-42c.
• the digital playback system is implemented using an Avid AIRPLAY broadcast system available from Avid Technology, Inc.
• graphics workstation 28 The number of graphics workstations, such as graphics workstation 28, are used for generating and editing graphics material for broadcast and storage in the video production system.
• the graphics workstation 28 is implemented using a MATADOR workstation available from Avid Technology.
• the server subsystem 14 is shown to include a number of journalist workstations, such as video editing workstation 40, coupled to the network 20 via a 10 base T hub 37 to news servers 42a - 42c.
• the number of journalist workstations used in the server subsystem is based on several factors including the amount of network activity generated by each user of the workstations and by the amount of delay each user will tolerate in accessing the system.
• each journalist workstation 40 is implemented using an MPC III compliant workstation.
• the journalist workstation provides access to multimedia data from a variety of sources and includes the tools (i.e., software) necessary to create a multimedia story board of a news story for broadcast.
• the multimedia data available to the journalist includes the low resolution MPEG video data captured by the media recorder 23.
• Each of the journalist workstations advantageously includes a video port (not shown) for receiving video from, for example, a video tape recorder.
• Each of the journalist workstations also includes a serial port (not shown) for controlling the video tape recorder.
• Each of the news servers 42a-42c provides the management and storage of multimedia data in the newsroom environment.
• the news servers arc configured as distributed processors with mirrored data bases to provide maximum reliability and performance.
• Other centralized functions, such as communications functions, are managed by the news servers 42a-42c.
• the news servers may be implemented, for example, using an Avid NewsServer workstation available from Avid Technology, Inc.
• the news servers have external connections 122 for providing access to news wire services and to allow remote access to the news server from users external to the core news room system.
• the server subsystem 14 may also include an interface such as interface 45 for providing connections to the digital network 20 for user terminals such as user terminal 46.
• the user terminals may be one of several different terminals used in prior art systems primarily for text processing and communications functions.
• a number of device controllers may also be coupled to the digital network 20 to provide control of several multimedia devices, such as teleprompters, from the journalist workstations.
• the journalist workstation 40 executes numerous functions in the news room. For example, the workstation 40 captures, stores and catalogs news wire text. It is used to create, store and catalog news story text. It is also used for capture, editing, playback, storage and cataloging of high resolution video. It is used for editing and browsing of low resolution video. All these functions are used by a journalist at the workstation 40 to create a rundown. The rundown is a list of events that are to occur during the broadcast. The rundown is forwarded from the server subsystem 14 over to the machine control subsystem 16.
• Machine Control Subsystem The machine control subsystem 16 includes three main functional components; one or more machine control servers 50, a technical directors workstation 52, and a serial port connector 54.
• the serial port device 54 provides connection pathways between the machine control server and a number of other external devices.
• One serial port device for use in such a system is the Avanstar connector provided by Digi International, Inc., Eden Prairie, Minnesota.
• Device manager software 51 executing at the machine control servers 50 and, optionally on devices coupled to the machine control servers 50, controls the transmission of data to the external devices, such as still image store 56, character generator 58, video switcher 60 and video playback unit 62.
• the still image store is for controlling the display of still images, stored in the new servers 42a-42c.
• the character generator 58 stores and displays character information, received over network 20, such as text for teleprompters, and text that is to be overlaid on an image (such as identification characters over a still image or video clip).
• the video switcher 60 controls the display of video sequences stored in news server 42a-42c.
• the video playback unit 62 cntrols the issuance of audio during production.
• the Technical director workstation 52 provides intelligent, user-friendly, interactive control for newsroom production.
• the workstation may be, for example, an Avid Workstation running Windows NT.
• the control of components coupled to the Technical Directors Workstation is managed via a graphical user interface, such as that shown in Figure 2.
• the graphical user interface 70 allows the user to select events for playing on one of the devices such as still store 56 or character generator 58. The user may select one event, or may alternatively select a range of machine events which will then play in sequential order without stopping.
• An event list is provided at the user interface 70 for displaying a portion of the run down received from the server 14.
• the data sent from the server 14 to the machine control subsystem 16 is communicated using a suitable protocol.
• the protocol is a packet type protocol.
• the information for each event may include, for example, a short name, or 'slug' 70b identifying the subject matter of the event, a status 70c of the event, a tape ID 70d for referencing a video segment, a total time 70e of the event, a back time 70f, indicating the expected completion time of the event, a device field 70g, indicating the device on which the event is to be broadcast, a device status field 70h, indicating whether the device is currently in use, and a channel field 70i for indicating a channel on which the audio is to be broadcast.
• a user may select an event, or sequence of events, by depressing a mouse button over an event, and dragging the mouse to select a section of events for processing.
• Some available functions that can be performed on the event are outlined in the machine pull down menu 80. These functions include a play, cue, stop, reload, and block play function.
• the play function causes the event to be forwarded to the device listed in field 70g of the event.
• the cue function also forwards an event to the device listed in its associated device field 70g, placing it behind a currently executing event.
• the stop function 80c stops the display of the event at the device, and the reload function 80d allows for the event to be reloaded at the device.
• the block play function 80e allows for multiple events to be sent as a 'block' over to the server.
• a user selects an event, and all of the events suceeding the selected event, up until a break point, are forwarded as a group to the server for processing.
• the block play function allows for all of the events until the next break period to be played in sequence, without intervention from the director.
• the block play is a useful tool for displaying sequences of video clips for news programs that principally use pre-taped programming.
• the play function 80a is also used to support compound events.
• Compound events are a series of machine control events that are linked together at the journalist workstations 40 and appear as one single event that incorporates all of the linked events. Compound events differ from block play, since in block play there are still multiple events that are joined together to play sequentially.
• the introduction of compound events allows for events, such as a video, and a character generation font, that are broadcast together, to be linked together as one event.
• Each of the events in the compound event series include an optional offset from the beginning, so that they do not all start at once.
• a video clip may include sound bits from Alan Green and Bob White.
• a compound event for the clip may look like: play the clip; at 13 seconds after the start, display "Alan Green” for 10 seconds; at 32 seconds after the start, display "Bob White” for 10 seconds; when the video clip is finished, display a still store image.
• the 'block play' menu item in the graphical user interface is provided for attaching events together.
• most compound events are received explicitly from the new server 14 as part of the run down.
• the compound event may be explicitly described, as in the above example, or described using a template of events, time offsets, and source materials.
• the compound events allow for support of common operations such as bringing up a title over a video clip at the same time the clip starts playing.
• the compound event allows multiple events to be represented as a single, macro event in a rundown list.
• the graphical user interface 70 additionally includes a device status window 82 for displaying the status of the attached devices.
• a device status window 82 for displaying the status of the attached devices.
• FIG. 2 A portion of one rundown list is shown in Figure 2. Although only one rundown is displayed at a given time, multiple rundowns may be stored at the technical director workstation.
• the director may select a next rundown from a list of rundowns, or alternatively rundowns may be automatically provided to the graphic user interface
• control over the entire production is centralized at one workstation, thus requiring intervention by only one operator and removing the ambiguity presented by having multiple operators controlling multiple external devices.
• device control may be automated, and the manual operator need not know the particulars of controlling each of the specific external devices.
• An additional benefit of providing the status of all of the events and devices coupled to the system in one graphical user interface is that it allows the director to over ride device assignments and channel assignments based on the status of the devices as viewed at the interface. For example, the director may override the channel assignment to maintain continuity if there are two back to back audio clips directed to different channels. In addition, if one of the devices becomes unavailable, the director may easily modify the run down to change device assignments of subsequent events.
• FIG 2 An example graphical user interface and associated functions have been described and illustrated in Figure 2, it should be understood that the user interface may be augmented to provide other types of functions that facilitate broadcast production. Thus the graphics user interface is meant only as an example, and not intended to be limiting, but rather intended to introduce a concept of centralized production control.
• the machine control server 50 is the central contact point for all of the components in the machine control subsystem 16.
• the machine control server 50 also maintains a composite list of events as defined by the rundown. When an event or group of events is selected by the technical director workstation, the event data, including device, event ID, or slug, and channel information, is forwarded to the machine control server 50.
• the machine control server forwards the received events in the form of commands, based on the received type of event and device data, to the associated device using the device manager software 51.
• Device manager software is typically provided with an associated device, and includes protocol and data management routines for controlling communication with that external device.
• Device manager software that is to be used with the MC servers should also be able to communicate with the server 14 according to the protocol. As a result, device status information may be made readily available to the user to facilitate device and channel reassignment during broadcast.
• the machine control server thus provides a centralized communication pathway for exchanging data between the server 14, the technical director workstation 52 and each of the coupled devices 56-62. Although only 8 devices are shown coupled to the machine control server 50, in one embodiment the server 50 is capable of supporting 32 devices simultaneously. As technology advances, it is envisioned that future embodiments will include the capability of supporting more than 32 devices.
• the machine control subsystem may include dual servers 50a and 50b, configured to provide redundant support.
• control is switched to the other server.
• This process is referred to as a 'warm start'.
• the warm start which allows for a continuance of processing by the redundant server within two minutes, occurs in response to a combination of commands entered at the technical directors workstation 32.
• Serial lines to individual devices are switched to the redundant server using the AB switch 65. The switching operation may occur manually, or may be performed automatically via a command from the technical director workstation.
• the machine control server additionally supports the concept of virtual devices, as seen by the journalists.
• a journalist can specify a machine control event for a named device that actually represents some combination of devices. For example, two AirPlays and a switch can be made to look like one dual channel Airplay to the journalist.
• Avid News broadcast system it should be understood that it may be readily adapted to support otheer types of news broadcast systems.
• the machine control subsystem 16 can also be used with NewsView, a news product for Novell® computer systems.
• a computer process would be provided for monitoring the News View database, and communicating changes to the machine control server 50 using the Avid Machine control protocol via network 20.
• a graphical user interface allows for a director, at one workstation, to control a variety of types of events that occur on multiple types of devices.
• the director may track the availability of resources, and update the device selection as required during live production.
• the graphical user interface allows for sequences of events to be selected to simplify the production of multiple, pre-generated video clips.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
• Television Signal Processing For Recording (AREA)
• Management Or Editing Of Information On Record Carriers (AREA)

Applications Claiming Priority (3)

Publications (1)

Family

ID=25262825

Family Applications (1)

Country Status (5)

Families Citing this family (23)

• 1998
  • 1998-03-30 WO PCT/US1998/015795 patent/WO1999005821A2/en active Application Filing
  • 1998-03-30 CA CA002284886A patent/CA2284886A1/en not_active Abandoned
  • 1998-03-30 JP JP50507399A patent/JP4278189B2/ja not_active Expired - Fee Related
  • 1998-03-30 EP EP98957305A patent/EP0972260A2/en not_active Ceased
  • 1998-03-30 AU AU13592/99A patent/AU1359299A/en not_active Abandoned

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events