GB2356732A - Editing of recorded material - Google Patents

Editing of recorded material Download PDF

Info

Publication number
GB2356732A
GB2356732A GB9928028A GB9928028A GB2356732A GB 2356732 A GB2356732 A GB 2356732A GB 9928028 A GB9928028 A GB 9928028A GB 9928028 A GB9928028 A GB 9928028A GB 2356732 A GB2356732 A GB 2356732A
Authority
GB
United Kingdom
Prior art keywords
clips
clip
point
source
editing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
GB9928028A
Other versions
GB2356732B (en
GB9928028D0 (en
Inventor
Mark John Mcgrath
Andrew Kydd
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Europe Ltd
Original Assignee
Sony United Kingdom Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony United Kingdom Ltd filed Critical Sony United Kingdom Ltd
Priority to GB9928028A priority Critical patent/GB2356732B/en
Publication of GB9928028D0 publication Critical patent/GB9928028D0/en
Priority to US09/722,122 priority patent/US6771285B1/en
Priority to JP2000360194A priority patent/JP2001202754A/en
Publication of GB2356732A publication Critical patent/GB2356732A/en
Application granted granted Critical
Publication of GB2356732B publication Critical patent/GB2356732B/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34Indicating arrangements 
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/034Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00Record carriers by type
    • G11B2220/40Combinations of multiple record carriers
    • G11B2220/45Hierarchical combination of record carriers, e.g. HDD for fast access, optical discs for long term storage or tapes for backup
    • G11B2220/455Hierarchical combination of record carriers, e.g. HDD for fast access, optical discs for long term storage or tapes for backup said record carriers being in one device and being used as primary and secondary/backup media, e.g. HDD-DVD combo device, or as source and target media, e.g. PC and portable player

Description

1 2356732 EDITING OF RECORDED MATERIAL This invention relates to the
editing of recorded material such as audio and/or video material.
Audio/video edit controllers are used to edit a number of "raw" source material sequences into a final programme or part of a programme. For example, a short news story may contain brief excerpts of a number of different video sequences, possibly including newly captured and older, archived sequences, in order to illustrate different aspects of the news story. A relevant portion or "clip" of each sequence needs to be selected, and the selected portions linked together to form the composite output sequence.
Recently, computer-based non-linear edit controllers have become available.
These allow a user to view the source sequences on a computer screen and to select an "in-point" and an "out-point" for each required sequence or clip using the computer keyboard or a cursor control device such as a mouse, joystick or trackerbaR. The selected clips can then be ordered to form the desired output sequence. An example of such a non-linear editing system is the DNE 700 system available from Sony Corporation (Sony is a registered trademark).
Traditional linear editors are destructive in their adjustment of prior edits, overwriting previous edit decisions with new ones. In contrast, non-linear editors are non-destructive, allowing events that have been edited to the current story or output sequence to be adjusted or trimmed. Various trimming ftmctions are available to non linear editing, allowing edit points or selected events to be adjusted relative to their surrounding events.
It is a constant aim in the field of material editing to improve the convenience of use of the editing equipment.
This invention provides editing apparatus for controlling editing of source audio and/or video material stored as one or more source files on a storage medium to generate an edited material series of clips from the source material arranged as one or more parallel sequences of temporally successive source material clips, at least some of the clips having one or more predefined time points within the clip, the apparatus comprising:
user-controllable means for adjusting the temporal position of a start point, an end point or both of clips in the edited material series, the adjusting means being 2 operable to adjust automatically the temporal position in steps so that at each step the temporal position is aligned with a predefined point of another clip in the same or another parallel sequence.
The invention recognises and addresses a difficulty which can occur when moving clips within an edited series. This difficulty is that on, for example, a display screen of finite resolution it can be difficult for the user to tell when the clip currently being adjusted is aligned with other temporal events such as the beginning or end of other clips, general time points, points predefined as points of interest by the user and so on.
The elegant solution provided by the invention is to allow such temporal positions to be adjusted step-wise, each step resulting in the position under adjustment being temporally aligned with a predefined point in one of the clips.
Further respective aspects of the invention are defined in the appended claims, Embodiments of the invention will now be described with reference to the accompanying drawings in which:
Figure I is a schematic diagram of an audio/video editing system; Figure 2 is a schematic diagram of a digital signal processing card; Figure 3 is a schematic diagram of a timeline; Figure 4 schematically illustrates a linked list of edit information data items; Figure 5 schematically illustrates an edit information data item; Figure 6 schematically illustrates the relationship between a timeline clip and a source clip; Figure 7 schematically illustrates a slide or trim operation; Figure 8 schematically illustrates a slip source operation; Figure 9 schematically illustrates a slip recorder operation; Figure 10 schematically illustrates an indication on the timeline of a loss of synchronisation between tracks; Figures 11 and 12 schematically illustrate nudge alignment during editing operations; and Figures 13a and 13b schematically illustrate screen icons.
Figure I is a schematic diagram of an audio/video editing system. The editing system comprises a general purpose personal computer (PC) 100 having a 3 video display unit (VDU) 110, a keyboard 120 and a cursor control device such as a mouse 130, an editing control panel 140 and an audio/video storage device 150.
In the embodiment described here, the storage device 150 is a so-called "hybrid recorder" manufactured by Sony Corporation and generally available at the priority date of the present application under any of the following part numbers:
DNW AlOO-P, DNW A50-P, DNW A45-P, DNW AlOO, DNW A50, DNW A45.
The hybrid recorder comprises a tape storage system based on a removable cassette and a hard disk storage system providing either 45 or 90 minutes of storage time for audio/video material. Some models also provide rapid streaming between tape io and disk, at a higher than real-time rate. The hybrid recorder is a particularly convenient device to use in an editing system: the controlling device (in this case, the PC 100) provides the hybrid recorder with a "virtual file" indicating, in a particular file protocol, the material to be played back in a certain operation. The hybrid recorder then makes the required material available for playback from disk.
It is possible for the hybrid recorder to play back at least partly from tape instead (albeit using a communication protocol different to the virtual file protocol) although it will be appreciated that playback from disk tends to be more convenient for the present type of work.
The PC 100 comprises a central processing unit (CPU) 101, a random access memory (RAM) 102, disk storage 103, video and input/output (1/0) interfaces 104, a SCSI interface 105 and a digital signal processing (DSP) interface card 106. The CPU 101, RAM 102, disk 103, video and 1/0 104 and SCSI interface 105 are all interconnected via a common bus 107. The system operates under the control of program codes stored in the RAM 102 and/or the disk storage 103.
The PC 100 communicates with the hybrid recorder by two means: the hybrid recorder 150 transmits audio/video material to the PC by a so-called "SDI" transmission link. SDI stands for "Serial Digital Interface" and is an established audio/video transmission format, so particular details of this transmission format will not be given here. Control commands are passed to the hybrid recorder and status information such as a current time code is passed from the hybrid recorder to the PC via a so-called RS422 interface. Again, this is an established interface format and so will not be described in detail here. The DSP card also receives information from the editing panel 140 which comprises a number of push-button 4 controls such as "play", "shuttle forward" and so on, and a jog/shuttle wheel 142.
Details of this communication of data will be described below with reference to Figure 2.
Data is passed to and from the DSP card 106 via a SCSI link using the SCSI interface 105. The data passed to and from the rest of the PC by this route includes control commands, timecode and status information and audio/video information.
The editing system is intended to operate in a non-linear fashion.
Audio/video material stored on the hybrid recorder 150 can be arranged into "clips" which are then ordered one after another in time to form a continuous piece i o of output material. The system provides various graphical user interface (GUI) features to assist the user in carrying out this function. In particular, the system provides a "viewer window" 112 in which the current edited output material or any individual clip can be viewed, a "browser" formed of a set of source material icons 114 each representing an individual source material file which has been set up with an in point and an out point by the user, icons 116 defining a current source file on the hybrid recorder, icons 117 defining an in point and out point of the currently viewed clip, a so-called timeline 118 showing the arrangement of clips forming the output edited sequence in a time order running from left to right of the screen, and a "now-line" 119 showing a current display position on the timeline 118. The timeline 118 and the now-line 119 will be described in much greater detail below.
Figure 2 is a schematic diagram of the DSP card 106. The DSP card 106 comprises a CPU 200 (separate to the CPU 101 of the PC 100) which controls the operation of the DSP card 106, an SDI receiver 210, an audio/video (AIV) buffer 220, an RS422 transceiver 230, a switch scanner 240, a status buffer 250 and a SCSI interface 260.
The SDI receiver 210 receives audio/video information from the hybrid recorder 150. It is noted that there is no need for audio/video information to be returned to the hybrid recorder 150 from the PC 100 all that the PC 100 returns to the recorder is edit control information defining (amongst other things) the order in which material is to be re-played from the hybrid recorder 150. So, the SDI link is unidirectional.
The AN material received by the SDI receiver 210 is buffered in the AN buffer 220. This holds one frame's worth of material, so that when a next frame's material is received it replaces the previously held data. The system used to display the material, for example in the viewer window 112, is that the CPU 10 1 of the PC 100 carries out a loop operation including a request sent via the SCSI interface to the DSP card 106 for a next frame of data. When such a request is received by the SCSI interface 260 on the DSP card 106, the current frame of data stored in the AN buffer 220 is retrieved and transmitted to the CPU 101 and/or video card 104 for display. This loop operation arrangement means that if the CPU 101 has many other tasks to perform at the same time as displaying video in the viewer window 112, the fact that the CPU 101 has to request each frame for display means that frames are automatically delivered at an appropriate rate which io the CPU 101 can handle. It may be that the display in the viewer window 112 occasionally skips frames if the CPU and other system resources are heavily loaded at that time, but overall the arrangement ensures that the display keeps up with real time rather than building up a backlog of undisplayed frames. In any event, in prototype embodiments based around a Compaq Deskpro PC using an Intel Pentium 11 CPU running at 450 MHz,, the situation in which frames are skipped is seen to occur rarely in normal use. (Compaq, Intel and Pentium are registered trademarks).
As mentioned above, the PC 100 transmits control commands to the hybrid recorder 150 via an RS422 link. In particular, any commands to be sent to the hybrid recorder are issued from the CPU 100 via the SCSI interface 105 to the SCSI interface 260 on the DSP card 106. From there they are routed to the RS422 interface 230 and sent onto the hybrid recorder. Examples of the commands transmitted in this way are simple demands such as "play", "stop" or more complex commands such as a command setting up a "virtual file" for replay (reference is made to the literature accompanying currently available hybrid recorder products to define the generation of a virtual file).
Data is also received back from the hybrid recorder via the RS422 interface 230, the SCSI interface 260, the SCSI interface 105 to the CPU 101. Examples of this type of data are details of the AN files stored on the hybrid recorder 150 and the current time code during a replay operation.
The operation of the switch scanner 240 and status buffer 250 will now be described. As mentioned above, the edit control panel 140 includes a number of push-button controls 141 and a jog/shuttle control wheel 142. These controls mimic those often found on audio/video equipment.
1 6 The switch scanner 240 establishes the status of each of these controls at a frequency of at least once per frame period. For the push buttons, which are hardwired directly to the switch scanner, this assessment of status is very simple in that the switch scanner 240 simply assess whether the push button is open or closed (i.e.
not pressed or pressed) at the sampling instant and stores this result in the status buffer 250. In a prototype embodiment there are eight push buttons and so the status of these controls can be stored in a single eight-bit byte in the status buffer 250.
For the jog/shuttle wheel 142, a little more information is required in that the jog/shuttle wheel 142 may move in either direction and by various amounts between sampling instants. The jog/shuttle wheel 142 has a position encoder of conventional type provided in the control panel 140, giving a numerical output indicative of a current position of the wheel 142. The switch scanner 240 samples the current position of the wheel and encodes the difference between the current position and the previously sampled position in an eight-bit byte. Here, the most significant bit is used to flag whether the change in position is positive or negative, the next most significant bit to flag whether the wheel 142 is in a jog or shuttle mode, and the remaining six bits provide a change value of between 0 and 63.
At each frame period, the CPU 101 requests status information from the DSP card 106 where that status information includes the current replay time code and the control panel status from the status buffer 250.
Figure 3 is a schematic diagram of a timeline 118.
As mentioned above, the timeline provides a graphical representation of a succession of video or audio clips 300 along a horizontal time access. The boundaries between clips are indicated by a vertical line (e.g. the line 3 10) in the case of a simple cut transition between successive clips or by more complicated graphical icons such as triangles to represent wipe or fade transitions between successive clips. The length of each clip representation 300 is proportional to the length (in time) of the corresponding clip, that is to say the difference between the clip's out-point time code and its in-point time code. Within a clip, the distance along the clip representation 300 is used to indicate the temporal position within that clip.
The timeline is arranged so as to give a scaleable graphical indication of the sequence of clips. That is to say, although on the screen the display distance 7 between the start of the timeline 320 and the end of the timeline 330 remains the same, the time scale used for the display in between can be varied. This also means that there may well be further clips not displayed to the left and/or to the right of the currently displayed portion of the sequence of clips.
Within each clip representation is a textual indication of the source of that material, for example the name of a file stored on the hybrid recorder 150.
The timeline is arranged as several rows or tracks, labeled in this example as "video", "audio V, "audio 2", "audio 3" and "audio 4". Each of these represents a respective recording track which can form a constituent part of the output edited signal.
The "now-line" 119 is used during a replay operation to indicate a current time. That is to say, during replay the frames or audio data at temporal positions within their respective clips defined by the now-line will be displayed or replayed.
In general, the now-line remains substantially at the centre of the display screen and the timeline scrolls beneath it. In a normal (forward) replay direction, this means that the timeline 'scrolls from right to left underneath the substantially stationary now-line. It can be seen that the material replayed on the different tracks at a particular instant does not have to come all from the same source file. In accordance with normal editing practice, material can be simultaneously replayed from different source files. So, for example, at the particular position of the now line shown in Figure 3, the video and audio 1 tracks come from one source file on the hybrid recorder ("file 007") and the remaining three audio tracks come from a different file ("file 004"). It is further possible that simultaneously replayed clips from the same source file such as the "video" and "audio P tracks at the current position of the now-line on Figure 3 actually represent different portions of those source files. In other words, although the two clips from file 007 appeared to be nominally aligned at their temporal start and end points, this just means that the lengths of the two clips are the same. It does not necessarily mean that the in-point time code and the out-point time code for the two clips are identical, only that the difference (in time) between the in-point and out-point are the same. This matter is referred to as "synchronization" between the clips. A loss of synchronization can have a dramatic effect on the output edited sequence - for example, with speech on an audio track not being properly synchronized with the speaker's lip movements 8 shown on a video track. The way in which the present system deals with a loss of synchronization will be described in particular with reference to Figure 10 below.
A master track indicator 340 indicates one of the tracks which has been selected by the user as a master track. The user can make this selection by moving the mouse cursor to the master track indicator for the desired track and operating one of the mouse buttons. One use of the master track arrangement will be described below in that any synchronisation losses are indicated to the user as differences with respect to the master track, so the master track is by definition fully synchronized.
Figure 4 schematically illustrates a linked list of edit information data items.
The list comprises a list header 400, a series of edit information data items 4 10 and a list ending 420.
The linked list represents the underlying data storage of the sequence of clips for one of the tracks (horizontal rows) of the timeline. So, for the timeline shown in Figure 3, having five tracks, there will be five parallel linked lists of edit information data items 410, each having the list header 400 and a list ending 420.
The content of an edit information data item 410 is shown schematically in Figure 5 to include the following items:
0 Source Identification a Start time code (in-point) 0 Clip ending time code (out-point) 0 Transitions at each end of the clip (e.g. fades, wipes etc) 9 Spot erasers within the clip A flag indicating whether the clip is live or deleted.
The source identification of the edit information data item points to a source definition file 430 containing storage details of that source material on the hybrid recorder 150 and a source title. It is of course possible for several edit information data items to point to the same source definition file 430 if multiple clips (on the same track, different tracks or a combination of these) are derived from a single source material.
The edit information data items 410 in Figure 4 are shown as by directionally linked to adjacent items. That is to say, from any particular item the 1 9 CPU 101 can readily establish which is the preceding item and which is the following item.
Figure 6 schematically illustrates the relationship between a clip on the timeline and a corresponding portion of source material.
For clarity, in Figure 6 only one track of the timeline 118 has been shown in a very schematic form, and all clips except one have been omitted. The one clip which is shown, a clip 450, is displayed on the timeline at a horizontal position representing the display time of that clip with respect to the start of the output edit material. Using the mapping of edit information data items 4 10 to source definition files 430, the clip is mapped to a corresponding portion 460 of the actual source material having an in-point time code and an out-point time code defining each end of that portion.
Several types of editing operation are possible on the clip shown in Figure 6, Examples of these are: "trim in-point, trim out-point, slide in-point, slide out point, slip source and slip recorder". Each of these will be described below.
Figure 7 schematically illustrates a slide or trim operation. In a slide or trim operation, either or both of the start and end points of the clip on the timeline are adjusted and corresponding adjustments take place to the in-point time code and the out-point time code of the corresponding portion of the source material.
In the example shown in Figure 7, both the start and end points on the timeline are moved together by a displacement 470 to the right. So, the clip 450 moves from an initial position on the timeline 480 to a new position 490, also shown as the newly positioned clip 450'. The corresponding section of the source material is changed by altering its in-point time code and out-point time code from an initial portion 460 to a newly positioned position 460'.
Of course, if only the start point on the timeline is moved, or only the end point on the timeline is moved, or the start and end points are moved by different amounts, the length of the clip will change.
The operations described above are common to both a slide and a trim 3.0 operation. The difference between sl ' iding and trimming is that in a slide operation, any changes to the start or end points on the timeline "push" or "pull" the adjacent boundary of the preceding or following clip with them. That is to say, if the end point of a clip is changed by a slide operation to a later end point, the immediately following clip will correspondingly shrink in length by movement of its start point to a later time. After a slide operation, the sum of the lengths of the two clips surrounding the slid boundary remains the same as before; the relative lengths of those two clips might change, however.
Trim operations can be carried out (under user selection) in either a "ripple on" mode or a "ripple off' mode. In "ripple on", any changes to a clip boundary will "push" or "pull" all preceding or following clips with them.
In "ripple off' mode, if the end point of a clip is trimmed to a later position it will in effect overwrite the early part of the following clip. If the end point of a clip is trimmed to an earlier position it will leave a gap between that clip and the io following clip. (Gaps are catered for in the data structure by including an edit information data item with the "live/dead" flag set to "dead").
Figure 8 schematically illustrates a slip source operation.
In a slip source operation, the start and end point of the clip 450 on the timeline, i.e. with respect to other surrounding clips, do not change. Also, the length of the clip 450 does not change. However, the in-point time code and the out-point time code of the corresponding source portion are altered by equal amounts to move the corresponding source portion within the source material. In the examples shown, the source portion 460 is displaced by an amount 470 to a new source portion 460'.
Figure 9 schematically illustrates a slip recorder operation.
This is in many ways a converse of the slip source operation, in that the in point time code and out-point time code of the source portion 460 remain unaltered but the replay position on the timeline of the clip 450 is altered, for example by an amount 470 to a new timeline position 450'.
Figure 10 schematically illustrates an indication on the timeline of a loss of synchronisation between tracks.
The loss of synchronisation is indicated by a text notice replacing the title of the track in question. The text notice 500 gives the synchronisation displacement between the master track defined by the user (in this example, the video track shown at the top of the timeline) and the track in question as a period of time displayed as seconds and ftames or SS:FF. The direction of the synchronisation displacement is also indicated by a positive or negative time difference. This particular aspect can be defined by convention, but in the present embodiment a negative time difference indicates that at the replay time indicated by the now-line 119, the time code of the master track is later than the time code of the non-synchronized track.
The manner in which the lack of synchronisation is detected will now be described.
Synchronisation is checked by a program routine carried out by the CPU 1 when any of the following events occurs.
ò An edit operation alters any of the tracks under the now-line.
ò During a replay or shuttle operation, the now-line crosses a boundary between clips on any of the tracks.
To check the synchronisation, the system first compares the source identification of the edit information data items associated with the current time position to establish whether any tracks apart from the master track come from the same source file as the master track.
If this is found to be the case, then the current (now-line) time code within each of those other tracks is compared with the current time code within the master track. If there is a difference this indicates a potential loss of synchronisation and so is flagged to the user by the indicator 500 as shown in Figure 10.
Of course, a loss of synchronisation may be deliberate, in which case the user may ignore this indication. However, if the loss of synchronisation is accidental, for example occurring because of an earlier trim (ripple on) operation carried out on a different section of the timeline, then it is desirable to correct the loss of synchronisation.
In the present system this is done by the user taking one of two steps: if the user operates the mouse pointer and "clicks" on the synchronisation loss indicator 500, that particular track has its synchronisation restored so that it is now in synchronisation with the master track. Alternatively, if the user clicks on the master track's name (in this example, "video"), then all other tracks are synchronized to the master track.
The mechanism for correcting a synchronisation loss is to carry out a slip source operation by the exact difference of synchronisation. The slip source operation is carried out on the track which is indicated as being out of synchronisation. It is not carried out on the master track.
12 Of course, a slip recorder operation on the track(s) other than the master track could be used instead to correct the lack of synchronisation.
As described, a loss of synchronisation is indicated only with respect to the master track. In other embodiments, however, information can be given about other tracks as well. Consider the example where the five tracks are from the following source files:
video source A (master track) audio I source A audio 2 source A audio 3 source B audio 4 source B The way in which a loss of synchronisation can be indicated and corrected for the video, audio I and audio 2 tracks has already been described. There is no analytical meaning to the concept of synchronisation between source B and source A, so the same mechanism is not used to indicate a loss of synchronisation between tracks audio 3 and audio 4. However, the same detection mechanism can still be used to detect whether there is a relative discrepancy between audio 3 and audio 4. It will not be known at that stage (i.e. while video is the master track) which of audio 3 and audio 4 is the reference and which is in error, but the relative synchronisation loss can be indicated by, for example, colouring the screen display of the names of audio 3 and audio 4 in a different display colour, or by displaying a coloured marker next to the track names. If the user wishes to correct the synchronisation loss the user simply selects (maybe just temporarily) the appropriate one of those tracks as the master track and then corrects the error in the other track exactly as described earlier. Figures 11 and 12 schematically illustrate nudge alignment during editing
operations.
The adjustment process indicated in this example is the moving (trimming or sliding) of a clip 520 (from file 013) in a leftwards or temporally backwards direction. The nudge alignment feature described here is, however, applicable to all six of the editing operations described above with the exception of slip source operations, which of course do not change the layout of the clips on the timeline.
The user selects an adjustment mode of the five to which this feature is applicable, and selects (possibly in the same operation) a clip to which the 13 adjustment mode is to be applied. The user can then operate one of the keys on the keyboard or one on the edit control panel, or operate a screen icon with the mouse pointer, to "nudge", or move step-wise, the selected clip.
The step-wise movement takes the clip from alignment with the start of one clip to the next in the chosen direction. So, in Figures I I and 12, a first step-wise movement has taken the clip 520 from its original position (see Figure 10 for this) to alignment with the start point 530 of the next clip in a leftwards direction. Further nudge adjustment is shown in Figure 12, where the clip 520 is now aligned with the start point 540 of the next clip to the left.
It will be seen that the alignment points used are across the whole set of tracks, including the track of the clip being adjusted (and, indeed, including its own Ccoriginal" position in that track). Further alignment points in addition to or instead of the start point of clips can be used, for example one or more categories of points selected from the following list:
Alignment with the now-line 0 Alignment with record marks 0 Alignment of the adjusted clip's tirnecode with the timecode of other clips 0 Alignment with pre-defined markers of points of interest in that or other clips 0 Alignment with user-defined bookmarks or positions along the tinieline Alignment with preset timing intervals on the timeline 0 Alignment with out (end) points of that or other clips "Shot" markers provided in metadata accompanying the recorded material, possibly inserted by a cameraman or recordist during material acquisition.
Record markers placed by the user into the timeline to indicate the required start and end points of a clip to be inserted.
The list accordingly includes points defined by a user of the editing apparatus and points defined by a user of a different material-handling apparatus such as a camera or recorder. The list includes points related to other clips or related to the timeline.
As mentioned above, although the example illustrates the moving of a whole clip without altering its length, the technique is applicable to editing operations which move only one end of the clip, or move both ends by different amounts.
14 When the clip being adjusted is aligned with the start of another clip, a screen icon 550 is displayed above the point of alignment. Figures 13a and l3b show two possible screen icons, one 550 for indicating alignment between the current point of interest of the clip being adjusted (i.e. the start point in this example) and the start point of another clip, and another icon 560 for indicating alignment between the current point of interest of the clip being adjusted and the end point of another clip. In general, a different type of icon can be used for indicating alignment with each category of point in the list above.

Claims (13)

1. Editing apparatus for controlling editing of source audio and/or video material stored as one or more source files on a storage medium. to generate an edited material series of clips from the source material arranged as one or more parallel sequences of temporally successive source material clips, at least some of the clips having one or more predefined time points within the clip, the apparatus comprising:
user-controllable means for adjusting the temporal position of a start point, an end point or both of clips in the edited material series, the adjusting means being i o operable to adjust the temporal position in steps so that at each step the temporal position is aligned with a predefined point of another clip in the same or another parallel sequence.
2. Apparatus according to claim 1, in which a predefined point for each of the 15 clips is a start point of that clip.
3. Apparatus according to claim I or claim 2, in which a predefined point for each of the clips is an end point of that clip.
4. Apparatus according to any one of claims 1 to 3), comprising means for the user to predefine points as points of interest within the clips.
5. Apparatus according to any one of the preceding claims, in which at each step the temporal position is aligned with a temporally next predefined point in the current 25 direction of adjustment.
6. Apparatus according to any one of the preceding claims, in which temporal alignment at each step is indicated by a screen display item.
7. Apparatus according to any one of the preceding claims, in which at each step the temporal position is aligned with a point in that or another clip defined by metadata accompanying the clip.
8. Apparatus according to any one of the preceding claims, comprising means 16 for storing a linked list of data items associated with respective clips of the edited material series, each data item defining a source file and, relative to the timecode associated with that source file, an in-point timecode and an out-point tirnecode.
9. A method of controlling editing of source audio and/or video material stored as one or more source files on a storage medium to generate an edited material series of clips from the source material arranged as one or more parallel sequences of temporally successive source material clips, at least some of the clips having one or more predefined time points within the clip, the method comprising the steps of- providing for user adjustment of the temporal position of a start point, an end point or both of clips in the edited material series, the adjustment taking place in steps so that at each step the temporal position is aligned with a predefined point of another clip in the same or another parallel sequence.
10. A method of controlling editing, the method being substantially as hereinbefore described with reference to the accompanying drawings.
11. Computer software comprising program code operable to carry out a method according to claim 9 or claim 10.
12. A storage medium carrying computer software according to claim 11.
13. Editing apparatus substantially as hereinbefore described with reference to the accompanying drawings.
GB9928028A 1999-11-26 1999-11-26 Editing of recorded material Expired - Fee Related GB2356732B (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
GB9928028A GB2356732B (en) 1999-11-26 1999-11-26 Editing of recorded material
US09/722,122 US6771285B1 (en) 1999-11-26 2000-11-24 Editing device and method
JP2000360194A JP2001202754A (en) 1999-11-26 2000-11-27 Editing device, its method and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GB9928028A GB2356732B (en) 1999-11-26 1999-11-26 Editing of recorded material

Publications (3)

Publication Number Publication Date
GB9928028D0 GB9928028D0 (en) 2000-01-26
GB2356732A true GB2356732A (en) 2001-05-30
GB2356732B GB2356732B (en) 2003-12-10

Family

ID=10865243

Family Applications (1)

Application Number Title Priority Date Filing Date
GB9928028A Expired - Fee Related GB2356732B (en) 1999-11-26 1999-11-26 Editing of recorded material

Country Status (3)

Country Link
US (1) US6771285B1 (en)
JP (1) JP2001202754A (en)
GB (1) GB2356732B (en)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2374746B (en) * 2001-04-19 2005-04-13 Discreet Logic Inc Displaying image data
AU2002327217A1 (en) * 2001-07-09 2003-01-29 Visible World, Inc. System and method for seamless switching of compressed audio streams
US7391436B2 (en) * 2001-08-28 2008-06-24 Canon Kabushiki Kaisha Image processing apparatus with comparing of difference of camera operation information between image data of plural sections in input image data
JP3731525B2 (en) * 2001-11-09 2006-01-05 ソニー株式会社 Information processing apparatus, information processing method, information processing system, and program
AUPS127702A0 (en) 2002-03-21 2002-05-02 Canon Kabushiki Kaisha Dual mode timeline interface
US20050160470A1 (en) * 2003-11-25 2005-07-21 Strauss Daryll J. Real-time playback system for uncompressed high-bandwidth video
US20050216840A1 (en) * 2004-03-25 2005-09-29 Keith Salvucci In-timeline trimming
US7895617B2 (en) 2004-12-15 2011-02-22 Sony Corporation Content substitution editor
US8041190B2 (en) 2004-12-15 2011-10-18 Sony Corporation System and method for the creation, synchronization and delivery of alternate content
US8577683B2 (en) 2008-08-15 2013-11-05 Thomas Majchrowski & Associates, Inc. Multipurpose media players
CA2600884C (en) * 2005-02-28 2017-05-02 James Monro Productions Inc. Method and apparatus for editing media
US7769819B2 (en) * 2005-04-20 2010-08-03 Videoegg, Inc. Video editing with timeline representations
US8295682B1 (en) * 2005-07-13 2012-10-23 Apple Inc. Selecting previously-selected segments of a signal
US7404150B2 (en) * 2005-11-14 2008-07-22 Red Hat, Inc. Searching desktop objects based on time comparison
DE102005059044A1 (en) * 2005-12-08 2007-06-14 Deutsche Thomson-Brandt Gmbh A method for editing media content in a network environment and device for storing media data
US7495667B2 (en) * 2006-02-24 2009-02-24 Michael Bruggeman Post production integration platform
US8185921B2 (en) 2006-02-28 2012-05-22 Sony Corporation Parental control of displayed content using closed captioning
US9946791B1 (en) * 2006-11-21 2018-04-17 Google Llc Making modified content available
US8020100B2 (en) * 2006-12-22 2011-09-13 Apple Inc. Fast creation of video segments
US8943410B2 (en) 2006-12-22 2015-01-27 Apple Inc. Modified media presentation during scrubbing
US20080256448A1 (en) * 2007-04-14 2008-10-16 Nikhil Mahesh Bhatt Multi-Frame Video Display Method and Apparatus
EP2308047A1 (en) 2008-06-27 2011-04-13 GVBB Holdings S.A.R.L Editing device and editing method
US8910046B2 (en) 2010-07-15 2014-12-09 Apple Inc. Media-editing application with anchored timeline
US8954477B2 (en) 2011-01-28 2015-02-10 Apple Inc. Data structures for a media-editing application
US8966367B2 (en) * 2011-02-16 2015-02-24 Apple Inc. Anchor override for a media-editing application with an anchored timeline
US9997196B2 (en) 2011-02-16 2018-06-12 Apple Inc. Retiming media presentations
US11747972B2 (en) 2011-02-16 2023-09-05 Apple Inc. Media-editing application with novel editing tools
US9578256B1 (en) * 2012-02-29 2017-02-21 Google Inc. Temporary intermediate video clips for video editing
CN107799132A (en) * 2016-09-05 2018-03-13 中兴通讯股份有限公司 A kind of audio clips method and apparatus, and terminal
CN113810751B (en) * 2020-06-12 2022-10-28 阿里巴巴集团控股有限公司 Video processing method and device, electronic device and server
US20230308732A1 (en) * 2020-07-31 2023-09-28 Hitsby Entertainment Inc. System and method of automated media asset sequencing in a media program

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2312139A (en) * 1996-04-12 1997-10-15 Sony Uk Ltd Editing clips of recorded video/audio data
GB2312138A (en) * 1996-04-12 1997-10-15 Sony Uk Ltd Determining replay point of edited sequences of video/audio clips
EP0843311A2 (en) * 1996-11-15 1998-05-20 Hitachi Denshi Kabushiki Kaisha Method for editing image information with aid of computer and editing system
WO1998025216A1 (en) * 1996-12-05 1998-06-11 Interval Research Corporation Indirect manipulation of data using temporally related data, with particular application to manipulation of audio or audiovisual data
WO1999054879A1 (en) * 1998-04-21 1999-10-28 Avid Technology, Inc. System and method for accessing and manipulating time-based data

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE69222102T2 (en) * 1991-08-02 1998-03-26 Grass Valley Group Operator interface for video editing system for the display and interactive control of video material
US5999173A (en) * 1992-04-03 1999-12-07 Adobe Systems Incorporated Method and apparatus for video editing with video clip representations displayed along a time line
AU4027393A (en) * 1992-04-10 1993-11-18 Avid Technology, Inc. Digital audio workstation providing digital storage and display of video information
US5758180A (en) * 1993-04-15 1998-05-26 Sony Corporation Block resizing function for multi-media editing which moves other blocks in response to the resize only as necessary
US5732184A (en) * 1995-10-20 1998-03-24 Digital Processing Systems, Inc. Video and audio cursor video editing system
US5760767A (en) * 1995-10-26 1998-06-02 Sony Corporation Method and apparatus for displaying in and out points during video editing
US6188396B1 (en) * 1996-03-29 2001-02-13 International Business Machines Corp. Synchronizing multimedia parts with reference to absolute time, relative time, and event time
US5889514A (en) * 1996-03-29 1999-03-30 International Business Machines Corp. Method and system for a multimedia application development sequence editor using spacer tools
US5781188A (en) * 1996-06-27 1998-07-14 Softimage Indicating activeness of clips and applying effects to clips and tracks in a timeline of a multimedia work

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2312139A (en) * 1996-04-12 1997-10-15 Sony Uk Ltd Editing clips of recorded video/audio data
GB2312138A (en) * 1996-04-12 1997-10-15 Sony Uk Ltd Determining replay point of edited sequences of video/audio clips
EP0843311A2 (en) * 1996-11-15 1998-05-20 Hitachi Denshi Kabushiki Kaisha Method for editing image information with aid of computer and editing system
WO1998025216A1 (en) * 1996-12-05 1998-06-11 Interval Research Corporation Indirect manipulation of data using temporally related data, with particular application to manipulation of audio or audiovisual data
WO1999054879A1 (en) * 1998-04-21 1999-10-28 Avid Technology, Inc. System and method for accessing and manipulating time-based data

Also Published As

Publication number Publication date
GB2356732B (en) 2003-12-10
JP2001202754A (en) 2001-07-27
US6771285B1 (en) 2004-08-03
GB9928028D0 (en) 2000-01-26

Similar Documents

Publication Publication Date Title
US6771285B1 (en) Editing device and method
US6674955B2 (en) Editing device and editing method
US5467288A (en) Digital audio workstations providing digital storage and display of video information
US6400378B1 (en) Home movie maker
US5682326A (en) Desktop digital video processing system
US6353461B1 (en) Multiple camera video assist control system
US5760767A (en) Method and apparatus for displaying in and out points during video editing
EP1872268B1 (en) Icon bar display for video editing system
US5513306A (en) Temporal event viewing and editing system
JP4117616B2 (en) Editing system, control method thereof and editing apparatus
US6115037A (en) Motion image control method and apparatus
US5732184A (en) Video and audio cursor video editing system
EP0915469B1 (en) Digital video editing method and system
US6324335B1 (en) Editing system and editing method
US6778223B2 (en) Image display apparatus and method
US20040066395A1 (en) Graphical user interface for a motion video planning and editing system for a computer
JPH0643839A (en) Method and device for displaying and editing multimedia information
GB2336025A (en) Video editing apparatus
GB2312081A (en) Text-based video editing system
KR19990072012A (en) Editing system and editing method
US20060168521A1 (en) Edition device and method
US7165219B1 (en) Media composition system with keyboard-based editing controls
EP0916136B1 (en) Graphical user interface for a motion video planning and editing system for a computer
US5781435A (en) Edit-to-it
CN1574930B (en) Apparatus and method for reproducing video contents

Legal Events

Date Code Title Description
PCNP Patent ceased through non-payment of renewal fee

Effective date: 20091126

732E Amendments to the register in respect of changes of name or changes affecting rights (sect. 32/1977)

Free format text: REGISTERED BETWEEN 20160804 AND 20160810

732E Amendments to the register in respect of changes of name or changes affecting rights (sect. 32/1977)

Free format text: REGISTERED BETWEEN 20170717 AND 20170719