GB2262198A - Video to film conversion - Google Patents

Video to film conversion Download PDF

Info

Publication number
GB2262198A
GB2262198A GB9125732A GB9125732A GB2262198A GB 2262198 A GB2262198 A GB 2262198A GB 9125732 A GB9125732 A GB 9125732A GB 9125732 A GB9125732 A GB 9125732A GB 2262198 A GB2262198 A GB 2262198A
Authority
GB
United Kingdom
Prior art keywords
frames
fields
interpolation
field
input
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
GB9125732A
Other versions
GB9125732D0 (en
GB2262198B (en
Inventor
John William Richards
Morgan William Amos David
Martin Rex Dorricott
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Broadcast and Communications Ltd
Original Assignee
Sony Broadcast and Communications Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Broadcast and Communications Ltd filed Critical Sony Broadcast and Communications Ltd
Priority to GB9125732A priority Critical patent/GB2262198B/en
Publication of GB9125732D0 publication Critical patent/GB9125732D0/en
Priority to US07/964,091 priority patent/US5430489A/en
Priority to JP4324338A priority patent/JPH0622210A/en
Publication of GB2262198A publication Critical patent/GB2262198A/en
Application granted granted Critical
Publication of GB2262198B publication Critical patent/GB2262198B/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/84Television signal recording using optical recording
    • H04N5/87Producing a motion picture film from a television signal
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/01Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0112Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level one of the standards corresponding to a cinematograph film standard

Abstract

In order to simulate, on set or on location, a subsequent video to film conversion process, an input interlaced video signal is converted in any of a variety of ways to a progressive scan format video signal, and then interlaced fields of the progressive scan format frames are displayed on a video monitor or view finder. <IMAGE>

Description

VIDEO TO FILM CONVERSION This invention relates to video to film conversion.
Recent developments in video signal processing have enabled a whole host of different video effects and operations, and the use of high definition digital video provides quality which is approaching, or even surpassing that obtainable by conventional film. However, for many years to come, there will be a need to be able to distribute as film or the ].ike material which has been processecl, if not also acquired, in high definition digital video format.
One popular video standard (SMPTE 240M) is characterised by 60 fieids per second and a 2:1 interlace. However, established standards for film are 30 frames per second and 24 frames per second. Sony Corporation has developed an electron beam recorder which can produce film material from a video signal and has also developed apparatus for converting the video signal from a standard format to a format which the electron beam recorder can use.
In one previously proposed process for recording SMOTE 240M video as 30 frame/s film, called a "field combination process", pairs of temporally adjacent fields of the 60 field/s video signal are composited to produce frames at 30 frame/s, and the frames are recorded on film. However, this process produces film which suffers from "double-imaging" in areas of motion. therefore, an improved process has been developed, involving "motion compensated temporal interpolation", in which: (i) frames at 60 frame/s are produced, each either from one or from three of the input fields, (ii) motion is detected in areas of the picture between pairs of temporiilly adjacent frames, (iii) output frames are produced at 30 frame/s, with each pixel of each output frame derived from pixels in the respective pair of 60 frame/s spatially displaced from the output pixel in dependence upon the detected motion and the temporal offset between the output frame and the two progressive scan frames from which it is formed, and (iv) the output frames are recorded on film. (Interlace to progressive scan conversion is described in detail in United Kingdom patent application GB 2231228A, especially wit reference to Figures 5 to 14 thereof).
Motion compensated temporal interpolation is also described in GB 2231228A, especially with reference to Figures 15 to 48 thereof.
Conversion from 60 field/s 2:1 interlace video to 30 frame/s film is described in detail in United Kingdom patent application GB 9024836.6 filed 15 November 1990 particularly with reference to Figures 57 to 60 thereof. The contents of GB 2231228A and GB 9024836.6 are incorporated herein by reference as if printed in full below.) This motion compensated temporal interpolation process is computationally intensive, and therefore requires complex, bulky and expensive apparatus, and with present technology cannot operate at real-time rate, but it does overcome to a large extent the double imaging problem.
In another previously proposed process for recording SMPTE 240M video as 24 frame/s film, known as the "drop field process", in a sequence of ten fields of the video signal, fields 3 and 8, for example, are ignored, the fields df each remaining pair of temporally adjacent fields (1 and 2; 4 and 5; 6 and 7; and 9 and 10) are composited to produce four frames at 24 frame/s, and these frames are recorded on film. Like the field combination pr-ocess, the drop field process also suffers from double imaging in areas of motion.
Furthermore, there is a 12 Hz temporal judder because a predetermined pair of the ten input fields are ignored. Therefore, an improved process has been developed, again involving motion compensated temporal interpolation, in which: (i) frames at 60 frame/s are produced, each either from one or from three of the input fields; (ii) motion is detected in areas of the picture between pairs of temporally adjacent frames; (iii) output frames are produced at 24 frame/s, four for every ten of the 60 frame/s frames, with each pixel of each output frame derived from pixels in a respective pair of the 60 frame/s frames spatially displaced from the output pixel in dependence upon the detected motion and the temporal misalignment between the output frame and the pair of frames from which is formed; and (iv) the output frames are recorded on film.Conversion from 60 field/s 2:1 interlace video to 24 frame/s film is described in GB 2231228A with reference to Figures 1 to 48 thereof. Again, this form of motion compensated temporal interpolation is computationally intensive, requiring complex, bulky and expensive apparatus, but it does overcome the double imaging problem and the judder problem to a large extent.
The lower output frame rate of 24 Hz can only support motion resulting in temporal frequencies up to 12 Hz in a picture without alias. Motion with components between 12 Hz and 30 Hz can be captured but only as aliased components. When the picture is down converted to the 24 Hz frame rate, even using motion compensated interpolation, all motion with temporal frequency components above 12 Hz will be aliased to lower frequencies and produce subjectively poor motion portrayal.
Both the drop fielcl process and the more complex motion compensated interpolation process produce the correct output temporal rate, but introduce motion artifacts in the output picture due to the down conversion from 30 Hz to 24 Hz frame rate. A similar problem arises in conversion from 60 field/s 2:1 interlace to 30 frame/s film. However, the motion artifacts are less pronounced.
When a picture is shot on a set or on location using video, the video material can immediately be viewed using a video monitor or viewfinder. It is, however, impracticable to convert the material to film, on set or on location, using the processes mentioned above, because the cost and size of the required equipment are prohibitive.
When the video material is viewed on set or on location, the above mentioned motion artifacts which may later be introduced by or become apparent due to the video to film conversion process will not be apparent, and if the subsequent conversion process introduces artifacts which are unacceptable, it is extremely expensive to reshoot the video at a later date, for example with slower pans or action, in an attempt to obtain an artifact free end product.
An aim of the present invention is to provide a method which can simulate, on set: or on location, motion artifacts which may be introduced in a subsequent video to film conversion process.
In accordance with the present invention, there is provided a method, preferably performed at real-time rate, of displaying an input interlaced format video signal on an interlaced display, comprising the steps of: forming from at least some of the fields of the input video signal a series of progressive scan format frames, preferably at the frame rate of the film which will subsequently be produced; and displaying sequentially interlaced fields of the progressive scan format frames. Because there is no temporal offset between the fields of each displayed field pair, the method is better able to simulate subsequent motion artifacts arising in video to film conversion than if the input interlaced video signal were simply displayed on an interlaced monitor especially as film projectors generally have a double-shuttered projection system.
In one version of the method of the invention, which can simulate the drop field and field combination processes, each progressive scan format frame is produced by vertical interpolation of and temporal interpolation between a respective pair of the input fields. Due to the temporal interpolation, double imaging will occur in the displayed picture in areas of motion, as it does in the actual drop field and field combination processes. When simulating the drop field process, two out of every ten fields of the input signal are dropped, and therefore a temporal judder will be introduced in the displayed picture, as in the actual drop field process. Alternatively, when simulating the field combination process, no input fields are dropped, and accordingly there will be no temporal judder.The vertical and temporal interpolation may be performed by a two-dimensional filter, or alternatively by forming a preliminary series of progressive scan format frames at twice the frame rate of the first-mentioned series of progressive scan format frames, each of the frames in the preliminary series being produced by intra-field interpolation of a respective one of the input fields; and forming each of the frames in the firstmentioned series by inter-frame interpolation between a respective pair of frames of the preliminary series.
In another version of the method of the invention, which can simulate to some extent the motion artifacts arising in the motion compensated temporal interpolation processes, each of the progressive scan format frames is produced by intra-field interpolation of a respective one of the input fields and/or by inter-field interpolation between the fields temporally adjacent that field. This version of the method partially imitates the actual processes because it removes the double image, but there is some loss of vertical resolution. In order to simulate the actual process for conversion from 60 field/s 2:1 interlace to 24 frame/s, conveniently four out of every ten fields of the input signal provide said one fields. However, this does suffer from a disadvantage that a temporal judder is produced in the displayed picture.On the other hand, in order to simulate the actual process for conversion from 60 field/s 2:1 interlace to 30 frame/s, conveniently alternate input fields provide said one fields. In this case there will be no temporal judder.
In a modification to the simulation method described in the preceding paragraph, some of the frames of said series of progressive scan format frames are each produced by vertical interpolation of and temporal interpolation between a respective pair of the input fields; and others of the frames of the said series are each produced by intrafield interpolation of a respective one of the input fields and/or by inter-field interpolation between the fields temporally adjacent that input field. This removes the temporal judder described in the preceding paragraph. However, said some frames have high resolution in static areas and double imaging in areas of motion, and said other frames have lower resolution in areas of motion if intra-field interpolation is used. The switching between these types of frame may be noticeable.The temporal and vertical interpolation may be performed by a two-dimensional filter, or alternatively by producing a respective preliminary progressive scan format frame from each field of said pairs of fields, and by forming said some frames by inter-frame interpolation between the frames of the pairs of preliminary frames.
In one example of this modified method, first and third of four of the progressive scan format frames are formed by vertical interpolation of and temporal interpolation between first and second, and sixth and seventh, respectively of ten of the input fields; the second of the four frames is formed by intra-field interpolation of the fourth of the ten fields and/or inter-field interpolation between the third to fifth of the ten fields; and the fourth of the four frames is formed by intra-field interpolation of the ninth of the ten fields and/or interfield interpolation between the eighth to tenth of the ten fields.
In a further modification, which attempts to overcome the switching problem, the frames of the series are each produced by temporal interpolation between a respective pair of temporally adjacent fields of the input signal. In one way of doing this, alternate frames of the series are produced with one temporal interpolation ratio (for example 1/4 : 3/4) and the other frames of the series are produced with another interpolation ratio (for example 3/4 : 1/4). When using this method to simulate conversion from 60 field/s 2:1 interlace to 24 frame/s film, four frames of the series of progressive scan format frames are temporally interpolated between four pairs of a series of ten input fields. This modification improves motion portrayal, but at the expense of slightly reduced dynamic resolution.
Specific embodiments of the present invention will now be described by way of example, with reference to the accompanying drawings, in which: Figure 1 illustrates the known drop field process for converting 60 field/s 2:1 interlaced video to 24 frame/s film; Figure 2 illustrates an unacceptable simulation of the Figure 1 process; Figure 3 also illustrates an unacceptable simulation of the Figure 1 process; Figure 4 illustrates a first example of a method according to the invention for simulating conversion from 60 field/s 2:1 interlaced video to 24 frame/s film; Figure 5 illustrates a known process for converting 60 field/s 2::1 interlaced video to 24 frame/s film using motion compensated temporal interpolation; Figure 6 illustrates a second example of a method according to the invention for simulating the Figure 5 process; Figure 7 illustrates a first modification to the Figure 6 example; Figure 8 illustrates a second modification to the Figure 6 example; Figure 9 illustrates a known process for converting 60 field/s 2:1 interlaced video to 30 frame/s film by field combination; Figure 10 illustrates a third example of a method according to the invention for simulating the Figure 9 process; Figure 11 illustrates a previously proposed process for converting 60 field/s 2:1 interlaced video to 30 frame/s film using motion compensated temporal interpolation; Figure 12 illustrates a fourth example of a method according to the invention for simulating the Figure 11 process; and Figure 13 is a block diagram of an apparatus for performing the examples referred to above.
Referring to Figure 1, in known conversion from 60 field/s 2:1 interlace video to 24 frame/s film by the drop field process, in a sequence of ten input fields IFD1 to IF 10, the first two input fields IED1 and IFD2 of opposite polarity are composited to produce a first output frame OFM1; the third input field IFD3 is ignored or dropped; the fourth and fifth input fields IFD4 and IFD5 of opposite polarity are composited to form the second output frame OFM2; the sixth and seventh input fields IFD6 and IFD7 of opposite polarity are composited to form the third output frame OFM3; the eighth input field IFD8 is dropped; and the ninth and tenth input fields IFD9 and IFD10 are composited to form the fourth output frame OFM4. The output video frames are then recorded on film F. It can be seen that the first and third output frames OFM1 and OFM3 are temporally sited relative to their originating fields IFD1 and IFD2, and IFD6 and IFD7, respectively, differently to the temporal siting of the second and fourth output frames OFD2 and OFD4 relative to their originating fields IFD4 and IFD5, and IFD9 and FIDlO, respectively. Therefore, there is a temporal judder in the output picture, at 12 Hz. Also because of the temporal offset between the two input fields, for example, IFDI and IFD2, making up a single output frame, for example OFM1, double imaging will occur in the output picture in areas of motion.
In order to simulate the drop field conversion process on set or on location, it might be considered appropriate to display the video on a 2:1 interlace monitor or camera viewfinder having a 48 Hz field rate, dropping fields FD3 and FD8 in each sequence of ten fields. This is illustrated in Figure 2. Input fields IFD1, IFD2 and IFD10 can be simply used to produce output fields OFD1, OFD2, OFD7 and OFD8, respectively because the polarities match. However, for polarity reasons the order of viewing input fields IFD4 and IFD5 must be reversed, as too must that of input fields IFD6 and IFD7. Thus, output fields OFD3 to OFD6 are produced from input fields IFD5, IFD4, IFD7 and YID6, respectively.Motion portrayal in the displayed output video will be extremely bizarre due to the reversal of the order in which input fields IFD4 and IFD5 are displayed and that in which input fields IFD6 and IFD7 are displayed, and more particularly because input field IFD7 is displayed immediately after input field IFD4. Thus, the output picture will look dreadful if there is any motion in the picture and will not in any way be representative of the motion in the film.
In order to deal with this problem, it might be considered appropriate to perform a polarity reversal process on input fields IFD4 to IFD7, as shown in Figure 3, or possibly to alter the raster scanning system of the display monitor (although this may not be feasible). If this were done, then the input fields IFD1, IFD2, IFD4 to IFD7, IFD9 and IFD10 are used in the proper sequence to produce the output fields OFD1 to OFD8. Nevertheless, the output fields are 2:1 interlaced with temporal offsets between successive fields, whereas when a film is viewed with a standard double-shutter projector, the same image is shown twice for each frame, with no temporal offset between the two showings of each frame.Accordingly, the scheme shown in Figure 3 is still not representative of and capable of simulating the motion artifacts which will be produced in the actual drop field video to film conversion process described above with reference to Figure 1.
Figure 4 illustrates a first example of the invention, in this case for simulating on a video display the 60 field/s 2:1 interlaced video to 24 frame/s film drop field conversion process. Firstly, eight out of ten input fields IFD1 to IFD10 are used to produce respective progressive scan format frames PFM1 to PFM8. In the particular example shown input fields IFD1, IFD2, IFD4 to IFD7, IFD9 and IFD10 are used, and input fields IFD3 and IFD8 are dropped. The 2:1 interlace to progressive scan format conversion is performed by intra-field interpolation. Secondly, from pairs of the progressive frames which are temporally adjacent, i.e.PFM1 and PFM2; PFM3 and PFM4; PFM5 and PFM6; and PFM7 and PFM8; four progressive format frames LIFM1 to LIFM4 are produced by linear interpolation, or averaging, such that a pixel at a location (x,y) in, say, interpolated frame LIFM2 has a value which is the average of the values of the pixels at locations (x,y) in the progressive frames PFM3 and PFM4. Lastly, eight 2:1 interlaced fields OFD1 to OFD8 at 48 field/s are displayed on a monitor M from the four interpolated frames, with pairs of the output fields being taken from respective interpolated frames.
An important point about the scheme of Figure 4 is that there is no temporal offset between pairs of output fields OFD1 and OFD2; OFD3 and-OFD4; OFD5 and OFD6; and OFD7 and OFD8 due to the formation of the interpolated frames by temporal interpolation between pairs of the progressive scan converted frames.
In a modification to the Figure 4 arrangement, instead of carrying out the progressive scan conversion and linear interpolation as separate steps, the frame, for example, LIFM1 may be produced directly from the input fields IFD1, IFD2 using a two-dimensional (vertical and temporal) filter as shown by the dotted lines 2DF in Figure 4.
Figure 5 illustrates a scheme known from GB 2231228A (Figures 1 to 48), for converting 60 field/s 2:1 interlaced video to 24 frame/s film using motion compensated temporal interpolation. From a sequence of ten input fields IFD1 to IFD1O, six progressive scan format frames PFM1 to PFM6 are produced. From one example, the progressive format frames PEM1 to PFM6 are derived from input fields TFD1, IFD2, IFD4, IFD6, IFD7 and IFD9 by intra-field interpolation. Alternatively or additionally, each of the progressive scan format frames may be derived from the previously mentioned ihput field and the preceding and succeeding fields using inter-field interpolation.Motion vectors are developed representative of motion of objects in the picture, and a first output frame OFM1 is produced using motion compensated temporal interpolation from the first and second progressive scan format frames PFM1, PFM2 by interpolation half-way along the motion vectors between the two progressive scan format frames. A third output frame OFM3 is similarly produced from the fourth and fifth progressive scan format frames PFM4, PFM5. The second and fourth output frames OFM2 and OFM4 are merely the same as the third and sixth progressive scan format frames PFM3 and PFM6. The output video frames are then recorded on film F. This method reduces the double imaging and 12 Hz judder which occurs in the drop field method described above with reference to Figure 1.
In order to simulate, on set or on location, title motion compensated temporal interpolation conversion process described above, a second example of the invention as will now be described with reference to Figure 6 may be employed. In a sequence of ten input video fields IFD1 to IFD1O, six of the fields IFD2, IFD3, IFD5, IFD7, IFD8 and IFD10 are dropped. Each of the other input fields is progressive scan converted using intra-field interpolation to form a respective progressive scan format frame PFM1 to PFM4. Alternatively, as shown in Figure 6 by dotted lines, each of the progressive scan format frames PFM1 to PFM4 may be produced by inter-field interpolation from the above-mentioned input field and the immediately preceding and succeeding input fields.As a further alternative a motion adaptive combination of inter-field and intra-field interpolation may be employed as described in detail in GB 2231228A. Then, eight 2:1 interlaced fields OFD1 to OFD8 are displayed on the monitor M at 48 field/s from the four progressive scan format frames, with each pair of the output fields being taken from a respective one of the progressive scan format frames. The resulting displayed image will partially imitate the motion compensated temporal interpolation video to film conversion process, because it removes the double imaging effect.
However, there will still be a 12 Hz judder, or if the progressive scan format frame PFM3 is derived from the seventh input field IFD7, rather than the sixth input field IFD6, a 6 Hz temporal judder component will also arise. Again, an important point about the scheme of Figure 6 is that there is no temporal offset between the fields of each pair of output fields.
A modification to the example of Figure 6, which overcomes the temporal judder problem, will now be described with reference to Figure 7. Six progressive scan format frames PFM1a, PFM1b, PFM2, PFM3a, PFM3b and PFM4 are formed by intra-field interpolation of the first, second, fourth, sixth and seventh and ninth input fields IFD1, IFD2, IFD4, IFD6, IFD7 and IFD9, respectively, or additionally by inter-field interpolation between these input fields and the temporally adjacent fields (as shown by dotted lines in Figure 7) in an adaptive manner as described in GB 2231Z28A. Two further progressive scan format frames PFM1 and PFM3 are also produced by inter-frame linear interpolation halfway between the progressive scan format frames PFM1a, PFM1b, and the progressive scan format frames PFM3a, PFM3b.The output fields OFD1 to OFD8 are produced from the progressive scan format frames PFM1 to PFM4 in a similar manner to that described above with reference to Figure 6. It will be appreciated that this scheme removes the temporal judder. However, the second and fourth progressive scan format frames PFM2 and PFM4 and their corresponding output fields suffer from loss of vertical resolution except in static areas in the case where frames are produced by inter-field interpolation. Also the first and third progressive scan format frames are blurred in areas of motion. This switching between the two methods of producing the progressive scan format frames at 12 Hz may be noticeable in some material.
It is not necessary to produce, for example, the progressive scan format frames PFM1a, PFM1b before producing the frame PFM1.
Alternatively, the frame PFM1 may be produced directly from the input field IFD1, IFD2 using a two-dimensional (vertical and temporal) filter as shown by the dotted lines 2DF in Figure 7. In its simplest form, the filter would produce as the value of a pixel at a location (x,y) in the output frame, the sum of: half of the value of the pixel at location (x,y) in the input field which contained a pixel at location (x,y); and one-quarter of the value of the pixel at location (x,y-1) in the other input field; and one-quarter of the value of the pixel at location (x,y+1) in that other input field.
A modification to the arrangement of Figure 7 which smooths out the 12 Hz switching effect will now be described with reference to Figure 8. Eight progressive scan format frames PFMla, PFM1b, PFM2a, PEM2b, PFM3a, PFM3b, PFM4a and PFM4b are produced from the input fields IFD1, IFD2, IFD4, IFD5, IFD6, IFD7, IFD9 and IFD10, respectively, by intra-field (vertical) interpolation, or adaptively by such intra-field interpolation and inter-field between the temporally adjacent fields.
Also, four progressive frames PFM1 to PFM4 are produced by inter-frame (temporal) linear interpolation: three-quarters of the way between the frames PFM1a, PFM1; one-quarter of the way between the frames PFM2a, PFM2b; three-quarters of the way between the frames PFM3a, PFM3b; and one-quarter of the way between the frames PFM4a, PFM41?, respectively.
The eight output fields OFD1 to OFD8 are produced in a similar fashion to that described above with reference to Figures 6 and 7. This arrangement removes the 12 Hz switching effect arising in the Figure 7 arrangement, but with slight loss of dynamic resolution compared with the Figure 7 arrangement, and there is a 12 Hz judder component.
Similarly to as described with reference to Figure 7, the progressive scan format frames PFM1 to PFM4 may be formed directly from the input fields using a two dimensional (vertical and temporal) filter as shown by the dotted lines 2DF in Figure 8.
Referring to Figure 9, in a known conversion from 60 field/s 2:1 interlace video to 30 frame/s film by the repeat field process, pairs of input fields, for example IFD1, IFD2 are composited to produce output frames, for example OFM1, and the output frames are recorded on film material F. Because of the temporal offset between the two input fields making up a single output frame, double imaging will occur in the output picture in areas of motion.
In order to simulate the field combination process on set or on location a third example of the invention, as shown in Figure 10, may be employed. For each input field IFD1 to IFD4, a respective progressive scan format frame PSFM1 to PSFM4 is produced by intra-field interpolation. Then, for each pair of progressive scan format frames, for example PSFM1, PSFM2, a respective progressive scan format frame, for example LIFM1, is produced by linear interpolation half way between the progressive scan format frames PSFM1, PSFM2. Then, two 2:1 interlaced fields, for example OFD1, OFD2 at 60 fields per second are displayed from each linearly interpolated frame.
An important point about the scheme of Figure 10 is that there is no temporal offset between pairs of the output fields, for example OFD1, OFD2, due to the formation of the interpolated frames, for example LIFM1, by temporal interpolation between pairs of the progressive scan converted frames.
Similarly to as described with reference to Figures 7 and 8, the progressive scan format frames LIFM1, LIFM2 may be produced directly from the input fields using a two-dimensional (vertical and temporal) filter as shown by the dotted lines 2dF in Figure 10.
Figure 11 illustrates a scheme, previously proposed in GB 9024836.6 (Figures 57 to 60), for converting 60 field/s 2:1 interlace video to 30 frame/s film using motion compensated temporal interpolation. For each input field (for example IFD2) a respective progressive scan format frame (for example PSFM2) is produced by intrafield interpolation of the field IFD2 and/or by inter-field interpolation of that field IFD2 and the temporally adjacent fields IFD1, IFD3. Motion vectors are developed representative of motion of objects in the picture, and an output frame (OFM1) is produced using motion compensated temporal interpolation from a respective pair of the progressive scan format frames (PSFM1, PSFM2) by interpolation half-way along the motion vectors between the two progressive scan format frames. The output frames are then recorded on film F. Unlike the field combination process described above with reference to Figure 9, the film transfer process using motion compensated temporal interpolation does not suffer from double imaging.
In order to simulate, on set or on location, the motion compensated temporal interpolation conversion process described above, an fourth example of the invention as will now be described with reference to Figure 12 may be employed. For each alternate input field 1FD1, IFD3, etc., a respective progressive scan format frame PSFM1, PSFM2, etc., is produced using intra-field interpolation, optionally and adaptively with some degree of inter-field interpolation between that field and the temporally adjacent fields. 2:1 interlaced output fields OFD1, OFD2, etc., are then displayed at 60 field/s per second on the monitor M, with each pair of output fields being taken from a respective one of the progressive scan format frames.It will be appreciated that this simulation method does not create any temporal judder, and there will be no double imaging. However, the vertical resolution of the output frames will be lower in areas of motion, and also in static areas unless adaptive inter-field interpolation is used.
Figure 13 illustrates an embodiment of an apparatus according to the invention for performing the various methods described above. The apparatus comprises a video camera V which provides a video signal either directly to a converter C, or- indirectly via a digital video tape recorder R. The converter C provides an output video signal to a monitor M, which either operate on 48 field/s 2:1 interlace format in the case of the examples described with reference to Figures 4, 6, 7 and 8, or on 60 field/s 2:1 interlace format in the case of the examples described above with reference to Figures 10 and 12. The converter C comprises a plurality of frame stores S and a processor P which directs the video signals between the camera V (or the recorder R) and the frame stores S, and between the frame stores S and the monitor M, and which also performs the progressive scan conversion operations and the linear interpolation operations mentioned above.

Claims (24)

1. A method of displaying an input interlaced format video signal on an interlaced display, comprising the steps of: forming from at least some of the fields of the input video signal a series of progressive scan format frames; and displaying sequentially interlaced fields of the progressive scan format frames.
2. A method as claimed in claim 1, which is performed at real-time rate.
3. A method as claimed in claim 1 or 2, wherein the frame rates of the progressive scan format frames and the displayed fields are equal.
4. A method as claimed in any preceding claim, wherein each progressive scan format frame is produced by vertical interpolation of and temporal interpolation between a respective pair of the input fields.
5. A method as claimed in claim 4, wherein such vertical and temporal interpolation is performed by a two-dimensional filter.
6. A method as claimed in claim 4, wherein such vertical and temporal interpolation is performed by: forming a preliminary series of progressive scan format frames at twice the frame rate of the first-mentioned series of progressive scan format frames, each of the frames in the preliminary series being produced by intra-field interpolation of a respective one of the input fields; and forming each of the frames in the first-mentioned series by inter-frame interpolation between a respective pair of frames of the preliminary series.
7. A method as claimed in any of claims 4 to 6, wherein: the input signal is characterised by 60 field/s and 2:1 interlace; the display is characterised by 48 fields and 2:1 interlace; and two out of every ten fields of the input signal are dropped.
8. A method as claimed in any of claims 4 to 6, wherein: the input signal and the display are each characterised by 60 field/s and 2:1 interlace.
9. A method as claimed in any of claims 1 to 3, wherein each of the progressive scan format frames is produced by intra-field interpolation of a respective one of the input fields and/or by inter-field interpolation between the fields temporally adjacent that fields.
10. A method as claimed in claim 9, wherein: the input signal is characterised by 60 field/s and 2:1 interlace; the display is characterised by 48 fields and 2:1 interlace; and or out of every ten fields of the input signal provide said one fields.
11. A method as claimed in claim 9, wherein: the input signal and the display are each characterised by 60 field/s and 2:1 interlace; and alternate input fields provide said one fields.
12. A method as claimed in any of claims 1 to 3, wherein: some of the frames of said series of progressive scan format frames are each produced by vertical interpolation of and temporal interpolation between a respective pair of the input fields; and others of the frames of the said series are each produced by intra-field interpolation of a respective one of the input fields and/or by inter-field interpolation between the fields temporally adjacent that input field.
13. A method as claimed in claim 12, wherein such vertical and temporal interpolation is performed by a two-dimensional filter.
14. A method as claimed in claim 12, wherein such vertical and temporal interpolation is performed by producing a respective preliminary progressive scan format frame from each field of said pairs of fields, and by forming said some frames by inter-frame interpolation between the frames of the pairs of preliminary frames.
15. A method as claimed in any of claims 12 to 14, wherein said some frames are alternative frames of the series.
16. A method as claimed in any of claims 12 to 15, wherein said some frames temporally interpolated half-way between the respective input fields.
17. A method as claimed in any of claims 12 to 16, wherein: the input signal is characterised by 60 field/s and 2:1 interlace; the display is characterised by 48 field/s and 2:1 interlace; first and third of four of the progressive scan format frames ar formed by vertical interpolation of and temporal interpolation between first and second, and sixth and seventh, respectively of ten of the input fields; the second of the four frames is formed by intra-field interpolation of the fourth of the ten fields and/or inter-field interpolation between the third to fifth of the ten fields; and the fourth of the four frames is formed by intra-field interpolation of the ninth of the ten fields and/or inter-field interpolation between the eighth to tenth of the ten fields.
18. A method as claimed in any of claims 1 to 3, wherein the frames of the ser-ies are each produced by temporal interpolation between a respective pair of temporally adjacent fields of the input signal.
19. A method as claimed in claim 18, wherein alternate frames of the series are produced with one temporal interpolation ratio and the other frames of the series are produced with another interpolation ratio.
20. A method as claimed in claim 19, wherein said one interpolation ratio is 1/4 : 3/4 and said other interpolation ratio is 3/4 : 1/4.
21. A method as claimed in any of claims 18 to 20, wherein: the input signal is characterised by 60 field/s and 2:1 interlace; the display is characterised by 48 field/s and 2:1 interlace; and four frames of the series of progressive scan format frames are temporally interpolated between four pairs of a series of ten input fields.
22. A method substantially as described with reference to Figure 4, Figure 6, Figure 7, Figure 8, Figure 10 or Figure 12.
23. An apparatus comprising a video source for providing an input video signal to a converter or performing the method of any preceding claim, and providing a video output signal, and a video monitor for displaying a picture represented by the video output signal.
24. An apparatus substantially as described with reference to Figure 13 for performing a method as claimed in any of claims 1 to 22.
GB9125732A 1991-07-24 1991-12-03 Video to film conversion Expired - Fee Related GB2262198B (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
GB9125732A GB2262198B (en) 1991-12-03 1991-12-03 Video to film conversion
US07/964,091 US5430489A (en) 1991-07-24 1992-10-21 Video to film conversion
JP4324338A JPH0622210A (en) 1991-12-03 1992-12-03 Method and apparatus for simulation of video film conversion

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GB9125732A GB2262198B (en) 1991-12-03 1991-12-03 Video to film conversion

Publications (3)

Publication Number Publication Date
GB9125732D0 GB9125732D0 (en) 1992-01-29
GB2262198A true GB2262198A (en) 1993-06-09
GB2262198B GB2262198B (en) 1995-05-03

Family

ID=10705648

Family Applications (1)

Application Number Title Priority Date Filing Date
GB9125732A Expired - Fee Related GB2262198B (en) 1991-07-24 1991-12-03 Video to film conversion

Country Status (2)

Country Link
JP (1) JPH0622210A (en)
GB (1) GB2262198B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2280080A (en) * 1993-06-09 1995-01-18 Sony Uk Ltd Video frame rate conversion from higher to lower frame rates
GB2262853B (en) * 1991-12-20 1995-07-19 Sony Broadcast & Communication Digital video signal processing
GB2271239B (en) * 1992-09-29 1996-06-19 Sony Broadcast & Communication Video to film conversion
WO2001078388A1 (en) * 2000-04-07 2001-10-18 Snell & Wilcox Limited Method of conversion from an interlaced format to a progressive format having a lower frame rate

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100662616B1 (en) * 2006-01-17 2007-01-02 삼성전자주식회사 Method for providing film image and the film image providing image display apparatus thereof
US8891011B2 (en) 2007-08-23 2014-11-18 Qualcomm Incorporated Systems and methods for combining deinterlacing and frame rate decimation for video format conversion

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2262853B (en) * 1991-12-20 1995-07-19 Sony Broadcast & Communication Digital video signal processing
GB2271239B (en) * 1992-09-29 1996-06-19 Sony Broadcast & Communication Video to film conversion
GB2280080A (en) * 1993-06-09 1995-01-18 Sony Uk Ltd Video frame rate conversion from higher to lower frame rates
GB2280080B (en) * 1993-06-09 1998-01-14 Sony Uk Ltd Video frame rate conversion
WO2001078388A1 (en) * 2000-04-07 2001-10-18 Snell & Wilcox Limited Method of conversion from an interlaced format to a progressive format having a lower frame rate

Also Published As

Publication number Publication date
JPH0622210A (en) 1994-01-28
GB9125732D0 (en) 1992-01-29
GB2262198B (en) 1995-05-03

Similar Documents

Publication Publication Date Title
US6118488A (en) Method and apparatus for adaptive edge-based scan line interpolation using 1-D pixel array motion detection
US5642170A (en) Method and apparatus for motion compensated interpolation of intermediate fields or frames
JPS58117788A (en) Color television signal processing circuit
US6208382B1 (en) Color video processing system and method
US5313281A (en) Video to film conversion
KR19990067399A (en) Adaptive picture delay
US5430489A (en) Video to film conversion
EP0475499B1 (en) Motion compensated frame rate conversion
JP3332093B2 (en) Television signal processor
JPH043151B2 (en)
GB2262198A (en) Video to film conversion
US5784116A (en) Method of generating high-resolution video
JPH05219482A (en) Compatibility improving device
US5717466A (en) Circuit for interpolating scan lines of a video signal and method of using same
JPS59138167A (en) Television signal processor
JPH077660A (en) Method for conversion of video signal system
EP0648046B1 (en) Method and apparatus for motion compensated interpolation of intermediate fields or frames
GB2264416A (en) Motion compensated video signal processing
JP2003032636A (en) Main scanning conversion equipment using movement compensation and main scanning conversion method
KR100518159B1 (en) Method and circuit configuration for producing a series of progressive pictures
JPS6314587A (en) Television transmission system
KR100222971B1 (en) Apparatus for high definition image scanner using 3 sensor
JP3603393B2 (en) Television circuit
KR20040105966A (en) Method and apparatus for image transformation
JPH03179890A (en) Television receiver

Legal Events

Date Code Title Description
732E Amendments to the register in respect of changes of name or changes affecting rights (sect. 32/1977)
PCNP Patent ceased through non-payment of renewal fee

Effective date: 20101203