WO2001011866A2 - Method and apparatus for performing an automated inverse telecine process - Google Patents
Method and apparatus for performing an automated inverse telecine process Download PDFInfo
- Publication number
- WO2001011866A2 WO2001011866A2 PCT/US1999/018295 US9918295W WO0111866A2 WO 2001011866 A2 WO2001011866 A2 WO 2001011866A2 US 9918295 W US9918295 W US 9918295W WO 0111866 A2 WO0111866 A2 WO 0111866A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- frame
- group
- pixels
- computer system
- selected pixel
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/004—Diagnosis, testing or measuring for television systems or their details for digital television systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0112—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level one of the standards corresponding to a cinematograph film standard
Definitions
- the present invention relates generally to video processing systems. More
- the present invention includes a method and apparatus for processing a
- Video tape is encoded using a similar
- video tape would be a simple process of transferring frames from the source media
- the rate is typically twenty-four
- Video tape encoded using the NTSC standard uses a rate
- each second of film must be expanded from twenty-four to thirty frames.
- each second of video tape must be reduced from thirty to twenty-four frames. This means that one
- the even field includes all of the even lines within the
- the odd field includes all of the odd lines within the frame.
- the composite frame is intended to
- the frames added by the telecine process make recordings made on film
- Compression increases the capacity of storage devices, such as optical disks.
- Compression also increases the performance of video transmissions, such as
- the output frame rate is higher (resulting in a greater amount of data), and because
- composite frames tend to be different than both their preceding and following
- Video compression methods such as MPEG are most effective when applied to relatively continuous frame sequences. These compression methods
- the first is the requirement that an operator manually
- frames within the video tape may have been removed or added. This means
- composite frames may occur at rather random intervals and not every fifth
- a video tape may have to be repeated. If a video tape includes a large number of edits, the
- the inverse telecine process automatically
- a computer system reads each of the
- the computer system uses the frames to create
- the computer system analyzes the pixels included in
- An original frame includes
- a composite frame is composite.
- a composite frame includes pixels from two distinct images and
- the computer system reconstructs an original frame using the even field of the composite frame and the odd field of the
- the computer system creates interpolated frames for composite frames that
- the computer system creates interpolated frames by
- the method of the present invention performs the inverse telecine process
- the automatic detection of composite frames means that the method is
- FIG. 1 is a block diagram of a host computer system shown as an
- FIG. 2 is a block diagram of an inverse telecine process in accordance with
- Figure 3 is a flow chart showing the steps associated with an inverse telecine
- Figure 4a is a block diagram of a first original video frame as exemplary input
- Figure 4b is a block diagram of a second original video frame as exemplary
- Figure 4c is a block diagram of a composite video frame as exemplary input
- Figure 5 is a flow chart showing the steps associated with a frame selection
- Figure 6 is a detail showing a group of pixels in a video frame.
- FIG. 1 a computer system 100 is shown as a representative environment
- computer system 100 includes a processor, or
- processors 102 and a memory 104.
- An input device 106 and an output device 108 are input devices 106 and an output device 108.
- I/O device 108 represent a wide range of varying I/O devices such as disk drives,
- Each node 102 may be any combination of nodes 102 .
- disk drive 110 also includes a disk drive 110 of any suitable disk drive type (equivalently, disk drive
- Flash memory 110 may be any non-volatile mass storage system such as "flash” memory).
- the inverse telecine process automatically
- sequence 206 are video data encoded as sequences of individual frames.
- source video sequence 206 may be encoded
- source video sequence 206 may be taken from a wide range of different video formats, such as QUICKTIME, AVI, DV or MPEG, or. This means that source video sequence 206 may be taken from a wide range of different video formats, such as QUICKTIME, AVI, DV or MPEG, or. This means that source video sequence 206 may be taken from a wide range of different video formats, such as QUICKTIME, AVI, DV or MPEG, or. This means that source video sequence 206 may be taken from a wide range of different video format, such as QUICKTIME, AVI, DV or MPEG, or. This means that source video sequence 206 may be taken from a wide range of different video format, such as QUICKTIME, AVI, DV or MPEG, or. This means that source video sequence 206 may be taken from a wide range of different video format, such as QUICKTIME, AVI, DV or MPEG, or. This means that source video sequence 206 may be taken from a wide range of
- video sequence 206 may be created using any suitable video format (i.e.,
- Method 300 includes a series of steps performed by
- Method 300 begins with initialization step 302.
- step 302 computer system 100 performs any sub-steps that are required prior to
- Computer system 100 uses the
- source timer to track the number of seconds of source video sequence 204 that
- Computer system 100 uses the destination timer to track the
- step 302 computer system 100 initializes both of these timers to zero.
- step 304 computer system 100 determines if the input of the inverse
- computer system 100 compares the start time of the next frame
- source video sequence 204 i.e., the source timer
- step 304 both of these timers are
- computer system 100 moves to step 306 if the destination
- timer leads the source timer by a frame or more.
- computer system 100 skips over one of the
- step 306 computer system 100 continues execution of
- step 308 computer system 100 determines if there are
- step 312 computer system 100 retrieves a frame from
- the frame retrieved during step 312 is one of two different types: original or composite. Original and composite frames are better
- Frame 400a includes a series of 486
- Each line has 420 pixels.
- the lines within each frame are divided into an even
- the even frame includes each even numbered line (i.e.,
- the odd frame includes each odd numbered line (i.e., lines 1 , 3, 5,
- frame 400b is the only image included in frame 400b. For this reason, frame 400b is the
- frame 400c contains the same pixel data as the odd field of 400b. For this reason, frame 400c
- Frame 400c is an intermediate
- sequence 204 from a format having fewer frames per second (such as film) to a
- the telecine process creates frame 400c using the even field of frame 400a and the odd field of frame
- frame 400c contains
- computer system 100 retrieves an original or a composite
- retrieved in step 312 is original. In all other cases, the retrieved frame is composite.
- Method 500 may be
- method 500 may be included as
- Method 500 begins, symbolically, with placeholder 502. During each
- computer system 100 reads a new frame from source
- This frame is referred to as the current frame.
- computer system 100 saves the old value (i.e., the frame read in
- the saved frame is referred to as the
- step 506 computer system 100 increments the value of the
- step 508 computer system 100 computes three values based on the pixels
- the first of these values measures the similarity between pixels included in the even field of
- the second value calculated in step 508 measures the similarity between pixels
- To compute AC E Co computer system 100 selects a predetermined
- computer system 100 calculates a value that represents the degree of
- computer system 100 For one embodiment of the present invention, computer system 100
- Computer system 100 compares
- this selected pixel with its two vertically aligned and adjacent neighbors.
- pixels are located at x, y + 1 and x, y - 1. Both of these pixels are included within the
- Computer system 100 also compares the selected pixel with the two pixels
- pixels are located at x, y + 2 and x, y - 2. Both of these pixels are included within the even field of the current frame (since the selected pixel is included within the even
- Computer system 100 compares each selected pixel to the pixels above and
- rgb_diff (a,b) computes the difference between two pixels and b.
- rgb_diff (a,b) computes the difference between
- tyb_diff (a,b) V(ted(a) - red ⁇ b)) 2 + (green(a) - green )) 2 + (blue(a) - blu j) 2
- rgb_diff (a,b) returns small values when pixels a and b are similar and
- ngb_diff ((x,y),(x,y + 2)
- pixels tend to be more similar to pixels within
- first two components of difference (x,y) contribute larger values than the second two
- AC E C 0 is the sum of each computed value of
- Computer system 100 computes values for AC E Po and AC 0 P E using the
- the computer system constructs two frames.
- the first constructed frame includes the
- the second constructed frame includes the odd field
- This frame is
- Computer system 100 repeats the method used to calculate
- step 510 computer system 100 compares A C E C 0 , AC E P 0 and AC 0 P E
- step 512 computer system 100 returns the
- step 514 computer system 100 continues method 500 at step 514.
- step 514 In step 514,
- computer system 100 concludes method 500 at step 516.
- computer system 100 returns the current frame and indicates that the returned frame is an
- step 518 computer system 100 continues method 500 at step 518.
- step 518 computer system 100 continues method 500 at step 518.
- system 100 determines if AC E P 0 is less than A C E C 0 and AC 0 P ⁇ - If so, computer
- system 100 concludes method 500 at step 520.
- step 520 computer system 100
- step 522 Computer system 100 reaches step 522 if AC 0 P E is less than A C E C 0
- step 522 computer system 100 returns the C 0 P E frame and
- method 500 returns an original frame (i.e., steps 516, 520 and
- the returned frame may include one or both fields from the current frame.
- method 500 is configured so that the identity of these fields are tracked.
- Computer system 100 uses this information to avoid constructing
- step 314 computer system 100 checks to see if method
- step 314 continues at step 314 by adding the returned frame to destination video sequence
- Computer system 100 also increments the destination timer by an amount
- Computer system 100 then continues method 300 at step 308 to determine if method 300 should continue to process
- step 318 computer system 100 determines if the input of the
- computer system 100 compares the start time of the
- Computer system 100 To output video sequence 206 (i.e., the destination timer).
- Computer system 100
- step 320 if the source timer leads the destination timer by a frame or more.
- computer system 100 moves to step 312.
- step 320 computer system 100 uses the
- interpolated frame (x, y) 0.25 * subject frame (x, y -l)
- Computer system 100 adds the interpolated frame to destination video sequence
- Computer system 100 increments the destination timer by an amount equal to
- Computer system 100 then continues method 300 at step 308 to determine if method 300 should continue to process remaining
- system 100 continues method 300 at 322. This causes the returned frame to be
- step 322 computer system 100 discards the returned frame.
- step 324 the system 100 then continues execution of method 300 at step 324.
- computer system 100 ends method 300 at step 310.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Studio Devices (AREA)
- Television Systems (AREA)
Abstract
Description
Claims
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU54796/99A AU5479699A (en) | 1999-08-11 | 1999-08-11 | Method and apparatus for performing an automated inverse telecine process |
PCT/US1999/018295 WO2001011866A2 (en) | 1999-08-11 | 1999-08-11 | Method and apparatus for performing an automated inverse telecine process |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/US1999/018295 WO2001011866A2 (en) | 1999-08-11 | 1999-08-11 | Method and apparatus for performing an automated inverse telecine process |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2001011866A2 true WO2001011866A2 (en) | 2001-02-15 |
WO2001011866A3 WO2001011866A3 (en) | 2002-09-19 |
Family
ID=22273370
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US1999/018295 WO2001011866A2 (en) | 1999-08-11 | 1999-08-11 | Method and apparatus for performing an automated inverse telecine process |
Country Status (2)
Country | Link |
---|---|
AU (1) | AU5479699A (en) |
WO (1) | WO2001011866A2 (en) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0612187A2 (en) * | 1993-02-19 | 1994-08-24 | Philips Electronics Uk Limited | Identifying film frames in a video sequence |
WO1995015659A1 (en) * | 1993-12-02 | 1995-06-08 | Compression Labs, Incorporated | An analyzer and methods for detecting and processing video data types in a video data stream |
EP0685968A2 (en) * | 1994-05-31 | 1995-12-06 | Victor Company Of Japan, Limited | Frame-frequency converting apparatus |
EP0730378A2 (en) * | 1995-02-28 | 1996-09-04 | Sony Corporation | Encoding and decoding of picture signals |
-
1999
- 1999-08-11 WO PCT/US1999/018295 patent/WO2001011866A2/en active Application Filing
- 1999-08-11 AU AU54796/99A patent/AU5479699A/en not_active Abandoned
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0612187A2 (en) * | 1993-02-19 | 1994-08-24 | Philips Electronics Uk Limited | Identifying film frames in a video sequence |
WO1995015659A1 (en) * | 1993-12-02 | 1995-06-08 | Compression Labs, Incorporated | An analyzer and methods for detecting and processing video data types in a video data stream |
EP0685968A2 (en) * | 1994-05-31 | 1995-12-06 | Victor Company Of Japan, Limited | Frame-frequency converting apparatus |
EP0730378A2 (en) * | 1995-02-28 | 1996-09-04 | Sony Corporation | Encoding and decoding of picture signals |
Also Published As
Publication number | Publication date |
---|---|
AU5479699A (en) | 2001-03-05 |
WO2001011866A3 (en) | 2002-09-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6538688B1 (en) | Method and apparatus for performing an automated inverse telecine process | |
US6295089B1 (en) | Unsampled hd MPEG video and half-pel motion compensation | |
JP3315766B2 (en) | Image data encoding method, image data encoding device using the method, image data restoring method, image data restoring device using the method, scene change detecting method, scene change detecting device using the method, scene change recording Device and image data scene change recording / reproducing device | |
US5684539A (en) | Method and apparatus for processing encoded video data to reduce the amount of data used to represent a video image | |
US6236806B1 (en) | Field detection apparatus and method, image coding apparatus and method, recording medium, recording method and transmission method | |
US6393054B1 (en) | System and method for automatically detecting shot boundary and key frame from a compressed video data | |
US7248788B2 (en) | Image processing apparatus | |
FI113929B (en) | Field removal device for video compression / decompression system | |
KR100468967B1 (en) | Thumbnail image generating system | |
Liu et al. | Scene decomposition of MPEG-compressed video | |
EP0674448B1 (en) | Video image reproduction with high speed | |
US6525774B1 (en) | Inverse telecine converting device and inverse telecine converting method | |
US5892550A (en) | Television signal conversion system and image encoding and decoding system | |
JPH0793584B2 (en) | Encoder | |
US6259479B1 (en) | Letterbox filter apparatus and method | |
WO2010151785A1 (en) | Time compressing video content | |
US9736490B2 (en) | Apparatus and method of compressing and restoring image using filter information | |
Pei et al. | Novel error concealment method with adaptive prediction to the abrupt and gradual scene changes | |
EP0827347A2 (en) | Recording and reproducing apparatus for digital image information | |
JP4182747B2 (en) | Image processing apparatus, image processing method, image processing program, and recording medium | |
WO2001011866A2 (en) | Method and apparatus for performing an automated inverse telecine process | |
US11323730B2 (en) | Temporally-overlapped video encoding, video decoding and video rendering techniques therefor | |
CN1171017A (en) | Method and apparatus for coding digital video signals | |
Li et al. | Robust panorama from mpeg video | |
JP2000013741A (en) | Video recorder and video reproducing device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A2 Designated state(s): AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG UZ VN YU ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A2 Designated state(s): GH GM KE LS MW SD SL SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
DFPE | Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101) | ||
REG | Reference to national code |
Ref country code: DE Ref legal event code: 8642 |
|
AK | Designated states |
Kind code of ref document: A3 Designated state(s): AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG UZ VN YU ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A3 Designated state(s): GH GM KE LS MW SD SL SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG |
|
122 | Ep: pct application non-entry in european phase |