US8255802B2 - Method for enabling efficient navigation of video - Google Patents
Method for enabling efficient navigation of video Download PDFInfo
- Publication number
- US8255802B2 US8255802B2 US11/578,946 US57894605A US8255802B2 US 8255802 B2 US8255802 B2 US 8255802B2 US 57894605 A US57894605 A US 57894605A US 8255802 B2 US8255802 B2 US 8255802B2
- Authority
- US
- United States
- Prior art keywords
- token
- images
- squashed
- band
- token images
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
- 238000000034 method Methods 0.000 title claims abstract description 30
- 238000012935 Averaging Methods 0.000 claims description 4
- 230000001131 transforming effect Effects 0.000 claims 11
- 239000011159 matrix material Substances 0.000 claims 6
- 230000009467 reduction Effects 0.000 description 4
- 230000008602 contraction Effects 0.000 description 1
- 238000005549 size reduction Methods 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
- G11B27/34—Indicating arrangements
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
- G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
Definitions
- Visual recordings of moving things are generally made up of sequences of successive of images. Each such image represents a scene at a different time or range of times.
- This invention relates to recordings consisting of sequences of images such as are found, for example, in video, film and animation.
- the common video standard PAL used in Europe comprises 25 frames per second. This means that an hour of video will consist of nearly 100,000 frames.
- Other video formats such as the NTSC standard used in the USA and Japan, have similar number of frames per hour as PAL.
- a requirement for a human operator to locate accurately and to access reliably a particular frame from within many can arise.
- One application where this requirement arises is video editing.
- the need may not just be for accurate access on the scale of individual frames, but also easy access to different scenes many frames apart.
- the invention described herein is a method for enabling efficient access to video content over a range of temporal scales.
- FIG. 1 is a computer display to which the invention may apply;
- FIG. 2 is a sequence of source image frames to which the invention may apply.
- FIG. 3 is an example of additional horizontal reductions.
- Images in the source are digitised and labelled with frame numbers where later times correspond to bigger frame numbers and consecutive frames have consecutive frame numbers.
- Each image is given an associated token image, which may be a copy of the source image.
- these source images may be too big to fit many on a display device such as a computer screen at the same time.
- the token image will be a reduced size version of the original image.
- the token images are small enough that a number of token images can be displayed on the display device at the same time.
- this size reduction is achieved by averaging a number of pixels in the source image to give each corresponding pixel in the smaller token images.
- the token images have the same aspect ratio as the original images.
- the token images are then combined consecutively with no gaps between them in a continuous band ( 6 ) which is preferably horizontal.
- This band is then displayed on the computer screen, although if the source is more than a few images in length, the band will be wider than the available display area, and only a subset of it will be visible at any one time.
- the video is navigated to frame accuracy by using a pointing device, such as a mouse, which is pointed at a particular token within the horizontal band. This causes the original image corresponding to this token to be selected. Any appropriate action can then be carried out on the selected frame. For example, the selected frame can then be displayed. In another example, the time code of the selected frame can be passed on for further processing. In a further example, the image pixels of the selected frame can be passed on for further processing.
- the band automatically and smoothly scrolls so that the token originally being pointed to moves towards the centre of the displayed range. This allows access beyond the original displayed area of the horizontal band.
- Each token is reduced in size, but this time only horizontally. This reduction leaves each new token ( 12 ) at least one pixel wide. Where the reduction in size is by a factor of x, the resulting token is called an x-token within this document. So, for example, 2-tokens are half the width of tokens, but the same height. The x-tokens are then displayed adjacent to each other in the same order as the original image frames to create a horizontal band as with the tokens, but with the difference that more of these x-tokens fit in the same space than the corresponding tokens, by a factor of x.
- the space ( 14 ) allocated to the horizontal band for tokens and x-tokens is 320 pixels.
- the tokens ( 4 ) are 32 ⁇ 24 pixels, and the x-tokens ( 12 ) are created in a variety of sizes down to 1 ⁇ 24 pixels.
- the horizontal band corresponds to 320 frames of video, compared with ten frames for the token image. This range of 320 frames can be navigated successfully with the pointer.
- the corresponding band may contain one token in every x.
- every pixel in every image contributes some information to each horizontal band. Even with x-tokens only one pixel wide, the position of any cut ( 16 ) on the source is visible to frame accuracy, as are sudden changes in the video content.
- the x-tokens are fine for navigating short clips, but to navigate longer sources, further horizontal reductions are required, see FIG. 3 .
- the horizontal band made of 1 pixel wide x-tokens is squashed horizontally by a factor of y. If y is an integer, this is achieved by combining y adjacent non-intersecting sets of 1 pixel wide x-tokens (by for example averaging) to make a y-token one pixel wide and the same height as the tokens.
- values of x and y used are powers of two, and the resulting horizontal display bands represent all scales from 10 frames to 5120 frames. Larger values of y will be appropriate for longer videos.
- the values of x and y need not be integers, although appropriate weightings between vertical lines within image frames and between image to frames will then be needed if image artefacts are to be avoided.
- the tokens, x-tokens and y-tokens are created in advance of their use for editing in order to facilitate rapid access to the horizontal bands.
- the x-tokens and y-tokens are created at multiple resolutions. Switching between horizontal bands representing different scales is facilitated by zoom in and zoom out buttons ( 22 , 24 ) which move through the range of horizontal contractions available.
Abstract
Description
Claims (18)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
GB0408677A GB2413450A (en) | 2004-04-19 | 2004-04-19 | Video navigation using image tokens displayed within a continuous band of tokens |
GB0408677.3 | 2004-04-19 | ||
PCT/GB2005/001444 WO2005101408A1 (en) | 2004-04-19 | 2005-04-14 | A method for enabling efficient navigation of video |
Publications (2)
Publication Number | Publication Date |
---|---|
US20080126997A1 US20080126997A1 (en) | 2008-05-29 |
US8255802B2 true US8255802B2 (en) | 2012-08-28 |
Family
ID=32321068
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/578,946 Active 2026-04-26 US8255802B2 (en) | 2004-04-19 | 2005-04-14 | Method for enabling efficient navigation of video |
Country Status (8)
Country | Link |
---|---|
US (1) | US8255802B2 (en) |
EP (1) | EP1738365B1 (en) |
AT (1) | ATE447758T1 (en) |
DE (1) | DE602005017482D1 (en) |
ES (1) | ES2337593T3 (en) |
GB (1) | GB2413450A (en) |
PL (1) | PL1738365T3 (en) |
WO (1) | WO2005101408A1 (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018197911A1 (en) | 2017-04-28 | 2018-11-01 | Forbidden Technologies Plc | Methods, systems, processors and computer code for providing video clips |
WO2022162400A1 (en) | 2021-01-29 | 2022-08-04 | Blackbird Plc | Methods for generating videos, and related systems and servers |
WO2023026064A1 (en) | 2021-08-27 | 2023-03-02 | Blackbird Plc | Method of editing a video file |
WO2024018166A1 (en) | 2022-07-22 | 2024-01-25 | Blackbird Plc | Computer-implemented methods of blurring a digital image; computer terminals and computer program products |
WO2024018239A1 (en) | 2022-07-22 | 2024-01-25 | Blackbird Plc | Video encoding and decoding |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8850318B2 (en) * | 2007-04-23 | 2014-09-30 | Digital Fountain, Inc. | Apparatus and method for low bandwidth play position previewing of video content |
GB201700086D0 (en) | 2017-01-04 | 2017-02-15 | Forbidden Tech Plc | Codec |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5495566A (en) * | 1994-11-22 | 1996-02-27 | Microsoft Corporation | Scrolling contents of a window |
WO1997027704A1 (en) | 1993-04-21 | 1997-07-31 | Kinya Washino | Multi-format audio/video production system with frame-rate conversion |
DE19944746A1 (en) | 1998-09-17 | 2000-03-23 | Sony Corp | Multi-layer editing system for performing fast composition, special effects and editing processes for video data, involves using a graphical user interface (GUI) with icons for various processes |
EP1164791A1 (en) | 1999-02-24 | 2001-12-19 | Sony Corporation | Screen control method |
US6342902B1 (en) * | 1996-04-12 | 2002-01-29 | Sony Corporation | Controlling audio and/or video replay |
US6377713B1 (en) * | 1999-01-27 | 2002-04-23 | General Instrument Corporation | Synchronous DRAM bandwidth optimization for display downsizing of an MPEG-2 image |
US6400378B1 (en) | 1997-09-26 | 2002-06-04 | Sony Corporation | Home movie maker |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH11136621A (en) * | 1997-10-29 | 1999-05-21 | Sony Corp | Image display method and edit device using the same |
-
2004
- 2004-04-19 GB GB0408677A patent/GB2413450A/en not_active Withdrawn
-
2005
- 2005-04-14 EP EP05734093A patent/EP1738365B1/en active Active
- 2005-04-14 PL PL05734093T patent/PL1738365T3/en unknown
- 2005-04-14 DE DE602005017482T patent/DE602005017482D1/en active Active
- 2005-04-14 US US11/578,946 patent/US8255802B2/en active Active
- 2005-04-14 ES ES05734093T patent/ES2337593T3/en active Active
- 2005-04-14 WO PCT/GB2005/001444 patent/WO2005101408A1/en active Application Filing
- 2005-04-14 AT AT05734093T patent/ATE447758T1/en not_active IP Right Cessation
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1997027704A1 (en) | 1993-04-21 | 1997-07-31 | Kinya Washino | Multi-format audio/video production system with frame-rate conversion |
US5495566A (en) * | 1994-11-22 | 1996-02-27 | Microsoft Corporation | Scrolling contents of a window |
US6342902B1 (en) * | 1996-04-12 | 2002-01-29 | Sony Corporation | Controlling audio and/or video replay |
US6400378B1 (en) | 1997-09-26 | 2002-06-04 | Sony Corporation | Home movie maker |
DE19944746A1 (en) | 1998-09-17 | 2000-03-23 | Sony Corp | Multi-layer editing system for performing fast composition, special effects and editing processes for video data, involves using a graphical user interface (GUI) with icons for various processes |
US6377713B1 (en) * | 1999-01-27 | 2002-04-23 | General Instrument Corporation | Synchronous DRAM bandwidth optimization for display downsizing of an MPEG-2 image |
EP1164791A1 (en) | 1999-02-24 | 2001-12-19 | Sony Corporation | Screen control method |
Non-Patent Citations (2)
Title |
---|
Card et al., "Information Visualization Using Vision to Think", 1999, pp. 570-575. * |
Super Stock, Rolodex 1566-02602 & 831-205, www.superstock.com. * |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018197911A1 (en) | 2017-04-28 | 2018-11-01 | Forbidden Technologies Plc | Methods, systems, processors and computer code for providing video clips |
WO2022162400A1 (en) | 2021-01-29 | 2022-08-04 | Blackbird Plc | Methods for generating videos, and related systems and servers |
WO2023026064A1 (en) | 2021-08-27 | 2023-03-02 | Blackbird Plc | Method of editing a video file |
WO2024018166A1 (en) | 2022-07-22 | 2024-01-25 | Blackbird Plc | Computer-implemented methods of blurring a digital image; computer terminals and computer program products |
WO2024018239A1 (en) | 2022-07-22 | 2024-01-25 | Blackbird Plc | Video encoding and decoding |
Also Published As
Publication number | Publication date |
---|---|
ES2337593T3 (en) | 2010-04-27 |
PL1738365T3 (en) | 2010-06-30 |
EP1738365B1 (en) | 2009-11-04 |
US20080126997A1 (en) | 2008-05-29 |
GB0408677D0 (en) | 2004-05-19 |
EP1738365A1 (en) | 2007-01-03 |
WO2005101408A1 (en) | 2005-10-27 |
DE602005017482D1 (en) | 2009-12-17 |
GB2413450A (en) | 2005-10-26 |
ATE447758T1 (en) | 2009-11-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8255802B2 (en) | Method for enabling efficient navigation of video | |
US5543842A (en) | Apparatus and method for providing multiple video data streams from a single source | |
US9959903B2 (en) | Video playback method | |
US6504552B2 (en) | Storing effects descriptions from a nonlinear editor using a field chart and/or pixel coordinate data for use by a compositor | |
US6396473B1 (en) | Overlay graphics memory management method and apparatus | |
EP0746840B1 (en) | Single frame buffer image processing system | |
US8004542B2 (en) | Video composition apparatus, video composition method and video composition program | |
CN105205354B (en) | Data generating device and data creation method | |
EP1170942A1 (en) | Image synthesizing device, recorded medium, and program | |
US20090122081A1 (en) | Image compositing apparatus and image compositing method | |
US8228414B2 (en) | Real-size preview system in terminal having digital camera function and control method thereof | |
JPS62242281A (en) | Digital video generator | |
CN103761315A (en) | Method and system for displaying webpage content | |
US6400832B1 (en) | Processing image data | |
JP2005354333A (en) | Image reproducer and program | |
US20230017751A1 (en) | Information processing device, display system, display control method | |
EP1528528A2 (en) | Image display system and method | |
JP5645448B2 (en) | Image processing apparatus, image processing method, and program | |
EP3951767A1 (en) | Image processing device, image processing method, and display device | |
US8264601B2 (en) | Video picture format conversion method and corresponding device | |
JP2002543458A (en) | How to display data on lower resolution displays | |
CN110519530A (en) | Hardware based picture-in-picture display methods and device | |
JPH04188369A (en) | Picture display device | |
JP2005115011A (en) | Image display apparatus, image display method, image display program and recording medium recording the program | |
JPH07134769A (en) | Anti-aliasing processing method for image synthesis |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: FORBIDDEN, TECHNOLOGIES PLC, UNITED KINGDOM Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:STREATER, STEPHEN BERNARD;REEL/FRAME:018708/0376 Effective date: 20061129 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
AS | Assignment |
Owner name: BLACKBIRD PLC, UNITED KINGDOM Free format text: CHANGE OF NAME;ASSIGNOR:FORBIDDEN TECHNOLOGIES PLC;REEL/FRAME:050582/0713 Effective date: 20190514 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 8 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 12 |