WO2008088883A1 - Web-based video browsing - Google Patents
Web-based video browsing Download PDFInfo
- Publication number
- WO2008088883A1 WO2008088883A1 PCT/US2008/000697 US2008000697W WO2008088883A1 WO 2008088883 A1 WO2008088883 A1 WO 2008088883A1 US 2008000697 W US2008000697 W US 2008000697W WO 2008088883 A1 WO2008088883 A1 WO 2008088883A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- video
- web
- frame
- web client
- source
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4782—Web browsing, e.g. WebTV
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/658—Transmission by the client directed to the server
- H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/54—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/74—Browsing; Visualisation therefor
- G06F16/745—Browsing; Visualisation therefor the internal structure of a single video sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
- H04N21/2387—Stream processing in response to a playback request from an end-user, e.g. for trick-play
Definitions
- Examples of devices that enable creation of videos include video cameras and handheld devices with an integrated camera.
- a variety of web-based services exist that enable individuals to share videos via the Internet.
- a web site may enable individuals to upload videos so that the videos may be viewed by friends and family-
- a web site that enables individuals to share videos may benefit by offering a video printing service that enables clients to browse videos and select individual video frames for printing.
- Providing a web-based video browsing may present a number of problems.
- web clients may connect to a web server using a variety of different network connections that- yield different communication speeds.
- a video browsing and selection system that is adapted to a high speed connection may not work well using a low speed connections, and visa versa.
- the source videos from which video frames are selected may include a large number of video frames and browsing large numbers of video frames may impose an undesirable burden on a user.
- a system for web-based video browsing including a web server and a web client that cooperatively provide a set of video browsing functions.
- the video browsing functions enable a user of the web client to browse a source video and select a video frame from the source video without imposing an excessive burden on the user.
- the distribution- of the video browsing functions between the web server and the web client may be adapted to a communication speed between the web server and the web client.
- Figure 1 shows a web-based video browsing system according to the present teachings
- Figures 2-6 show example distributions of a set of video browsing functions among a web client and a web server
- Figures 7a-7d illustrate a semi-automatic method for selecting a video frame.
- FIG. 1 shows a web-based video browsing system 100 according to the present teachings.
- the web-based video browsing system 100 includes a web server 10 and a web client 12 that communicate via a network 14 using web protocols.
- the web server 10 and the web client 12 cooperatively provide a set of video browsing functions 18 that enable a user of the web client 12 to browse a source video 22 and select a video frame 30 from the source video 22.
- the web- based video browsing system 100 may be part of a web- based video printing service in which the video frame 30 is selected for printing.
- Other applications for the web-based video browsing system 100 include video books (photo book produced from video frames) and video thumbnailing.
- the video browsing functions 18 are distributed among the web server 10 and the web client 12.
- the distribution of the video browsing functions 18 is adapted to the characteristics of a communication link 16 used by the web client 12 to reach the communicate network 14.
- the distribution may be selected to enhance the experience of a user of the web client 12. For example, if the communication link 16 has a relatively limited bandwidth then the video browsing functions 18 are distributed among the web server 10 and the web client 12 to minimize bandwidth utilization on the communication link 16. On the other hand, if the communication link 16 has a relatively high bandwidth then the video browsing functions 18 are distributed among the web server 10 and the web client 12 to take full advantage of the available bandwidth of the communication link 16.
- Figure 2 shows a distribution of the video browsing functions 18 in an embodiment in which the source video 22 is stored on the web server 10.
- the video browsing functions 18 in this example distribution include a video browser 300 located in the web client 12 and a frame enhancer 302 located in the web server 10.
- the web client 12 downloads the source video 22 from the web server 10.
- the source video 22 may be downloaded from the web server 10 in real-time or in non-real-time .
- a user of the web client 12 browses the source video 22 on the web client 12 using the video browser 300.
- the user selects the video frame 30 from the source video 22 using the video browser 300 and then the video browser 300 uploads the video frame 30 to the web server 10.
- the frame enhancer 302 enhances the video frame 30 after it is uploaded.
- the frame enhancer 302 may be located on the web client 12 so that the video frame 30 is enhanced before it is uploaded.
- FIG 3 shows another distribution of the video browsing functions 18 in an embodiment in which the source video 22 is stored on the web server 10.
- the video browsing functions 18 in this example distribution include the video browser 300 located in the web client 12 and a frame extractor 304 located in the web server 10.
- the web client 12 downloads the source video 22 from the web server 10 and a user of the web client 12 browses the source video 22 on the web client 12 using the video browser 300 and selects the video frame 30 from the source video 22 using the video browser 300.
- the video browser 300 then uploads an identifier 54 to the web server 10.
- the identifier 54 may be a frame index of the video frame 30 within the source video 22.
- the frame extractor 304 on the web server 10 uses the identifier 54 to extract the video frame 30 from the source video 22 stored on the web server 10.
- FIG 4 shows yet another distribution of the video browsing functions 18 in an embodiment in which the source video 22 is stored on the web server 10.
- the video browsing functions 18 in this example distribution include the video browser 300 located in the web client 12 'and the frame extractor 304 located in the web server 10 along with a compressor 306 located in the web server 10.
- the compressor 306 generates a compressed video 24 and the web client 12 downloads the compressed video 24 from the web server 10.
- the compressed video 24 is a down-sample of the source video 22.
- the compressed video 24 may be a down-sample of the source video 22 in frame rate or in frame size.
- a user of the web client 12 browses the compressed video 24 on the web client 12 using the video browser 300 and selects a frame 31 corresponding to the video frame 30 from the compressed video 24 using the video browser 300.
- the video browser 300 then uploads an identifier 56 corresponding to the frame 31 to the web server 10.
- the frame extractor 304 on the web server 10 uses the identifier 56 to extract the video frame 30 from the source video 22 stored on the web server 10.
- the web server 10 may subsequently send the video frame 30 to the web client 12 such that the web client 12 displays the video frame 30 to a user. This enables a user of the web client 12 to view the video frame 30 in its full resolution before deciding whether or not it should be selected, e.g. for printing.
- FIG. 5 shows another distribution of the video browsing functions 18 in an embodiment in which the source video 22 is stored on the web server 10.
- the video browsing functions 18 in this example distribution include the video browser 300 and the frame enhancer 302 located in the web server 10.
- the video browser 300 in this embodiment enables a user of the web client 12 to browse the source video 22 and select the video frame 30 while the source video 22 remains on the web server 10.
- the video browser 300 generates a set of web pages 80-82 that the user of the web client 12 accesses to browse the source video 22 and select the video frame 30.
- the frame enhancer 302 enhances the video frame 30 once selected.
- FIG 6 shows a distribution of the video browsing functions 18 in an embodiment in which the source video 22 is stored on the web client 12.
- the video browsing functions 18 in this example distribution include the video browser 300 located in the web client 12.
- the video browser 300 enables the user of the web client 12 to browse the source video 22 and select the video frame 30 from the source video 22 while the source video 22 is on the web client 12.
- the video browser 300 then uploads the video frame 30 to the web server 10 for further processing, e.g. printing.
- the frame enhancer 302 may be located on the web server 10 or the web client 12.
- the components of the video browsing functions 18 described above, e.g. the video browser 300 may be implemented using software that runs on the web server 10 and the web client 12.
- the web client 12 may be a personal computer that is capable of running the web browser 300 implemented in software.
- the software that runs on the web client 12 may be pre-downloaded and installed permanently at the web client 12 or may be downloaded as needed and installed in a temporary folder on the web client 12 and then removed after a working session is finished.
- the software may run remotely from the web server 10 and operate on the source video 22 at the web client 12.
- Figures 7a-7d illustrates a semi-automatic method for selecting the video frame 30 from the source video 22.
- the semi-automatic method depicted in steps 200-206 may be implemented in the video browser 300 that executes on the web server 10 or the web client 12.
- Figures 7a-7d depict a user interface display rendered to a user of the web client 12 along with corresponding user selections.
- the user interface displays may be rendered using, for example, a display device of the web client 12 and the corresponding user selections may be made, for example, using a keyboard/mouse of the web client 12. User selections are indicated with darkened borders.
- Figure 7a illustrates step 200 during which a set of key frames 40-44 are extracted from the source video 22.
- a set of blocks 50-53 located in between adjacent pairs of the key frames 40-44 represents the respective sections of the source video 22 in between the corresponding key frames.
- the block 50 selected by the user of the web client 12 represents a section of the source video 22 located in between the key frames 40 and 41.
- a block 149 represents a section of the source video 22 before the key frame 40 and a block 154 represents a section of the source video 22 after the key frame 44.
- Any known method for extracting a set of key frames may be employed at step 200.
- the number of key frames extracted at step 200 may be user-selectable or may be adaptively determined in response to the content of the source video 22.
- the user of the web client 12 examines the key ⁇ frames 40-44 from step 200 and decides that they subjectively prefer the portion of the source video 22 that is bounded by the key frames 40 and 41.
- the user of the web client 12 indicates this preference by selecting the block 50, e.g. using keyboard/mouse of the web client 12.
- Figure 7b illustrates step 202 during which a set of key frames 60-64 are extracted from the portion of the source video 22 that corresponds to the block 50 selected at step 200.
- a block 169 represents a section of the source video 22 before the key frame 60 and a block 174 represents a section of the source video 22 after the key frame 64.
- the key frames 60-64 show additional detail of the section of the source video 22 that corresponds to the block 50.
- the user of the web client 12 examines the key frames 60-64 and decides that they subjectively prefer the key frame 63. The user of the web client 12 indicates this preference by selecting the key frame 63.
- Figure 7c illustrates step 204 during which the key frame 63 selected by the user is presented along with the set of M previous video frames 70-72 and M subsequent video frames 80-82 from the source video 22.
- the video frames 70-72 followed by the key frame 63 followed by the video frames 80-82 are a continuous sequence of video frames from the source video 22 without any intervening video frames.
- the user of the web client 12 selects the video frame 70 from among the video frames 70-72.
- Figure 7d illustrates step 206 during which the 5 video frame 70 selected by the user at step 204 is presented along with a set of M previous video frames 90-92 and M subsequent video frames 120-122 from the source video 22.
- the user of the web client 12 selects the video frame 30 from among the video 10 frames 90-92, the video frame 70, and the video frames 120-122.
- a semi-automatic method enables a user to express the subjective desirability of the video 15 frame 30.
- a semi-automatic process helps avoid imposing tedious manual operations on a user while enabling the user to obtain the best video frames according to their own subjective preferences.
- the video browser 300 may select video frame 30 automatically.
- a variety of known methods for selecting key frames from a video may be employed and the video frame 30 may be one of the extracted key frames.
- One example is to extract a key
- the key frames may be selected based on a content analysis of the source video 22 so that more key frames are selected from a highlight portion of the source video 22.
- a fully manual method may be used in which the user of the web client 12 browses all of the video frames in the source video 22 to select the video frame 30.
- the frame enhancer 302 may employ one or more of a variety of methods to enhance the image quality of the video frame 30. Examples include increasing the resolution of the video frame 30 by applying a super- resolution process, reducing noise and artifacts in the video frame 30 using a de-noising process, sharpening edges of the video frame 30, correcting colors in the video frame 30 with white balance, etc.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Description
Claims
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2009546433A JP2010517368A (en) | 2007-01-19 | 2008-01-18 | Web-based video browsing |
EP08724624A EP2103126A4 (en) | 2007-01-19 | 2008-01-18 | Web-based video browsing |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/655,566 US8788938B2 (en) | 2007-01-19 | 2007-01-19 | Web-based video browsing |
US11/655,566 | 2007-01-19 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2008088883A1 true WO2008088883A1 (en) | 2008-07-24 |
Family
ID=39636313
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2008/000697 WO2008088883A1 (en) | 2007-01-19 | 2008-01-18 | Web-based video browsing |
Country Status (6)
Country | Link |
---|---|
US (1) | US8788938B2 (en) |
EP (1) | EP2103126A4 (en) |
JP (1) | JP2010517368A (en) |
KR (1) | KR101114768B1 (en) |
CN (1) | CN101589618A (en) |
WO (1) | WO2008088883A1 (en) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8327253B2 (en) | 2010-11-09 | 2012-12-04 | Shutterfly, Inc. | System and method for creating photo books using video |
JP5689095B2 (en) * | 2012-07-10 | 2015-03-25 | 新日鉄住金ソリューションズ株式会社 | Image processing apparatus, image processing method, and program |
CN104917666B (en) | 2014-03-13 | 2019-08-06 | 腾讯科技(深圳)有限公司 | A kind of method and apparatus making personalized dynamic expression |
JP6574144B2 (en) * | 2016-03-02 | 2019-09-11 | APRESIA Systems株式会社 | Relay device and relay system |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0782085A1 (en) | 1995-12-28 | 1997-07-02 | International Business Machines Corporation | Video browsing on the world wide web |
US6173317B1 (en) * | 1997-03-14 | 2001-01-09 | Microsoft Corporation | Streaming and displaying a video stream with synchronized annotations over a computer network |
US20010013068A1 (en) * | 1997-03-25 | 2001-08-09 | Anders Edgar Klemets | Interleaved multiple multimedia stream for synchronized transmission over a computer network |
US20020135808A1 (en) | 2001-03-22 | 2002-09-26 | Parry Travis J. | Method and apparatus for printing video data |
US20030009488A1 (en) * | 2001-05-22 | 2003-01-09 | Reuters America, Inc | System and method of accelerating delivery of dynamic web pages over a network |
US6631424B1 (en) * | 1997-09-10 | 2003-10-07 | Fmr Corp. | Distributing information using a computer |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5835667A (en) * | 1994-10-14 | 1998-11-10 | Carnegie Mellon University | Method and apparatus for creating a searchable digital video library and a system and method of using such a library |
US5664227A (en) * | 1994-10-14 | 1997-09-02 | Carnegie Mellon University | System and method for skimming digital audio/video data |
US5630670A (en) | 1995-06-03 | 1997-05-20 | INA W alzlager Schaeffler KG | Axial rolling bearing |
US6006241A (en) * | 1997-03-14 | 1999-12-21 | Microsoft Corporation | Production of a video stream with synchronized annotations over a computer network |
US6782049B1 (en) * | 1999-01-29 | 2004-08-24 | Hewlett-Packard Development Company, L.P. | System for selecting a keyframe to represent a video |
US6535639B1 (en) * | 1999-03-12 | 2003-03-18 | Fuji Xerox Co., Ltd. | Automatic video summarization using a measure of shot importance and a frame-packing method |
EP1312219A2 (en) * | 2000-08-25 | 2003-05-21 | Intellocity USA, Inc. | Method of enhancing streaming media content |
US20020071651A1 (en) | 2000-08-31 | 2002-06-13 | Wurz William Hastings | Method of indexing and printing user specified frames during playback or contemporaneous video recording |
US7281260B2 (en) * | 2001-08-07 | 2007-10-09 | Loral Cyberstar, Inc. | Streaming media publishing system and method |
KR100464076B1 (en) | 2001-12-29 | 2004-12-30 | 엘지전자 주식회사 | Video browsing system based on keyframe |
JP4110785B2 (en) | 2002-01-28 | 2008-07-02 | セイコーエプソン株式会社 | Image printing system, image printed material providing method, image distribution apparatus, image printing apparatus, and program for the apparatus |
US20030212993A1 (en) | 2002-05-07 | 2003-11-13 | Pere Obrador | System and method for efficiently managing video files |
US7586636B2 (en) | 2002-12-11 | 2009-09-08 | Broadcom Corp. | Printer resource sharing in a media exchange network |
-
2007
- 2007-01-19 US US11/655,566 patent/US8788938B2/en active Active
-
2008
- 2008-01-18 EP EP08724624A patent/EP2103126A4/en not_active Ceased
- 2008-01-18 JP JP2009546433A patent/JP2010517368A/en active Pending
- 2008-01-18 WO PCT/US2008/000697 patent/WO2008088883A1/en active Application Filing
- 2008-01-18 CN CNA2008800025660A patent/CN101589618A/en active Pending
- 2008-01-18 KR KR1020097015025A patent/KR101114768B1/en active IP Right Grant
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0782085A1 (en) | 1995-12-28 | 1997-07-02 | International Business Machines Corporation | Video browsing on the world wide web |
US6173317B1 (en) * | 1997-03-14 | 2001-01-09 | Microsoft Corporation | Streaming and displaying a video stream with synchronized annotations over a computer network |
US20010013068A1 (en) * | 1997-03-25 | 2001-08-09 | Anders Edgar Klemets | Interleaved multiple multimedia stream for synchronized transmission over a computer network |
US6631424B1 (en) * | 1997-09-10 | 2003-10-07 | Fmr Corp. | Distributing information using a computer |
US20020135808A1 (en) | 2001-03-22 | 2002-09-26 | Parry Travis J. | Method and apparatus for printing video data |
US20030009488A1 (en) * | 2001-05-22 | 2003-01-09 | Reuters America, Inc | System and method of accelerating delivery of dynamic web pages over a network |
Non-Patent Citations (1)
Title |
---|
See also references of EP2103126A4 |
Also Published As
Publication number | Publication date |
---|---|
KR101114768B1 (en) | 2012-03-05 |
EP2103126A1 (en) | 2009-09-23 |
US8788938B2 (en) | 2014-07-22 |
KR20090091340A (en) | 2009-08-27 |
JP2010517368A (en) | 2010-05-20 |
EP2103126A4 (en) | 2010-03-31 |
US20080178086A1 (en) | 2008-07-24 |
CN101589618A (en) | 2009-11-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9866630B2 (en) | System, method and apparatus for media submission | |
EP2255527B1 (en) | Method for implementing rich video on mobile terminals | |
CN107491701B (en) | Automatically creating a group for sharing photos | |
US9270926B2 (en) | System and method for distributed media personalization | |
CN101068235B (en) | Video frequency program prebrowsing method and system | |
US20220337655A1 (en) | Multimedia file upload | |
US20080018658A1 (en) | Method of Optimising Web Page Access in Wireless Networks | |
CN106384388B (en) | The real-time try-in method of internet glasses and system based on HTML5 and augmented reality | |
JP2002170113A (en) | Method and apparatus for providing digitally enlarged image via data communication network | |
CN105144146B (en) | Information processing method, transmitting device, information processing unit and information processing method in reception device, reception device | |
KR20010111380A (en) | An internet service apparatus and service method | |
US8788938B2 (en) | Web-based video browsing | |
CN102572072A (en) | Mobile phone video preview method, video preview control device, and mobile phone with device | |
CN101739654A (en) | Method, system and server for manufacturing image set | |
CN101867784B (en) | Method for filtering advertisements, digital television receiving terminal, server terminal and system | |
JP2004302500A (en) | Image processing apparatus and image processing method | |
KR102521904B1 (en) | System and method for automatic video editing using utilization of auto labeling and insertion of design elements | |
KR102521903B1 (en) | System and method for automatic video editing using auto labeling | |
US7461331B2 (en) | Automated construction of print order for images capture during a session | |
CN103702167B (en) | Method and electronic equipment for displaying program preview | |
JP5027774B2 (en) | Image browsing control apparatus, image browsing control method, and image browsing control program for dating system | |
CN101667978B (en) | Network service method, system thereof and data server thereof | |
KR101997909B1 (en) | Program and recording medium for extracting ai image learning parameters for resolution restoration | |
US20030043274A1 (en) | Method for semiautomated digital photo editing | |
CN107071495A (en) | A kind of picture compression method and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200880002566.0 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 08724624 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 3808/CHENP/2009 Country of ref document: IN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2008724624 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1020097015025 Country of ref document: KR |
|
ENP | Entry into the national phase |
Ref document number: 2009546433 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |