WO2009093136A3 - Image capture and motion picture generation - Google Patents

Image capture and motion picture generation Download PDF

Info

Publication number
WO2009093136A3
WO2009093136A3 PCT/IB2009/000119 IB2009000119W WO2009093136A3 WO 2009093136 A3 WO2009093136 A3 WO 2009093136A3 IB 2009000119 W IB2009000119 W IB 2009000119W WO 2009093136 A3 WO2009093136 A3 WO 2009093136A3
Authority
WO
WIPO (PCT)
Prior art keywords
image data
viewpoint
scenic
movement capture
viewpoint position
Prior art date
Application number
PCT/IB2009/000119
Other languages
French (fr)
Other versions
WO2009093136A2 (en
Inventor
Luke Reid
Original Assignee
Areograph Ltd
Eip Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Areograph Ltd, Eip Limited filed Critical Areograph Ltd
Publication of WO2009093136A2 publication Critical patent/WO2009093136A2/en
Publication of WO2009093136A3 publication Critical patent/WO2009093136A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • G06T15/20Perspective computation
    • G06T15/205Image-based rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/698Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/14Picture signal circuitry for video frequency region
    • H04N5/144Movement detection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/2224Studio circuitry; Studio devices; Studio equipment related to virtual studio applications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2625Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect
    • H04N5/2627Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect for providing spin image effect, 3D stop motion effect or temporal freeze effect
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/272Means for inserting a foreground image in a background image, i.e. inlay, outlay

Abstract

A method of generating a moving image in the form of a series of playback frames, wherein said moving image is generated from: a first set of image data captured using a motion picture camera system having an associated movement capture system; movement capture data generated by said movement capture system; and a second set of scenic image data captured using a scene-scanning imaging system which provides image data from which images, representing viewpoints distributed across a scene through which a virtual viewer is capable of navigating, are derivable, the method comprising: on the basis of said movement capture data, selecting a first viewpoint position; deriving first scenic viewpoint image data from said second set of image data, based on the selection of said first viewpoint position; combining image data from said first image data with said first scenic viewpoint image data to generate a first playback frame; on the basis of said movement capture data, selecting a next viewpoint position from a plurality of potential next viewpoint positions distributed relative to the first viewpoint position across said scene; deriving second scenic viewpoint image data from said second set of image data, based on the selection of said next viewpoint position; and combining image data from said first image data with said second scenic viewpoint image data to generate a second playback frame.
PCT/IB2009/000119 2008-01-24 2009-01-23 Image capture and motion picture generation WO2009093136A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB0801297A GB2456802A (en) 2008-01-24 2008-01-24 Image capture and motion picture generation using both motion camera and scene scanning imaging systems
GB0801297.3 2008-01-24

Publications (2)

Publication Number Publication Date
WO2009093136A2 WO2009093136A2 (en) 2009-07-30
WO2009093136A3 true WO2009093136A3 (en) 2009-11-05

Family

ID=39186254

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2009/000119 WO2009093136A2 (en) 2008-01-24 2009-01-23 Image capture and motion picture generation

Country Status (2)

Country Link
GB (1) GB2456802A (en)
WO (1) WO2009093136A2 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE202009014231U1 (en) * 2009-10-21 2010-01-07 Robotics Technology Leaders Gmbh System for visualizing a camera situation in a virtual recording studio
US20110222757A1 (en) 2010-03-10 2011-09-15 Gbo 3D Technology Pte. Ltd. Systems and methods for 2D image and spatial data capture for 3D stereo imaging
JP5629642B2 (en) * 2011-05-19 2014-11-26 株式会社ソニー・コンピュータエンタテインメント Moving image photographing apparatus, information processing system, information processing apparatus, and image data processing method
GB201208088D0 (en) 2012-05-09 2012-06-20 Ncam Sollutions Ltd Ncam
US9769365B1 (en) 2013-02-15 2017-09-19 Red.Com, Inc. Dense field imaging
US9113154B2 (en) 2013-07-10 2015-08-18 Faro Technologies, Inc. Three-dimensional measurement device having three-dimensional overview camera
US9888174B2 (en) 2015-10-15 2018-02-06 Microsoft Technology Licensing, Llc Omnidirectional camera with movement detection
US10277858B2 (en) 2015-10-29 2019-04-30 Microsoft Technology Licensing, Llc Tracking object of interest in an omnidirectional video
US11651473B2 (en) * 2020-05-22 2023-05-16 Meta Platforms, Inc. Outputting warped images from captured video data
CN115423920B (en) * 2022-09-16 2024-01-30 如你所视(北京)科技有限公司 VR scene processing method, device and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1997003416A1 (en) * 1995-07-10 1997-01-30 Sarnoff Corporation Method and system for rendering and combining images
EP0930584A2 (en) * 1998-01-15 1999-07-21 International Business Machines Corporation Method and apparatus for displaying panoramas with video data

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2329292A (en) * 1997-09-12 1999-03-17 Orad Hi Tec Systems Ltd Camera position sensing system
JP4649050B2 (en) * 2001-03-13 2011-03-09 キヤノン株式会社 Image processing apparatus, image processing method, and control program
JP4099013B2 (en) * 2002-07-24 2008-06-11 日本放送協会 Virtual studio video generation apparatus and method and program thereof
SE0203908D0 (en) * 2002-12-30 2002-12-30 Abb Research Ltd An augmented reality system and method
EP1834312A2 (en) * 2005-01-03 2007-09-19 Vumii, Inc. Systems and methods for night time surveillance
US20070236514A1 (en) * 2006-03-29 2007-10-11 Bracco Imaging Spa Methods and Apparatuses for Stereoscopic Image Guided Surgical Navigation

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1997003416A1 (en) * 1995-07-10 1997-01-30 Sarnoff Corporation Method and system for rendering and combining images
EP0930584A2 (en) * 1998-01-15 1999-07-21 International Business Machines Corporation Method and apparatus for displaying panoramas with video data

Also Published As

Publication number Publication date
GB0801297D0 (en) 2008-03-05
WO2009093136A2 (en) 2009-07-30
GB2456802A (en) 2009-07-29

Similar Documents

Publication Publication Date Title
WO2009093136A3 (en) Image capture and motion picture generation
WO2008107783A3 (en) Image capture and playback
CN107925753B (en) Method and system for 3D image capture with dynamic camera
US8928729B2 (en) Systems and methods for converting video
US20180192033A1 (en) Multi-view scene flow stitching
EP2153409A4 (en) Camera pose estimation apparatus and method for augmented reality imaging
Lai et al. Real-time panoramic depth maps from omni-directional stereo images for 6 dof videos in virtual reality
WO2008061490A3 (en) Arrangement and method for capturing and displaying images of a scene and/or an object
US10277890B2 (en) System and method for capturing and viewing panoramic images having motion parallax depth perception without image stitching
US20200388068A1 (en) System and apparatus for user controlled virtual camera for volumetric video
CN105072314A (en) Virtual studio implementation method capable of automatically tracking objects
JP2007536825A5 (en)
WO2011043249A1 (en) Image processing device and method, and program
EP3374992A1 (en) Device and method for creating videoclips from omnidirectional video
RU2012151489A (en) SIMULATED VIDEO WITH ADDITIONAL VIEWPOINTS AND AN ENHANCED RESOLUTION CAPABILITY FOR TRANSPORT MOTION SURVEILLANCE CAMERAS
KR101245214B1 (en) Method and system for generating three-dimensional video utilizing a monoscopic camera
JP2008061237A (en) Systems and methods for panoramic image construction using small sensor array
WO2007142776A3 (en) System and method for combined 3-d imaging and full motion video using a single lenticular lens sheet
CN105488801A (en) Method and system for combining real shooting of full dome film with three-dimensional virtual scene
GB2536822A (en) Motion tracking system
JP2013025649A (en) Image processing device, image processing method, and program
CN103051916A (en) Apparatus and method of creating 3 dimension panorama image
JP2010166218A (en) Camera system and method of controlling the same
JP2008187678A (en) Video generating apparatus and video generating program
KR101603876B1 (en) Method for fabricating a panorama

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09703513

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 09703513

Country of ref document: EP

Kind code of ref document: A2