GB2534821A - Analysis and manipulation of objects and layers in surround views - Google Patents

Analysis and manipulation of objects and layers in surround views Download PDF

Info

Publication number
GB2534821A
GB2534821A GB1609577.0A GB201609577A GB2534821A GB 2534821 A GB2534821 A GB 2534821A GB 201609577 A GB201609577 A GB 201609577A GB 2534821 A GB2534821 A GB 2534821A
Authority
GB
United Kingdom
Prior art keywords
layers
surround view
manipulation
objects
analysis
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
GB1609577.0A
Other versions
GB201609577D0 (en
GB2534821B8 (en
GB2534821B (en
Inventor
Johannes Josef Holzer Stefan
David Miller Stephen
Bogdan Rusu Radu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fyusion Inc
Original Assignee
Fyusion Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fyusion Inc filed Critical Fyusion Inc
Publication of GB201609577D0 publication Critical patent/GB201609577D0/en
Publication of GB2534821A publication Critical patent/GB2534821A/en
Application granted granted Critical
Publication of GB2534821B publication Critical patent/GB2534821B/en
Publication of GB2534821B8 publication Critical patent/GB2534821B8/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53—Querying
    • G06F16/532—Query formulation, e.g. graphical querying
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/5838—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using colour
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/73—Querying
    • G06F16/738—Presentation of query results
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842—Selection of displayed objects or displayed text elements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
    • H04N13/279—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals the virtual viewpoint locations being selected by the viewers or determined by tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G06T2207/10021—Stereoscopic video; Stereoscopic image sequence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2215/00—Indexing scheme for image rendering
    • G06T2215/12—Shadow map, environment map
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2215/00—Indexing scheme for image rendering
    • G06T2215/16—Using real world measurements to influence rendering

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Library & Information Science (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Processing Or Creating Images (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. According to particular embodiments, the spatial relationship between multiple images and video is analyzed together with location information data, for purposes of creating a representation referred to herein as a surround view for presentation on a device. An object included in the surround view may be manipulated along axes by manipulating the device along corresponding axes. In particular embodiments, a surround view can be separated into layers. Effects can be applied to one or more of these layers to enhance the interactive and immersive viewing experience of the surround view.
GB1609577.0A 2013-11-12 2014-11-12 Analysis and manipulation of objects and layers in surround views Active GB2534821B8 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201361903359P 2013-11-12 2013-11-12
PCT/US2014/065282 WO2015073570A2 (en) 2013-11-12 2014-11-12 Analysis and manipulation of objects and layers in surround views

Publications (4)

Publication Number Publication Date
GB201609577D0 GB201609577D0 (en) 2016-07-13
GB2534821A true GB2534821A (en) 2016-08-03
GB2534821B GB2534821B (en) 2018-07-25
GB2534821B8 GB2534821B8 (en) 2018-08-08

Family

ID=53043419

Family Applications (1)

Application Number Title Priority Date Filing Date
GB1609577.0A Active GB2534821B8 (en) 2013-11-12 2014-11-12 Analysis and manipulation of objects and layers in surround views

Country Status (7)

Country Link
US (9) US20150130799A1 (en)
JP (1) JP2017501516A (en)
KR (1) KR20160086868A (en)
CN (1) CN105849781B (en)
DE (1) DE112014005165T5 (en)
GB (1) GB2534821B8 (en)
WO (1) WO2015073570A2 (en)

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9836873B2 (en) 2013-11-12 2017-12-05 Fyusion, Inc. Analysis and manipulation of panoramic surround views
US10430995B2 (en) 2014-10-31 2019-10-01 Fyusion, Inc. System and method for infinite synthetic image generation from multi-directional structured image array
US10540773B2 (en) 2014-10-31 2020-01-21 Fyusion, Inc. System and method for infinite smoothing of image sequences
US10818029B2 (en) 2014-10-31 2020-10-27 Fyusion, Inc. Multi-directional structured image array capture on a 2D graph
US10852902B2 (en) 2015-07-15 2020-12-01 Fyusion, Inc. Automatic tagging of objects on a multi-view interactive digital media representation of a dynamic entity
US11195314B2 (en) 2015-07-15 2021-12-07 Fyusion, Inc. Artificially rendering images using viewpoint interpolation and extrapolation
US11202017B2 (en) 2016-10-06 2021-12-14 Fyusion, Inc. Live style transfer on a mobile device
US11435869B2 (en) 2015-07-15 2022-09-06 Fyusion, Inc. Virtual reality environment based manipulation of multi-layered multi-view interactive digital media representations
US11488380B2 (en) 2018-04-26 2022-11-01 Fyusion, Inc. Method and apparatus for 3-D auto tagging
US11632533B2 (en) 2015-07-15 2023-04-18 Fyusion, Inc. System and method for generating combined embedded multi-view interactive digital media representations
US11636637B2 (en) 2015-07-15 2023-04-25 Fyusion, Inc. Artificially rendering images using viewpoint interpolation and extrapolation
US11776229B2 (en) 2017-06-26 2023-10-03 Fyusion, Inc. Modification of multi-view interactive digital media representation
US11876948B2 (en) 2017-05-22 2024-01-16 Fyusion, Inc. Snapshots at predefined intervals or angles
US11956412B2 (en) 2015-07-15 2024-04-09 Fyusion, Inc. Drone based capture of multi-view interactive digital media
US11960533B2 (en) 2017-01-18 2024-04-16 Fyusion, Inc. Visual search using multi-view interactive digital media representations
US12261990B2 (en) 2015-07-15 2025-03-25 Fyusion, Inc. System and method for generating combined embedded multi-view interactive digital media representations

Families Citing this family (101)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10063848B2 (en) * 2007-08-24 2018-08-28 John G. Posa Perspective altering display system
JP2015111746A (en) * 2012-04-09 2015-06-18 ソニー株式会社 Image processing apparatus, image processing method, and program
US10163261B2 (en) 2014-03-19 2018-12-25 Matterport, Inc. Selecting two-dimensional imagery data for display within a three-dimensional model
US9786097B2 (en) 2012-06-22 2017-10-10 Matterport, Inc. Multi-modal method for interacting with 3D models
US10139985B2 (en) * 2012-06-22 2018-11-27 Matterport, Inc. Defining, displaying and interacting with tags in a three-dimensional model
US10168871B2 (en) * 2013-09-16 2019-01-01 Rovi Guides, Inc. Methods and systems for presenting direction-specific media assets
US20150215530A1 (en) * 2014-01-27 2015-07-30 Microsoft Corporation Universal capture
KR102214193B1 (en) * 2014-03-25 2021-02-09 삼성전자 주식회사 Depth camera device, 3d image display system having the same and control methods thereof
US10026010B2 (en) * 2014-05-14 2018-07-17 At&T Intellectual Property I, L.P. Image quality estimation using a reference image portion
US10068373B2 (en) * 2014-07-01 2018-09-04 Samsung Electronics Co., Ltd. Electronic device for providing map information
US9940541B2 (en) 2015-07-15 2018-04-10 Fyusion, Inc. Artificially rendering images using interpolation of tracked control points
US10586378B2 (en) 2014-10-31 2020-03-10 Fyusion, Inc. Stabilizing image sequences based on camera rotation and focal length parameters
US10719939B2 (en) 2014-10-31 2020-07-21 Fyusion, Inc. Real-time mobile device capture and generation of AR/VR content
US10726593B2 (en) 2015-09-22 2020-07-28 Fyusion, Inc. Artificially rendering images using viewpoint interpolation and extrapolation
US10726560B2 (en) 2014-10-31 2020-07-28 Fyusion, Inc. Real-time mobile device capture and generation of art-styled AR/VR content
US10650574B2 (en) 2014-10-31 2020-05-12 Fyusion, Inc. Generating stereoscopic pairs of images from a single lens camera
US9998655B2 (en) * 2014-12-23 2018-06-12 Quallcomm Incorporated Visualization for viewing-guidance during dataset-generation
EP3043316A1 (en) * 2015-01-08 2016-07-13 Thomson Licensing Method and apparatus for generating superpixels for multi-view images
US9723206B1 (en) * 2015-03-11 2017-08-01 Vsn Technologies, Inc. Enabling a true surround view of a 360 panorama via a dynamic cylindrical projection of the panorama
US9704298B2 (en) * 2015-06-23 2017-07-11 Paofit Holdings Pte Ltd. Systems and methods for generating 360 degree mixed reality environments
EP3859676B1 (en) 2015-06-30 2024-07-31 Meta Platforms, Inc. Method in constructing a model of a scenery and device therefor
US10698558B2 (en) 2015-07-15 2020-06-30 Fyusion, Inc. Automatic tagging of objects on a multi-view interactive digital media representation of a dynamic entity
WO2017011700A1 (en) * 2015-07-15 2017-01-19 Fyusion, Inc. Artificially rendering images using viewpoint interpolation and extrapolation
US10750161B2 (en) 2015-07-15 2020-08-18 Fyusion, Inc. Multi-view interactive digital media representation lock screen
KR102370374B1 (en) * 2015-08-04 2022-03-04 삼성전자주식회사 Photographing apparatus module, user terminal having the photographing apparatus and control method for the user terminal
US11783864B2 (en) 2015-09-22 2023-10-10 Fyusion, Inc. Integration of audio into a multi-view interactive digital media representation
KR102432085B1 (en) * 2015-09-23 2022-08-11 노키아 테크놀로지스 오와이 A method, an apparatus and a computer program product for coding a 360-degree panoramic video
US10791285B2 (en) * 2015-10-05 2020-09-29 Woncheol Choi Virtual flying camera system
US9773022B2 (en) 2015-10-07 2017-09-26 Google Inc. Displaying objects based on a plurality of models
JP6833830B2 (en) * 2015-10-16 2021-02-24 レイア、インコーポレイテッドＬｅｉａ Ｉｎｃ． Near-eye display based on multi-beam diffraction grating
US10097747B2 (en) * 2015-10-21 2018-10-09 Qualcomm Incorporated Multiple camera autofocus synchronization
US20170155572A1 (en) * 2015-11-30 2017-06-01 International Business Machines Corporation Relative positioning of a mobile computing device in a network
GB2545275A (en) * 2015-12-11 2017-06-14 Nokia Technologies Oy Causing provision of virtual reality content
US9652828B1 (en) 2015-12-29 2017-05-16 Motorola Solutions, Inc. Method and apparatus for imaging a scene
US9715638B1 (en) 2015-12-31 2017-07-25 Nokia Technologies Oy Method and apparatus for identifying salient subimages within a panoramic image
US10157501B2 (en) * 2016-01-08 2018-12-18 Skyyfish, LLC Camera angle visualization for aerial vehicle flight plan
CN107026973B (en) * 2016-02-02 2020-03-13 株式会社摩如富 Image processing device, image processing method and photographic auxiliary equipment
GB201609833D0 (en) * 2016-06-06 2016-07-20 Go Been There Ltd Video processing and tagging platform
WO2017218834A1 (en) 2016-06-17 2017-12-21 Kerstein Dustin System and method for capturing and viewing panoramic images having motion parralax depth perception without images stitching
JP7098604B2 (en) * 2016-08-19 2022-07-11 ファイユージョン，インコーポレイテッド Automatic tagging of objects in a multi-view interactive digital media representation of a dynamic entity
WO2018052665A1 (en) * 2016-08-19 2018-03-22 Fyusion, Inc. Virtual reality environment based manipulation of multi-layered multi-view interactive digital media representations
WO2018039269A1 (en) * 2016-08-22 2018-03-01 Magic Leap, Inc. Augmented reality display device with deep learning sensors
US10311614B2 (en) * 2016-09-07 2019-06-04 Microsoft Technology Licensing, Llc Customized realty renovation visualization
US10313751B2 (en) 2016-09-29 2019-06-04 International Business Machines Corporation Digital display viewer based on location
US10740939B1 (en) * 2016-12-09 2020-08-11 Snap Inc. Fast image style transfers
US10665024B2 (en) 2016-12-12 2020-05-26 Fyusion, Inc. Providing recording guidance in generating a multi-view interactive digital media representation
US10297059B2 (en) 2016-12-21 2019-05-21 Motorola Solutions, Inc. Method and image processor for sending a combined image to human versus machine consumers
US11636572B2 (en) 2016-12-29 2023-04-25 Nokia Technologies Oy Method and apparatus for determining and varying the panning speed of an image based on saliency
US10353946B2 (en) * 2017-01-18 2019-07-16 Fyusion, Inc. Client-server communication for live search using multi-view digital media representations
US20180224942A1 (en) * 2017-02-03 2018-08-09 International Business Machines Corporation Method and system for navigation of content in virtual image display devices
US10628675B2 (en) 2017-02-07 2020-04-21 Fyusion, Inc. Skeleton detection and tracking via client-server communication
US11044464B2 (en) 2017-02-09 2021-06-22 Fyusion, Inc. Dynamic content modification of image and video based multi-view interactive digital media representations
US10068316B1 (en) * 2017-03-03 2018-09-04 Fyusion, Inc. Tilts as a measure of user engagement for multiview digital media representations
US10440351B2 (en) 2017-03-03 2019-10-08 Fyusion, Inc. Tilts as a measure of user engagement for multiview interactive digital media representations
US10356395B2 (en) 2017-03-03 2019-07-16 Fyusion, Inc. Tilts as a measure of user engagement for multiview digital media representations
CN107102794B (en) * 2017-04-27 2020-08-11 武汉数文科技有限公司 Operation processing method and device
CN116521302A (en) 2017-05-16 2023-08-01 苹果公司 User interface for peer-to-peer transfers
US10200677B2 (en) 2017-05-22 2019-02-05 Fyusion, Inc. Inertial measurement unit progress estimation
US10237477B2 (en) 2017-05-22 2019-03-19 Fyusion, Inc. Loop closure
US11138432B2 (en) 2017-05-25 2021-10-05 Fyusion, Inc. Visual feature tagging in multi-view interactive digital media representations
US10701413B2 (en) * 2017-06-05 2020-06-30 Disney Enterprises, Inc. Real-time sub-second download and transcode of a video stream
US11164606B2 (en) * 2017-06-30 2021-11-02 Qualcomm Incorporated Audio-driven viewport selection
CA3069183A1 (en) * 2017-07-14 2019-01-17 Cappasity Inc. Systems and methods for creating and displaying interactive 3d representations of real objects
US10275856B2 (en) * 2017-08-03 2019-04-30 Facebook, Inc. Composited animation
US10592550B2 (en) 2017-10-13 2020-03-17 International Business Machines Corporation System and method for species and object recognition
US10469768B2 (en) * 2017-10-13 2019-11-05 Fyusion, Inc. Skeleton-based effects and background replacement
JP6980496B2 (en) * 2017-11-21 2021-12-15 キヤノン株式会社 Information processing equipment, information processing methods, and programs
CN108234904B (en) * 2018-02-05 2020-10-27 刘捷 Multi-video fusion method, device and system
US10659686B2 (en) 2018-03-23 2020-05-19 Fyusion, Inc. Conversion of an interactive multi-view image data set into a video
CN108563700A (en) * 2018-03-23 2018-09-21 北京恩耐科技有限公司 The quick methods of exhibiting of virtual reality display system
US10687046B2 (en) 2018-04-05 2020-06-16 Fyusion, Inc. Trajectory smoother for generating multi-view interactive digital media representations
US10382739B1 (en) 2018-04-26 2019-08-13 Fyusion, Inc. Visual annotation using tagging sessions
KR102086779B1 (en) * 2018-05-14 2020-03-09 단국대학교 산학협력단 Focus setting modul and method, virtual video playback system including the same
US11900258B2 (en) * 2018-05-23 2024-02-13 Sony Interactive Entertainment Inc. Learning device, image generating device, learning method, image generating method, and program
CN109061705B (en) * 2018-06-27 2022-07-12 千寻位置网络有限公司 Data processing method and terminal based on tensoflow and differential positioning platform
CN111050145B (en) * 2018-10-11 2022-07-01 上海云绅智能科技有限公司 Multi-screen fusion imaging method, intelligent device and system
CN109447887B (en) * 2018-10-16 2022-12-23 广西师范大学 A Hidden Image Inpainting Method Based on Convex Hull and Group Interpolation
US11385850B2 (en) 2018-10-26 2022-07-12 Sony Interactive Entertainment Inc. Content reproduction device, picture data output device, content creation device, content reproduction method, picture data output method, and content creation method
JP2020095602A (en) * 2018-12-14 2020-06-18 ヤフー株式会社 Display program, display device, and display method
DE102018222861A1 (en) 2018-12-21 2020-06-25 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Device with a multi-aperture imaging device for accumulating image information
US11388326B2 (en) * 2019-01-18 2022-07-12 Justin Dion Cowell Camera collaboration configuration
US10616483B1 (en) * 2019-02-27 2020-04-07 Hong Kong Applied Science and Technology Research Institute Company Limited Apparatus and method of generating electronic three-dimensional walkthrough environment
CN109951654B (en) * 2019-03-06 2022-02-15 腾讯科技（深圳）有限公司 Video synthesis method, model training method and related device
US11314383B2 (en) * 2019-03-24 2022-04-26 Apple Inc. Stacked media elements with selective parallax effects
WO2021020143A1 (en) * 2019-07-30 2021-02-04 ソニー株式会社 Image-processing device, image-processing method, and recording medium
TWI714318B (en) * 2019-10-25 2020-12-21 緯創資通股份有限公司 Face recognition method and face recognition apparatus
US10970330B1 (en) * 2019-11-20 2021-04-06 International Business Machines Corporation Method of searching images using rotational gesture input
CN113256361B (en) 2020-02-10 2024-12-27 阿里巴巴集团控股有限公司 Commodity publishing method and image processing method, device, equipment and storage medium
CN111612689B (en) * 2020-05-28 2024-04-05 上海联影医疗科技股份有限公司 Medical image processing method, medical image processing device, computer equipment and readable storage medium
US11790254B2 (en) 2020-12-04 2023-10-17 Shutterstock, Inc. Method and system for detecting model file content
US11983702B2 (en) * 2021-02-01 2024-05-14 Apple Inc. Displaying a representation of a card with a layered structure
US11921992B2 (en) 2021-05-14 2024-03-05 Apple Inc. User interfaces related to time
CN113246863A (en) * 2021-06-25 2021-08-13 上海昶音通讯科技有限公司 Panoramic all-round looking system for large automobile and image processing method
US11989398B2 (en) * 2021-10-22 2024-05-21 Ebay Inc. Digital content view control system
EP4175281B1 (en) 2021-11-02 2023-08-02 Rene Kiessig Method and device for producing a communication channel
DE202021003383U1 (en) 2021-11-02 2021-11-22 Rene Kiessig System arrangement and apparatus for establishing a communication channel
US12004821B2 (en) 2022-02-03 2024-06-11 Medtronic Navigation, Inc. Systems, methods, and devices for generating a hybrid image
US12249099B2 (en) * 2022-02-03 2025-03-11 Medtronic Navigation, Inc. Systems, methods, and devices for reconstructing a three-dimensional representation
US12295797B2 (en) 2022-02-03 2025-05-13 Medtronic Navigation, Inc. Systems, methods, and devices for providing an augmented display
CN114581336B (en) * 2022-03-21 2024-12-17 北京有竹居网络技术有限公司 Image restoration method, device, equipment, medium and product
CN114880565B (en) * 2022-05-17 2024-08-09 腾讯科技（深圳）有限公司 Information recommendation method, model training method and related device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060188147A1 (en) * 2005-02-24 2006-08-24 Rai Barinder S Method and apparatus applying digital image filtering to color filter array data
US20100171691A1 (en) * 2007-01-26 2010-07-08 Ralph Cook Viewing images with tilt control on a hand-held device
US20130155180A1 (en) * 2011-12-14 2013-06-20 Microsoft Corporation Parallax compensation
US20130162634A1 (en) * 2011-12-26 2013-06-27 Samsung Electronics Co., Ltd. Image processing method and apparatus using multi-layer representation

Family Cites Families (47)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8427538B2 (en) * 2004-04-30 2013-04-23 Oncam Grandeye Multiple view and multiple object processing in wide-angle video camera
US7746376B2 (en) * 2004-06-16 2010-06-29 Felipe Mendoza Method and apparatus for accessing multi-dimensional mapping and information
KR20070119018A (en) * 2005-02-23 2007-12-18 크레이그 써머스 Auto scene modeling for 3D cameras and 3D video
JP4774806B2 (en) * 2005-05-25 2011-09-14 セイコーエプソン株式会社 File search device, printing device, file search method and program thereof
JP4853149B2 (en) * 2005-09-14 2012-01-11 ソニー株式会社 Image processing apparatus, image display apparatus, image processing method, program, and recording medium
JP4463215B2 (en) * 2006-01-30 2010-05-19 日本電気株式会社 Three-dimensional processing apparatus and three-dimensional information terminal
US8078004B2 (en) 2006-11-09 2011-12-13 University Of Delaware Geometric registration of images by similarity transformation using two reference points
US7900225B2 (en) * 2007-02-20 2011-03-01 Google, Inc. Association of ads with tagged audiovisual content
US8254684B2 (en) * 2008-01-02 2012-08-28 Yahoo! Inc. Method and system for managing digital photos
JP5039922B2 (en) * 2008-03-21 2012-10-03 インターナショナル・ビジネス・マシーンズ・コーポレーション Image drawing system, image drawing server, image drawing method, and computer program
US20090287655A1 (en) * 2008-05-13 2009-11-19 Bennett James D Image search engine employing user suitability feedback
US9683853B2 (en) * 2009-01-23 2017-06-20 Fuji Xerox Co., Ltd. Image matching in support of mobile navigation
US8452794B2 (en) * 2009-02-11 2013-05-28 Microsoft Corporation Visual and textual query suggestion
US20100208029A1 (en) * 2009-02-13 2010-08-19 Samsung Electronics Co., Ltd Mobile immersive display system
JP2010226500A (en) * 2009-03-24 2010-10-07 Toshiba Corp Device and method for displaying stereoscopic image
EP2249312A1 (en) * 2009-05-06 2010-11-10 Thomson Licensing Layered-depth generation of images for 3D multiview display devices
US20110099507A1 (en) * 2009-10-28 2011-04-28 Google Inc. Displaying a collection of interactive elements that trigger actions directed to an item
KR20110052124A (en) * 2009-11-12 2011-05-18 삼성전자주식회사 Panorama image generation and inquiry method and mobile terminal using the same
US20110184949A1 (en) * 2010-01-25 2011-07-28 Jiebo Luo Recommending places to visit
JP5483699B2 (en) * 2010-01-29 2014-05-07 京楽産業．株式会社 Game machine, game machine presentation method and program
US20110254835A1 (en) 2010-04-20 2011-10-20 Futurity Ventures LLC System and method for the creation of 3-dimensional images
US8730267B2 (en) * 2010-06-21 2014-05-20 Celsia, Llc Viewpoint change on a display device based on movement of the device
US20120019557A1 (en) 2010-07-22 2012-01-26 Sony Ericsson Mobile Communications Ab Displaying augmented reality information
JP2012094111A (en) * 2010-09-29 2012-05-17 Sony Corp Image processing device, image processing method and program
US8705892B2 (en) * 2010-10-26 2014-04-22 3Ditize Sl Generating three-dimensional virtual tours from two-dimensional images
JP6246991B2 (en) * 2011-06-01 2017-12-13 任天堂株式会社 Information processing program, information processing apparatus, information processing system, and information processing method
JP5750637B2 (en) * 2011-03-08 2015-07-22 オリンパス株式会社 Imaging device
US20120293607A1 (en) * 2011-05-17 2012-11-22 Apple Inc. Panorama Processing
TWI449420B (en) * 2011-05-31 2014-08-11 Nat Applied Res Laboratoires Image searching, capturing system and control method thereof
JP5860634B2 (en) * 2011-08-23 2016-02-16 任天堂株式会社 Information processing system, information processing method, server program, server device, and server system
US20150153933A1 (en) * 2012-03-16 2015-06-04 Google Inc. Navigating Discrete Photos and Panoramas
KR101818778B1 (en) * 2012-03-23 2018-01-16 한국전자통신연구원 Apparatus and method of generating and consuming 3d data format for generation of realized panorama image
US8788587B2 (en) * 2012-06-15 2014-07-22 Be Labs, Llc System, method, and product for capturing memories
US20130346068A1 (en) * 2012-06-25 2013-12-26 Apple Inc. Voice-Based Image Tagging and Searching
US20140046794A1 (en) * 2012-08-07 2014-02-13 Ebay Inc Shopping assistant
US10168882B2 (en) * 2013-06-09 2019-01-01 Apple Inc. Device, method, and graphical user interface for switching between camera interfaces
US10249029B2 (en) * 2013-07-30 2019-04-02 Apple Inc. Reconstruction of missing regions of images
WO2015017865A1 (en) * 2013-08-02 2015-02-05 Shoto, Inc. Discovery and sharing of photos between devices
US20150130799A1 (en) 2013-11-12 2015-05-14 Fyusion, Inc. Analysis and manipulation of images and video for generation of surround views
WO2016004258A1 (en) * 2014-07-03 2016-01-07 Gopro, Inc. Automatic generation of video and directional audio from spherical content
US10275935B2 (en) 2014-10-31 2019-04-30 Fyusion, Inc. System and method for infinite synthetic image generation from multi-directional structured image array
US10719939B2 (en) 2014-10-31 2020-07-21 Fyusion, Inc. Real-time mobile device capture and generation of AR/VR content
US10262426B2 (en) 2014-10-31 2019-04-16 Fyusion, Inc. System and method for infinite smoothing of image sequences
US10176592B2 (en) 2014-10-31 2019-01-08 Fyusion, Inc. Multi-directional structured image array capture on a 2D graph
US10586378B2 (en) 2014-10-31 2020-03-10 Fyusion, Inc. Stabilizing image sequences based on camera rotation and focal length parameters
US10726560B2 (en) 2014-10-31 2020-07-28 Fyusion, Inc. Real-time mobile device capture and generation of art-styled AR/VR content
US10650574B2 (en) 2014-10-31 2020-05-12 Fyusion, Inc. Generating stereoscopic pairs of images from a single lens camera

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060188147A1 (en) * 2005-02-24 2006-08-24 Rai Barinder S Method and apparatus applying digital image filtering to color filter array data
US20100171691A1 (en) * 2007-01-26 2010-07-08 Ralph Cook Viewing images with tilt control on a hand-held device
US20130155180A1 (en) * 2011-12-14 2013-06-20 Microsoft Corporation Parallax compensation
US20130162634A1 (en) * 2011-12-26 2013-06-27 Samsung Electronics Co., Ltd. Image processing method and apparatus using multi-layer representation

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9836873B2 (en) 2013-11-12 2017-12-05 Fyusion, Inc. Analysis and manipulation of panoramic surround views
US10026219B2 (en) 2013-11-12 2018-07-17 Fyusion, Inc. Analysis and manipulation of panoramic surround views
US10169911B2 (en) 2013-11-12 2019-01-01 Fyusion, Inc. Analysis and manipulation of panoramic surround views
US10521954B2 (en) 2013-11-12 2019-12-31 Fyusion, Inc. Analysis and manipulation of panoramic surround views
US10430995B2 (en) 2014-10-31 2019-10-01 Fyusion, Inc. System and method for infinite synthetic image generation from multi-directional structured image array
US10540773B2 (en) 2014-10-31 2020-01-21 Fyusion, Inc. System and method for infinite smoothing of image sequences
US10818029B2 (en) 2014-10-31 2020-10-27 Fyusion, Inc. Multi-directional structured image array capture on a 2D graph
US10846913B2 (en) 2014-10-31 2020-11-24 Fyusion, Inc. System and method for infinite synthetic image generation from multi-directional structured image array
US10852902B2 (en) 2015-07-15 2020-12-01 Fyusion, Inc. Automatic tagging of objects on a multi-view interactive digital media representation of a dynamic entity
US11195314B2 (en) 2015-07-15 2021-12-07 Fyusion, Inc. Artificially rendering images using viewpoint interpolation and extrapolation
US11956412B2 (en) 2015-07-15 2024-04-09 Fyusion, Inc. Drone based capture of multi-view interactive digital media
US11435869B2 (en) 2015-07-15 2022-09-06 Fyusion, Inc. Virtual reality environment based manipulation of multi-layered multi-view interactive digital media representations
US12261990B2 (en) 2015-07-15 2025-03-25 Fyusion, Inc. System and method for generating combined embedded multi-view interactive digital media representations
US11632533B2 (en) 2015-07-15 2023-04-18 Fyusion, Inc. System and method for generating combined embedded multi-view interactive digital media representations
US11636637B2 (en) 2015-07-15 2023-04-25 Fyusion, Inc. Artificially rendering images using viewpoint interpolation and extrapolation
US12020355B2 (en) 2015-07-15 2024-06-25 Fyusion, Inc. Artificially rendering images using viewpoint interpolation and extrapolation
US11776199B2 (en) 2015-07-15 2023-10-03 Fyusion, Inc. Virtual reality environment based manipulation of multi-layered multi-view interactive digital media representations
US11202017B2 (en) 2016-10-06 2021-12-14 Fyusion, Inc. Live style transfer on a mobile device
US11960533B2 (en) 2017-01-18 2024-04-16 Fyusion, Inc. Visual search using multi-view interactive digital media representations
US11876948B2 (en) 2017-05-22 2024-01-16 Fyusion, Inc. Snapshots at predefined intervals or angles
US11776229B2 (en) 2017-06-26 2023-10-03 Fyusion, Inc. Modification of multi-view interactive digital media representation
US11967162B2 (en) 2018-04-26 2024-04-23 Fyusion, Inc. Method and apparatus for 3-D auto tagging
US11488380B2 (en) 2018-04-26 2022-11-01 Fyusion, Inc. Method and apparatus for 3-D auto tagging

Also Published As

Publication number Publication date
CN105849781B (en) 2020-01-17
US10169911B2 (en) 2019-01-01
US20190156559A1 (en) 2019-05-23
US20180330537A1 (en) 2018-11-15
CN105849781A (en) 2016-08-10
US20150130894A1 (en) 2015-05-14
US10521954B2 (en) 2019-12-31
US20150134651A1 (en) 2015-05-14
WO2015073570A3 (en) 2015-10-08
JP2017501516A (en) 2017-01-12
US9836873B2 (en) 2017-12-05
KR20160086868A (en) 2016-07-20
GB201609577D0 (en) 2016-07-13
GB2534821B8 (en) 2018-08-08
US20150339846A1 (en) 2015-11-26
US20150130800A1 (en) 2015-05-14
GB2534821B (en) 2018-07-25
DE112014005165T5 (en) 2016-07-21
US20150138190A1 (en) 2015-05-21
US20150130799A1 (en) 2015-05-14
US10026219B2 (en) 2018-07-17
US20180068485A1 (en) 2018-03-08
WO2015073570A2 (en) 2015-05-21

Similar Documents

Publication Publication Date Title
GB2534821A (en) Analysis and manipulation of objects and layers in surround views
IL276640A (en) Method, system and computer program product for interactively identifying same individuals or objects present in video recordings
IL267052A (en) Systems, methods, and media for displaying interactive augmented reality presentations
WO2016025811A3 (en) Spatial data visualization
MX2018013364A (en) Systems and methods for presenting content.
NZ713292A (en) Campaign optimization for experience content dataset
PH12019500411A1 (en) Method and apparatus for controlled observation point and orientation selection audiovisual content
EP3042272A4 (en) System and method for interactive visual analytics of multi-dimensional temporal data
WO2014134107A3 (en) System and method for multi-user control and media streaming to a shared display
MX351771B (en) Live faces.
GB201415860D0 (en) Systems and methods for recording and recreating interactive user-sessions involving an on-line server
EP3089154A4 (en) Image processing device, image processing method, computer program, and image display system
MX387629B (en) DATA REPRODUCTION METHOD AND DATA REPRODUCTION DEVICE.
EP3149539A4 (en) Methods and systems for generating virtual content display with a virtual or augmented reality apparatus
WO2014037876A3 (en) Augmented reality for video system
EP3077943A4 (en) Methods and systems for analyzing image data
MX2015012834A (en) Mapping augmented reality experience to various environments.
WO2012122172A3 (en) Assessing environmental characteristics in a video stream captured by a mobile device
EP3335774A4 (en) Information processing device and viewing request transmission method
WO2014165392A3 (en) Content presentation based on social recommendations
EP3136717A4 (en) Video display device, video projection device, dynamic illusion presentation device, video generation device, method thereof, data construct, and program
EP3035229A4 (en) Method and system for preventing image captures of the information displayed on a screen, and computer program for same
GB2553693A (en) Virtual reality content presentation including viewpoint transitions to prevent simulator sickness
EP3322192A4 (en) Method for intuitive video content reproduction through data structuring and user interface device therefor
EP2950526A4 (en) Projection type image display device, image processing device and image processing method, and computer program