EP4055524A4 - Arbitrary view generation - Google Patents

Arbitrary view generation Download PDF

Info

Publication number
EP4055524A4
EP4055524A4 EP20883695.7A EP20883695A EP4055524A4 EP 4055524 A4 EP4055524 A4 EP 4055524A4 EP 20883695 A EP20883695 A EP 20883695A EP 4055524 A4 EP4055524 A4 EP 4055524A4
Authority
EP
European Patent Office
Prior art keywords
view generation
arbitrary view
arbitrary
generation
view
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP20883695.7A
Other languages
German (de)
French (fr)
Other versions
EP4055524A1 (en
Inventor
Clarence Chui
Manu Parmar
Amogh Subbakrishna Adishesha
Harshul GUPTA
Avinash Venkata Uppuluri
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Outward Inc
Original Assignee
Outward Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US17/090,794 external-priority patent/US11989821B2/en
Priority claimed from US17/090,793 external-priority patent/US11989820B2/en
Application filed by Outward Inc filed Critical Outward Inc
Publication of EP4055524A1 publication Critical patent/EP4055524A1/en
Publication of EP4055524A4 publication Critical patent/EP4055524A4/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/194—Segmentation; Edge detection involving foreground-background segmentation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/774—Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Computing Systems (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • Medical Informatics (AREA)
  • Health & Medical Sciences (AREA)
  • Databases & Information Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Processing Or Creating Images (AREA)
  • Image Generation (AREA)
  • Image Analysis (AREA)
EP20883695.7A 2019-11-08 2020-11-06 Arbitrary view generation Pending EP4055524A4 (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201962933261P 2019-11-08 2019-11-08
US201962933258P 2019-11-08 2019-11-08
US17/090,794 US11989821B2 (en) 2016-03-25 2020-11-05 Arbitrary view generation
US17/090,793 US11989820B2 (en) 2016-03-25 2020-11-05 Arbitrary view generation
PCT/US2020/059500 WO2021092454A1 (en) 2019-11-08 2020-11-06 Arbitrary view generation

Publications (2)

Publication Number Publication Date
EP4055524A1 EP4055524A1 (en) 2022-09-14
EP4055524A4 true EP4055524A4 (en) 2024-02-21

Family

ID=75848702

Family Applications (2)

Application Number Title Priority Date Filing Date
EP20883695.7A Pending EP4055524A4 (en) 2019-11-08 2020-11-06 Arbitrary view generation
EP20885037.0A Pending EP4055525A4 (en) 2019-11-08 2020-11-06 Arbitrary view generation

Family Applications After (1)

Application Number Title Priority Date Filing Date
EP20885037.0A Pending EP4055525A4 (en) 2019-11-08 2020-11-06 Arbitrary view generation

Country Status (4)

Country Link
EP (2) EP4055524A4 (en)
JP (3) JP7410289B2 (en)
KR (2) KR20220078651A (en)
WO (2) WO2021092454A1 (en)

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1996959A4 (en) * 2006-03-03 2012-02-29 Medic Vision Brain Technologies Ltd System and method of automatic prioritization and analysis of medical images
US8867820B2 (en) * 2009-10-07 2014-10-21 Microsoft Corporation Systems and methods for removing a background of an image
US9177381B2 (en) * 2010-12-22 2015-11-03 Nani Holdings IP, LLC Depth estimate determination, systems and methods
WO2015167739A1 (en) * 2014-04-30 2015-11-05 Replay Technologies Inc. System for and method of generating user-selectable novel views on a viewing device
US10726593B2 (en) * 2015-09-22 2020-07-28 Fyusion, Inc. Artificially rendering images using viewpoint interpolation and extrapolation
GB2532075A (en) * 2014-11-10 2016-05-11 Lego As System and method for toy recognition and detection based on convolutional neural networks
US9996914B2 (en) * 2016-03-25 2018-06-12 Outward, Inc. Arbitrary view generation
KR101980603B1 (en) * 2016-05-20 2019-05-22 구글 엘엘씨 Relating to predicting the motion (s) of the object (s) in the robotic environment based on the image (s) capturing the object (s) and parameter (s) for future robot motion in the environment Methods and apparatus
JP6833348B2 (en) * 2016-05-25 2021-02-24 キヤノン株式会社 Information processing device, image processing system, information processing device control method, virtual viewpoint image generation method, and program
US10387765B2 (en) * 2016-06-23 2019-08-20 Siemens Healthcare Gmbh Image correction using a deep generative machine-learning model
WO2017223560A1 (en) * 2016-06-24 2017-12-28 Rensselaer Polytechnic Institute Tomographic image reconstruction via machine learning
US10846836B2 (en) * 2016-11-14 2020-11-24 Ricoh Company, Ltd. View synthesis using deep convolutional neural networks
WO2018197984A1 (en) * 2017-04-28 2018-11-01 株式会社半導体エネルギー研究所 Display system and mobile body
JPWO2019167453A1 (en) * 2018-02-28 2021-03-18 富士フイルム株式会社 Image processing equipment, image processing methods, and programs

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
CHRISTIAN LEDIG ET AL: "Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network", 15 September 2016 (2016-09-15), XP055383325, Retrieved from the Internet <URL:https://arxiv.org/pdf/1609.04802.pdf> DOI: 10.1109/CVPR.2017.19 *
LEFKIMMIATIS STAMATIOS: "Non-local Color Image Denoising with Convolutional Neural Networks", IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 1 July 2017 (2017-07-01), pages 5882 - 5891, XP093089052, ISBN: 978-1-5386-0457-1, Retrieved from the Internet <URL:https://arxiv.org/pdf/1611.06757.pdf> DOI: 10.1109/CVPR.2017.623 *
See also references of WO2021092454A1 *

Also Published As

Publication number Publication date
EP4055525A4 (en) 2024-02-21
WO2021092454A1 (en) 2021-05-14
EP4055524A1 (en) 2022-09-14
KR20220078651A (en) 2022-06-10
EP4055525A1 (en) 2022-09-14
JP2022553846A (en) 2022-12-26
WO2021092455A1 (en) 2021-05-14
JP2022553845A (en) 2022-12-26
JP7410289B2 (en) 2024-01-09
KR20220074959A (en) 2022-06-03
JP2024079778A (en) 2024-06-11

Similar Documents

Publication Publication Date Title
EP3867745A4 (en) Hyperpiler
EP3833739A4 (en) Akkermansia muciniphila
EP3781482A4 (en) Nano-satellite
EP3723593A4 (en) Reference interval generation
EP3976107A4 (en) Sonosensitization
EP4044942A4 (en) Occlusion-crossing devices
EP3973549A4 (en) Betavoltaic devices
EP3980332A4 (en) Electroaerodynamic devices
EP4003420A4 (en) Il-38-specific antiobodies
EP3818976A4 (en) Structure
EP4055524A4 (en) Arbitrary view generation
EP4055567A4 (en) Arbitrary view generation
EP3883117A4 (en) Vibration-powered generation element
EP4072433A4 (en) Septalcrossingsystem
EP3990820A4 (en) Cryosphere
EP3936266A4 (en) Structure
AU2019904806A0 (en) Fastcast-3
AU2019904733A0 (en) Trolleyon
AU2019904564A0 (en) WaterWords
AU2019904428A0 (en) Tapware
AU2019901722A0 (en) Betavoltaic Devices I
AU2019904116A0 (en) Oct2019ideasin3d
AU2019903707A0 (en) iWasteless
AU2019903699A0 (en) T-Brake
AU2019903571A0 (en) Shandybusta

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20220427

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230605

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Free format text: PREVIOUS MAIN CLASS: G06K0009360000

Ipc: G06T0005500000

RIC1 Information provided on ipc code assigned before grant

Ipc: G06T 5/50 20060101AFI20231009BHEP

A4 Supplementary search report drawn up and despatched

Effective date: 20240123

RIC1 Information provided on ipc code assigned before grant

Ipc: G06T 5/50 20060101AFI20240117BHEP