EP3881163A4 - Automatische räumliche indexierung von bildern zu video - Google Patents

Automatische räumliche indexierung von bildern zu video Download PDF

Info

Publication number
EP3881163A4
EP3881163A4 EP19884142.1A EP19884142A EP3881163A4 EP 3881163 A4 EP3881163 A4 EP 3881163A4 EP 19884142 A EP19884142 A EP 19884142A EP 3881163 A4 EP3881163 A4 EP 3881163A4
Authority
EP
European Patent Office
Prior art keywords
images
video
spatial indexing
automated spatial
automated
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP19884142.1A
Other languages
English (en)
French (fr)
Other versions
EP3881163A1 (de
Inventor
Michael Ben Fleischman
Philip DECAMP
Jeevan James Kalanithi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Open Space Labs Inc
Original Assignee
Open Space Labs Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Open Space Labs Inc filed Critical Open Space Labs Inc
Publication of EP3881163A1 publication Critical patent/EP3881163A1/de
Publication of EP3881163A4 publication Critical patent/EP3881163A4/de
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/10—Terrestrial scenes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/003—Navigation within 3D models or images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
    • H04N13/279—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals the virtual viewpoint locations being selected by the viewers or determined by tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/62—Control of parameters via user interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/04—Architectural design, interior design
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/004—Annotating, labelling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/024—Multi-user, collaborative environment
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/44—Event detection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/10—Recognition assisted with metadata
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
    • H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Medical Informatics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Databases & Information Systems (AREA)
  • Computing Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Geometry (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Image Analysis (AREA)
  • Processing Or Creating Images (AREA)
EP19884142.1A 2018-11-12 2019-11-11 Automatische räumliche indexierung von bildern zu video Pending EP3881163A4 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201862759945P 2018-11-12 2018-11-12
PCT/US2019/060784 WO2020102107A1 (en) 2018-11-12 2019-11-11 Automated spatial indexing of images to video

Publications (2)

Publication Number Publication Date
EP3881163A1 EP3881163A1 (de) 2021-09-22
EP3881163A4 true EP3881163A4 (de) 2022-08-03

Family

ID=70550346

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19884142.1A Pending EP3881163A4 (de) 2018-11-12 2019-11-11 Automatische räumliche indexierung von bildern zu video

Country Status (4)

Country Link
US (4) US10944959B2 (de)
EP (1) EP3881163A4 (de)
CN (1) CN113424131A (de)
WO (1) WO2020102107A1 (de)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019006189A1 (en) 2017-06-29 2019-01-03 Open Space Labs, Inc. AUTOMATED SPACE INDEXING OF IMAGES BASED ON MASS PLAN CHARACTERISTICS
EP3881163A4 (de) 2018-11-12 2022-08-03 Open Space Labs, Inc. Automatische räumliche indexierung von bildern zu video
US10922831B2 (en) * 2019-02-20 2021-02-16 Dell Products, L.P. Systems and methods for handling multiple simultaneous localization and mapping (SLAM) sources and algorithms in virtual, augmented, and mixed reality (xR) applications
CN112013844B (zh) * 2019-05-31 2022-02-11 北京小米智能科技有限公司 建立室内环境地图的方法及装置
US11405543B2 (en) * 2019-09-14 2022-08-02 Constru Ltd Exploring construction site images by construction stages
CN113747113A (zh) * 2020-05-29 2021-12-03 北京小米移动软件有限公司 图像显示方法及装置、电子设备、计算机可读存储介质
US11436812B2 (en) * 2020-05-29 2022-09-06 Open Space Labs, Inc. Machine learning based object identification using scaled diagram and three-dimensional model
KR102300570B1 (ko) * 2020-07-31 2021-09-09 주식회사 쓰리아이 전방위 이미지 촬영 어셈블리 및 이에 의해 수행되는 방법
CN113810943A (zh) * 2021-09-09 2021-12-17 国网信息通信产业集团有限公司北京分公司 智能视觉检测系统及方法

Family Cites Families (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6097393A (en) 1996-09-03 2000-08-01 The Takshele Corporation Computer-executed, three-dimensional graphical resource management process and system
US8207964B1 (en) 2008-02-22 2012-06-26 Meadow William D Methods and apparatus for generating three-dimensional image data models
US7860301B2 (en) 2005-02-11 2010-12-28 Macdonald Dettwiler And Associates Inc. 3D imaging system
US7639943B1 (en) * 2005-11-15 2009-12-29 Kalajan Kevin E Computer-implemented system and method for automated image uploading and sharing from camera-enabled mobile devices
US8160400B2 (en) 2005-11-17 2012-04-17 Microsoft Corporation Navigating images using image based geometric alignment and object based controls
CN101055494B (zh) 2006-04-13 2011-03-16 上海虚拟谷数码科技有限公司 基于空间索引立方体全景视频的虚拟场景漫游方法及其系统
US8611673B2 (en) 2006-09-14 2013-12-17 Parham Aarabi Method, system and computer program for interactive spatial link-based image searching, sorting and/or displaying
US8542872B2 (en) 2007-07-03 2013-09-24 Pivotal Vision, Llc Motion-validating remote monitoring system
US8270767B2 (en) 2008-04-16 2012-09-18 Johnson Controls Technology Company Systems and methods for providing immersive displays of video camera information from a plurality of cameras
US9870629B2 (en) 2008-06-20 2018-01-16 New Bis Safe Luxco S.À R.L Methods, apparatus and systems for data visualization and related applications
US20130300740A1 (en) 2010-09-13 2013-11-14 Alt Software (Us) Llc System and Method for Displaying Data Having Spatial Coordinates
US8711206B2 (en) 2011-01-31 2014-04-29 Microsoft Corporation Mobile camera localization using depth maps
WO2013126784A2 (en) * 2012-02-23 2013-08-29 Huston Charles D System and method for creating an environment and for sharing a location based experience in an environment
US9324190B2 (en) 2012-02-24 2016-04-26 Matterport, Inc. Capturing and aligning three-dimensional scenes
US11282287B2 (en) * 2012-02-24 2022-03-22 Matterport, Inc. Employing three-dimensional (3D) data predicted from two-dimensional (2D) images using neural networks for 3D modeling applications and other applications
US20130222583A1 (en) 2012-02-28 2013-08-29 Research In Motion Limited System and Method for Obtaining Images from External Cameras Using a Mobile Device
US10139985B2 (en) 2012-06-22 2018-11-27 Matterport, Inc. Defining, displaying and interacting with tags in a three-dimensional model
US8705893B1 (en) 2013-03-14 2014-04-22 Palo Alto Research Center Incorporated Apparatus and method for creating floor plans
US9721046B2 (en) 2013-03-15 2017-08-01 Aditazz, Inc. System and method for realizing a building system that involves computer based matching of form to function
US9888215B2 (en) 2013-04-26 2018-02-06 University Of Washington Indoor scene capture system
US10127721B2 (en) 2013-07-25 2018-11-13 Hover Inc. Method and system for displaying and navigating an optimal multi-dimensional building model
EP3042358A2 (de) 2013-09-03 2016-07-13 3ditize SL Erzeugung einer interaktiven immersiven 3d-erfahrung aus einem statischen 2d-bild
KR102059311B1 (ko) 2013-12-19 2019-12-24 애플 인크. 모바일 디바이스에서의 slam
US10002640B2 (en) 2014-02-28 2018-06-19 Microsoft Technology Licensing, Llc Hyper-lapse video through time-lapse and stabilization
US9613298B2 (en) 2014-06-02 2017-04-04 Microsoft Technology Licensing, Llc Tracking using sensor data
WO2016019390A1 (en) 2014-08-01 2016-02-04 Locuslabs Ip Image-based object location system and process
WO2016077798A1 (en) 2014-11-16 2016-05-19 Eonite Perception Inc. Systems and methods for augmented reality preparation, processing, and application
CN107667366B (zh) 2015-03-24 2021-12-28 开利公司 用于捕获和分析多维建筑物信息的系统和方法
JP6350374B2 (ja) 2015-04-17 2018-07-04 トヨタ自動車株式会社 路面検出装置
CN107646126B (zh) 2015-07-16 2020-12-08 谷歌有限责任公司 用于移动设备的相机姿态估计
US9445081B1 (en) 2015-09-25 2016-09-13 Intel Corporation Method and system of 3D image capture with dynamic cameras
US10395435B2 (en) * 2016-04-04 2019-08-27 Occipital, Inc. System for multimedia spatial annotation, visualization, and recommendation
US10163271B1 (en) 2016-04-04 2018-12-25 Occipital, Inc. System for multimedia spatial annotation, visualization, and recommendation
US10030979B2 (en) 2016-07-29 2018-07-24 Matterport, Inc. Determining and/or generating a navigation path through a captured three-dimensional model rendered on a device
US10769438B2 (en) * 2017-05-23 2020-09-08 Samsung Electronics Company, Ltd. Augmented reality
WO2019006189A1 (en) * 2017-06-29 2019-01-03 Open Space Labs, Inc. AUTOMATED SPACE INDEXING OF IMAGES BASED ON MASS PLAN CHARACTERISTICS
EP3881163A4 (de) * 2018-11-12 2022-08-03 Open Space Labs, Inc. Automatische räumliche indexierung von bildern zu video

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
LUKOSCH STEPHAN ET AL: "Providing Information on the Spot: Using Augmented Reality for Situational Awareness in the Security Domain", COMPUTER SUPPORTER COOPERATIVE WORK, DORDRECHT, NL, vol. 24, no. 6, 6 October 2015 (2015-10-06), pages 613 - 664, XP035732259, ISSN: 0925-9724, [retrieved on 20151006], DOI: 10.1007/S10606-015-9235-4 *

Also Published As

Publication number Publication date
US11995885B2 (en) 2024-05-28
US11638001B2 (en) 2023-04-25
US20230222784A1 (en) 2023-07-13
EP3881163A1 (de) 2021-09-22
US11178386B2 (en) 2021-11-16
CN113424131A (zh) 2021-09-21
US20200154095A1 (en) 2020-05-14
US20220070437A1 (en) 2022-03-03
US10944959B2 (en) 2021-03-09
US20210136348A1 (en) 2021-05-06
WO2020102107A1 (en) 2020-05-22

Similar Documents

Publication Publication Date Title
EP3881163A4 (de) Automatische räumliche indexierung von bildern zu video
EP3646583A4 (de) Automatisierte räumliche indexierung von bildern auf der basis von grundrissmerkmalen
SG11202101439VA (en) Video image processing
SG10201604361SA (en) Video camera scene translation
EP3400113A4 (de) Roboter zur automatisierten bilderfassung
EP3369073A4 (de) Videobilderzeugung eines gebiets von interesse mit verwendung von vernetzten kameras
EP3198862A4 (de) Bildzusammenfügung für dreidimensionales video
EP3479259A4 (de) Video-erfassungsrahmen für visuelle suchplattform
EP3317576A4 (de) Kardanische aufhängung für bilderfassung
EP3304914A4 (de) Codierung eines pixels einer eingangsvideosequenz
EP3198853A4 (de) Bildzusammensetzung mit hochdynamischem bereich unter verwendung mehrerer bilder
EP3726119A4 (de) Videokamera
EP3682421A4 (de) Mit echtzeitverfolgung kompensierte bildeffekte
PL3721623T3 (pl) Deblokowanie granic obrazu wideo
AU201612508S (en) Video camera
GB2568326B (en) Video image processing
EP3490239A4 (de) Sphäroidische videokamera
EP3445032A4 (de) Videokamera
EP3337167A4 (de) Kamera und überwachungssysteme zur videoüberwachung
EP3414916A4 (de) Verwendung eines bildabgleichssystems zur verbesserung der dienstqualität in einem videoabgleichssystem
EP3568832A4 (de) Hinzufügen von bewegungseffekten zu digitalen standbildern
EP3734963A4 (de) Mehrkopfkamera
EP3241131A4 (de) Bilder für abfrageergebnisse
GB201507348D0 (en) Digital video camera
EP3288446A4 (de) Neurotherapeutisches videospiel zur verbesserung der räumlich-zeitlichen kognition

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210608

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20220705

RIC1 Information provided on ipc code assigned before grant

Ipc: G06V 20/20 20220101ALI20220629BHEP

Ipc: G06V 20/64 20220101ALI20220629BHEP

Ipc: G06V 20/10 20220101ALI20220629BHEP

Ipc: G06V 10/70 20220101ALI20220629BHEP

Ipc: G06K 9/62 20060101ALI20220629BHEP

Ipc: H04N 7/18 20060101ALI20220629BHEP

Ipc: G09G 5/00 20060101ALI20220629BHEP

Ipc: G06F 3/00 20060101AFI20220629BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20240417