MX2020013016A - Inyección perfecta de imágenes tridimensionales aumentadas usando una secuencia de vídeo codificada posicionalmente. - Google Patents

Inyección perfecta de imágenes tridimensionales aumentadas usando una secuencia de vídeo codificada posicionalmente.

Info

Publication number
MX2020013016A
MX2020013016A MX2020013016A MX2020013016A MX2020013016A MX 2020013016 A MX2020013016 A MX 2020013016A MX 2020013016 A MX2020013016 A MX 2020013016A MX 2020013016 A MX2020013016 A MX 2020013016A MX 2020013016 A MX2020013016 A MX 2020013016A
Authority
MX
Mexico
Prior art keywords
environment
video frames
augmented
video stream
encoded video
Prior art date
Application number
MX2020013016A
Other languages
English (en)
Inventor
Mario Pintaric
Kyle Thomas Foley
Adrian James Hatch
Original Assignee
Tedtech Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tedtech Inc filed Critical Tedtech Inc
Publication of MX2020013016A publication Critical patent/MX2020013016A/es

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/60—Analysis of geometric attributes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/681—Motion detection
    • H04N23/6812—Motion detection based on additional sensors, e.g. acceleration sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/388—Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Geometry (AREA)
  • Computer Hardware Design (AREA)
  • Human Computer Interaction (AREA)
  • Processing Or Creating Images (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

Se describen métodos, sistemas y aparatos, incluidos programas informáticos codificados en un medio de almacenamiento informático, para un sistema de comunicaciones de telepresencia de múltiples pares. En un aspecto, un método incluye formular una geometría de un ambiente con base en los datos del sensor recopilados del ambiente por al menos un sensor; capturar, con una cámara, una pluralidad de fotogramas de vídeo del ambiente y asociar cada uno de los fotogramas de vídeo capturados con datos de transformación espacial de la cámara dentro de la geometría del entorno; proporcionar los fotogramas de vídeo y los datos de posición de la cámara asociados a un par remoto; componer, por parte del par remoto, los fotogramas de vídeo y los datos de posición de la cámara asociados para generar un compuesto local; y mostrar, en el par remoto, una realidad aumentada tridimensional del ambiente basada en el compuesto local.
MX2020013016A 2018-06-01 2019-05-30 Inyección perfecta de imágenes tridimensionales aumentadas usando una secuencia de vídeo codificada posicionalmente. MX2020013016A (es)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201862679245P 2018-06-01 2018-06-01
US16/042,010 US10380804B1 (en) 2018-06-01 2018-07-23 Seamless injection of augmented three-dimensional imagery using a positionally encoded video stream
PCT/US2019/034593 WO2019232171A1 (en) 2018-06-01 2019-05-30 Seamless injection of augmented three-dimensional imagery using a positionally encoded video stream

Publications (1)

Publication Number Publication Date
MX2020013016A true MX2020013016A (es) 2021-05-12

Family

ID=67543714

Family Applications (1)

Application Number Title Priority Date Filing Date
MX2020013016A MX2020013016A (es) 2018-06-01 2019-05-30 Inyección perfecta de imágenes tridimensionales aumentadas usando una secuencia de vídeo codificada posicionalmente.

Country Status (5)

Country Link
US (2) US10380804B1 (es)
EP (1) EP3803805A4 (es)
CA (1) CA3102253A1 (es)
MX (1) MX2020013016A (es)
WO (1) WO2019232171A1 (es)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3522539A1 (en) * 2018-02-01 2019-08-07 Vrije Universiteit Brussel Method and apparatus for compensating motion for a holographic video stream
CN110989840B (zh) * 2019-12-03 2023-07-25 成都纵横自动化技术股份有限公司 数据处理方法、前端设备、后端设备及地理信息系统
CN111260793B (zh) * 2020-01-10 2020-11-24 中国电子科技集团公司第三十八研究所 面向增强和混合现实的远程虚实高精度匹配定位的方法
US11288877B2 (en) * 2020-01-10 2022-03-29 38th Research Institute, China Electronics Technology Group Corp. Method for matching a virtual scene of a remote scene with a real scene for augmented reality and mixed reality

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7796155B1 (en) 2003-12-19 2010-09-14 Hrl Laboratories, Llc Method and apparatus for real-time group interactive augmented-reality area monitoring, suitable for enhancing the enjoyment of entertainment events
KR101199498B1 (ko) * 2005-03-31 2012-11-09 삼성전자주식회사 카메라 파라미터를 이용한 다시점 영상의 부호화 장치 및생성 장치, 그 방법과, 이를 수행하기 위한 프로그램이기록된 기록 매체
US8477246B2 (en) * 2008-07-11 2013-07-02 The Board Of Trustees Of The Leland Stanford Junior University Systems, methods and devices for augmenting video content
US9824495B2 (en) 2008-09-11 2017-11-21 Apple Inc. Method and system for compositing an augmented reality scene
US8509315B1 (en) * 2008-09-23 2013-08-13 Viasat, Inc. Maintaining synchronization of compressed data and associated metadata
US20100257252A1 (en) * 2009-04-01 2010-10-07 Microsoft Corporation Augmented Reality Cloud Computing
KR20160084502A (ko) * 2011-03-29 2016-07-13 퀄컴 인코포레이티드 로컬 멀티-사용자 협업을 위한 모듈식 모바일 접속된 피코 프로젝터들
US20130249947A1 (en) 2011-08-26 2013-09-26 Reincloud Corporation Communication using augmented reality
US20130083003A1 (en) * 2011-09-30 2013-04-04 Kathryn Stone Perez Personal audio/visual system
US9268406B2 (en) 2011-09-30 2016-02-23 Microsoft Technology Licensing, Llc Virtual spectator experience with a personal audio/visual apparatus
US9128520B2 (en) 2011-09-30 2015-09-08 Microsoft Technology Licensing, Llc Service provision using personal audio/visual system
US20130215229A1 (en) 2012-02-16 2013-08-22 Crytek Gmbh Real-time compositing of live recording-based and computer graphics-based media streams
US10649613B2 (en) 2012-06-07 2020-05-12 Wormhole Labs, Inc. Remote experience interfaces, systems and methods
US9645394B2 (en) 2012-06-25 2017-05-09 Microsoft Technology Licensing, Llc Configured virtual environments
US20140368537A1 (en) 2013-06-18 2014-12-18 Tom G. Salter Shared and private holographic objects
US9779548B2 (en) 2013-06-25 2017-10-03 Jordan Kent Weisman Multiuser augmented reality system
US9940750B2 (en) 2013-06-27 2018-04-10 Help Lighting, Inc. System and method for role negotiation in multi-reality environments
US9761059B2 (en) * 2014-01-03 2017-09-12 Intel Corporation Dynamic augmentation of a physical scene
US10068373B2 (en) * 2014-07-01 2018-09-04 Samsung Electronics Co., Ltd. Electronic device for providing map information
US10962780B2 (en) 2015-10-26 2021-03-30 Microsoft Technology Licensing, Llc Remote rendering for virtual images
US10567449B2 (en) 2016-02-17 2020-02-18 Meta View, Inc. Apparatuses, methods and systems for sharing virtual elements
US20170295229A1 (en) 2016-04-08 2017-10-12 Osterhout Group, Inc. Synchronizing head-worn computers
WO2017177019A1 (en) 2016-04-08 2017-10-12 Pcms Holdings, Inc. System and method for supporting synchronous and asynchronous augmented reality functionalities
US10380800B2 (en) 2016-04-18 2019-08-13 Disney Enterprises, Inc. System and method for linking and interacting between augmented reality and virtual reality environments
US10218793B2 (en) 2016-06-13 2019-02-26 Disney Enterprises, Inc. System and method for rendering views of a virtual space
US10032307B2 (en) * 2016-08-10 2018-07-24 Viacom International Inc. Systems and methods for a generating an interactive 3D environment using virtual depth

Also Published As

Publication number Publication date
US10380804B1 (en) 2019-08-13
CA3102253A1 (en) 2019-12-05
EP3803805A4 (en) 2021-12-15
WO2019232171A1 (en) 2019-12-05
US20190371074A1 (en) 2019-12-05
US10614631B2 (en) 2020-04-07
EP3803805A1 (en) 2021-04-14

Similar Documents

Publication Publication Date Title
MX2020013016A (es) Inyección perfecta de imágenes tridimensionales aumentadas usando una secuencia de vídeo codificada posicionalmente.
WO2018210796A8 (en) Action recognition in videos using 3d spatio-temporal convolutional neural networks
CN107925753B (zh) 利用动态相机进行3d图像捕捉的方法和系统
US9445081B1 (en) Method and system of 3D image capture with dynamic cameras
WO2018201097A3 (en) Video and chart image fusion systems and methods
WO2018083668A8 (en) Scene understanding and generation using neural networks
US10650590B1 (en) Method and system for fully immersive virtual reality
WO2014171987A3 (en) Augmented video system providing enhanced situational awareness
GB2555331A (en) Image processing method
WO2014186420A3 (en) Augmented reality (ar) capture & play
GB2555724A8 (en) General spherical capture methods
WO2020092177A3 (en) Method and apparatus for 3-d auto tagging
WO2008109567A3 (en) System and method for tracking three dimensional objects
EP2629267A3 (en) Real-time compositing of live recording-based and computer graphics-based media streams
WO2014125502A3 (en) Segmenting objects in multimedia data
WO2012062813A3 (en) Recovery of 3d scene structure and camera motion from a video sequence
US20200137376A1 (en) Method for generating a light-field 3d display unit image and a generating device
WO2010116329A3 (en) Method and system for creating three-dimensional viewable video from a single video stream
WO2012033758A3 (en) Video system with intelligent visual display
GB2536822A (en) Motion tracking system
MX2018011498A (es) Metodo, aparato y corriente de formateo de un video inmersivo para dispositivos de entrega de legado e inmersivos.
MY201632A (en) Projection image construction method and device
US20220188973A1 (en) Systems and methods for synthetic augmentation of cameras using neural networks
US9208549B2 (en) Method and apparatus for color transfer between images
US10380077B2 (en) System and method for upload and synchronization of media content to cloud based media services