BR112014011172A2 - sistema e método de operação para veículos operados remotamente com imagem 3d sobreposta - Google Patents

sistema e método de operação para veículos operados remotamente com imagem 3d sobreposta

Info

Publication number
BR112014011172A2
BR112014011172A2 BR112014011172A BR112014011172A BR112014011172A2 BR 112014011172 A2 BR112014011172 A2 BR 112014011172A2 BR 112014011172 A BR112014011172 A BR 112014011172A BR 112014011172 A BR112014011172 A BR 112014011172A BR 112014011172 A2 BR112014011172 A2 BR 112014011172A2
Authority
BR
Brazil
Prior art keywords
overlay
video
image
remotely operated
operated vehicles
Prior art date
Application number
BR112014011172A
Other languages
English (en)
Other versions
BR112014011172B1 (pt
Inventor
Alberto Parente Da Silva Manuel
Original Assignee
Abyssal S A
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Abyssal S A filed Critical Abyssal S A
Publication of BR112014011172A2 publication Critical patent/BR112014011172A2/pt
Publication of BR112014011172B1 publication Critical patent/BR112014011172B1/pt

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/0011—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement
    • G05D1/0038—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/0011—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement
    • G05D1/0044—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement by providing the operator with a computer generated representation of the environment of the vehicle, e.g. virtual reality, maps
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/50—Lighting effects
    • G06T15/503—Blending, e.g. for anti-aliasing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/60—Analysis of geometric attributes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/62—Semi-transparency

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Theoretical Computer Science (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • General Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Computer Graphics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Geometry (AREA)
  • Signal Processing (AREA)
  • Instructional Devices (AREA)
  • Processing Or Creating Images (AREA)
  • Navigation (AREA)
  • Closed-Circuit Television Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Selective Calling Equipment (AREA)

Abstract

resumo "sistema e método de operação para veículos operados remotamente com imagem 3d sobreposta" a presente invenção se refere a um sistema e método de utilização de imagem 3d sobreposta para veículos operados remotamente, a saber 3d, imagens reconstruídas do ambiente do rov. em outro aspecto, esta invenção inclui gerar um vídeo virtual de elementos 3d no ambiente de operação, sincronizar o ângulo e posição da câmera de um vídeo virtual com o ângulo e posição de uma câmera real, sobrepor o vídeo virtual e o vídeo real a partir da câmera real; sobrepor esses alimentadores de vídeo de maneira que um seja manipulado para mostrar transparências em áreas de menos interesse, para mostrar através do outro vídeo. a presente invenção pode também incluir sobreposição de informação, seja gráfica, textual ou ambas na imagem 3d híbrida virtual-real. a presente invenção está também em rede, de maneira que a interface visual de imersão descrita acima é acessível a uma pluralidade de usuários que operam a partir de uma pluralidade de locais.
BR112014011172-3A 2011-11-09 2012-11-08 Sistema e método de operação para veículos operados remotamente com imagem 3d sobreposta BR112014011172B1 (pt)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
PTPPP105989 2011-11-09
PT10598911 2011-11-09
US201261681411P 2012-08-09 2012-08-09
US61/681,411 2012-08-09
PCT/IB2012/002281 WO2013068821A2 (en) 2011-11-09 2012-11-08 System and method of operation for remotely operated vehicles with superimposed 3d imagery

Publications (2)

Publication Number Publication Date
BR112014011172A2 true BR112014011172A2 (pt) 2017-05-09
BR112014011172B1 BR112014011172B1 (pt) 2021-07-27

Family

ID=48290705

Family Applications (1)

Application Number Title Priority Date Filing Date
BR112014011172-3A BR112014011172B1 (pt) 2011-11-09 2012-11-08 Sistema e método de operação para veículos operados remotamente com imagem 3d sobreposta

Country Status (10)

Country Link
US (3) US9195231B2 (pt)
EP (1) EP2777024B1 (pt)
AU (3) AU2012335330B2 (pt)
BR (1) BR112014011172B1 (pt)
CA (1) CA2854595C (pt)
ES (1) ES2895454T3 (pt)
HR (1) HRP20211664T1 (pt)
PT (1) PT2777024T (pt)
SG (1) SG11201402114PA (pt)
WO (1) WO2013068821A2 (pt)

Families Citing this family (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9123241B2 (en) 2008-03-17 2015-09-01 International Business Machines Corporation Guided video feed selection in a vehicle-to-vehicle network
US9043483B2 (en) 2008-03-17 2015-05-26 International Business Machines Corporation View selection in a vehicle-to-vehicle network
CA2854595C (en) * 2011-11-09 2022-04-26 Abyssal S.A. System and method of operation for remotely operated vehicles with superimposed 3d imagery
US9754507B1 (en) * 2013-07-02 2017-09-05 Rockwell Collins, Inc. Virtual/live hybrid behavior to mitigate range and behavior constraints
WO2016073060A2 (en) * 2014-09-02 2016-05-12 Flir Systems, Inc. Augmented reality sonar imagery systems and methods
GB201405527D0 (en) * 2014-03-27 2014-05-14 Mill Facility The Ltd A driveable vehicle unit
DE102014107211A1 (de) * 2014-05-22 2015-11-26 Atlas Elektronik Gmbh Vorrichtung zum Anzeigen einer virtuellen Realität sowie Messgerät
US10802141B2 (en) 2014-05-30 2020-10-13 FLIR Belgium BVBA Water temperature overlay systems and methods
US10444349B2 (en) 2014-09-02 2019-10-15 FLIR Belgium BVBA Waypoint sharing systems and methods
US11181637B2 (en) 2014-09-02 2021-11-23 FLIR Belgium BVBA Three dimensional target selection systems and methods
NL2013804B1 (en) * 2014-11-14 2016-10-07 Fugro Subsea Services Ltd A method of controlling a subsea platform, a system and a computer program product.
US9784832B2 (en) 2015-03-05 2017-10-10 Navico Holding As Systems and associated methods for producing a 3D sonar image
JP6317854B2 (ja) * 2015-03-30 2018-04-25 株式会社カプコン 仮想三次元空間生成方法、映像システム、その制御方法およびコンピュータ装置での読み取りが可能な記録媒体
FR3037429B1 (fr) * 2015-06-15 2018-09-07 Donecle Systeme et procede d'inspection automatique de surface
US20170094227A1 (en) * 2015-09-25 2017-03-30 Northrop Grumman Systems Corporation Three-dimensional spatial-awareness vision system
CA2948761A1 (en) * 2015-11-23 2017-05-23 Wal-Mart Stores, Inc. Virtual training system
CN105679169A (zh) * 2015-12-31 2016-06-15 中国神华能源股份有限公司 一种铁路电子沙盘系统
EP3475778A4 (en) 2016-06-28 2019-12-18 Cognata Ltd. CREATION AND SIMULATION OF A REALISTIC 3D VIRTUAL WORLD FOR DRIVING SELF-CONDUCTIVE SYSTEMS
GB2557572B (en) * 2016-09-20 2020-02-12 Subsea 7 Ltd Performing remote inspection at subsea locations
IL251189A0 (en) 2017-03-15 2017-06-29 Ophir Yoav Gradual transition between two-dimensional and three-dimensional augmented reality simulations
WO2019017919A1 (en) * 2017-07-18 2019-01-24 Bechtel Oil, Gas & Chemicals, Inc. PRIMARY NAVIGATION SYSTEM FOR TRAILER WITH OBSTRUCTED PILOT VIEW
GB2565101A (en) * 2017-08-01 2019-02-06 Lobster Pictures Ltd Method for integrating photographic images and BIM data
US11934187B2 (en) * 2017-12-01 2024-03-19 Onesubsea Ip Uk Limited Systems and methods of pilot assist for subsea vehicles
US11010975B1 (en) 2018-03-06 2021-05-18 Velan Studios, Inc. Remote camera augmented reality system
US11436807B2 (en) 2018-08-08 2022-09-06 Abyssal S.A. System and method of operation for remotely operated vehicles with improved position estimation
WO2020030951A1 (en) 2018-08-08 2020-02-13 Abyssal S.A. System and method of operation for remotely operated vehicles for simultaneous localization and mapping
SG11202100945WA (en) * 2018-08-08 2021-02-25 Abyssal S A System and method of operation for remotely operated vehicles leveraging synthetic data to train machine learning models
US11475551B2 (en) 2018-08-08 2022-10-18 Abyssal S.A. System and method of operation for remotely operated vehicles for automatic detection of structure integrity threats
GB2578592B (en) * 2018-10-31 2023-07-05 Sony Interactive Entertainment Inc Apparatus and method of video playback
EP3712558A1 (en) * 2019-03-21 2020-09-23 Rovco Limited Surveying system for surveying in harsh environments
US11228737B2 (en) * 2019-07-31 2022-01-18 Ricoh Company, Ltd. Output control apparatus, display terminal, remote control system, control method, and non-transitory computer-readable medium
EP4042251A4 (en) * 2019-10-07 2023-11-01 OneSubsea IP UK Limited UNDERWATER VEHICLE CONTROL SYSTEM
GB2598345B (en) * 2020-08-27 2023-04-19 Extend Robotics Ltd Remote operation of robotic systems
CN113500601B (zh) * 2021-07-21 2022-11-22 上海原圈网络科技有限公司 一种机器人运动控制方法和系统
US11948257B2 (en) * 2022-05-09 2024-04-02 Rovi Guides, Inc. Systems and methods for augmented reality video generation

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5412569A (en) 1994-03-29 1995-05-02 General Electric Company Augmented reality maintenance system with archive and comparison device
US5706195A (en) * 1995-09-05 1998-01-06 General Electric Company Augmented reality maintenance system for multiple rovs
AU6912798A (en) * 1997-06-10 1998-12-30 Lg. Philips Lcd Co., Ltd. Liquid crystal display with wide viewing angle and method for making it
JPH11139390A (ja) 1997-11-10 1999-05-25 Ishikawajima Harima Heavy Ind Co Ltd 水中物体探索装置
US6330356B1 (en) 1999-09-29 2001-12-11 Rockwell Science Center Llc Dynamic visual registration of a 3-D object with a graphical model
EP2363774B1 (en) 2000-05-01 2017-06-21 iRobot Corporation Method and system for remote control of mobile robot
US8015507B2 (en) 2001-11-05 2011-09-06 H2Eye (International) Limited Graphical user interface for a remote operated vehicle
US7071970B2 (en) * 2003-03-10 2006-07-04 Charles Benton Video augmented orientation sensor
US7292257B2 (en) * 2004-06-28 2007-11-06 Microsoft Corporation Interactive viewpoint video system and process
KR101424942B1 (ko) 2004-07-30 2014-08-01 익스트림 리얼리티 엘티디. 이미지 프로세싱을 기반으로 한 3ｄ 공간 차원용 시스템 및 방법
US8423292B2 (en) * 2008-08-19 2013-04-16 Tomtom International B.V. Navigation device with camera-info
US8577538B2 (en) * 2006-07-14 2013-11-05 Irobot Corporation Method and system for controlling a remote vehicle
US7352292B2 (en) 2006-01-20 2008-04-01 Keith Alter Real-time, three-dimensional synthetic vision display of sensor-validated terrain data
US7693617B2 (en) * 2006-09-19 2010-04-06 The Boeing Company Aircraft precision approach control
US8301318B2 (en) * 2008-03-05 2012-10-30 Robotic Research Llc Robotic vehicle remote control system having a virtual operator environment
US20100091036A1 (en) * 2008-10-10 2010-04-15 Honeywell International Inc. Method and System for Integrating Virtual Entities Within Live Video
GB2464985A (en) 2008-11-03 2010-05-05 Wireless Fibre Systems Ltd Underwater Vehicle Guidance
FR2949167B1 (fr) * 2009-08-11 2016-07-01 Alain Dinis Systeme et methode de plongee virtuelle en temps reel
US20110153189A1 (en) 2009-12-17 2011-06-23 Garmin Ltd. Historical traffic data compression
US8725273B2 (en) 2010-02-17 2014-05-13 Irobot Corporation Situational awareness for teleoperation of a remote vehicle
CA2854595C (en) * 2011-11-09 2022-04-26 Abyssal S.A. System and method of operation for remotely operated vehicles with superimposed 3d imagery

Also Published As

Publication number Publication date
US20140316611A1 (en) 2014-10-23
AU2019264604B2 (en) 2020-05-21
AU2019264604A1 (en) 2019-12-05
SG11201402114PA (en) 2014-06-27
CA2854595C (en) 2022-04-26
EP2777024B1 (en) 2021-08-04
WO2013068821A3 (en) 2014-04-24
AU2017236009B2 (en) 2019-08-22
CA2854595A1 (en) 2013-05-16
AU2017236009A1 (en) 2017-10-26
BR112014011172B1 (pt) 2021-07-27
AU2012335330B2 (en) 2017-07-20
US20170323487A1 (en) 2017-11-09
AU2012335330A1 (en) 2014-06-05
ES2895454T3 (es) 2022-02-21
PT2777024T (pt) 2021-11-08
US20160063768A1 (en) 2016-03-03
US9741173B2 (en) 2017-08-22
EP2777024A2 (en) 2014-09-17
WO2013068821A2 (en) 2013-05-16
US9195231B2 (en) 2015-11-24
US10424119B2 (en) 2019-09-24
HRP20211664T1 (hr) 2022-02-18

Similar Documents

Publication Publication Date Title
BR112014011172A2 (pt) sistema e método de operação para veículos operados remotamente com imagem 3d sobreposta
EP2629267A3 (en) Real-time compositing of live recording-based and computer graphics-based media streams
BR112014015375A8 (pt) aparelho de processamento de imagem, sistema de exibição de imagem e método e programa de processamento de imagem
BRPI0924288A2 (pt) sistemas e métodos para simular interacções virtuais tridimensionais a partir de imagens bidimensionais de câmara
EP3318945A3 (en) Virtual reality and augmented reality for industrial automation
EP3318944A3 (en) Virtual reality and augmented reality for industrial automation
WO2013093761A3 (en) Overlay and motion compensation of structures from volumetric modalities onto video of an uncalibrated endoscope
JP2009237878A5 (pt)
BR112015005258A2 (pt) sistema de processamento de imagem, método de processamento de imagem e programa
BR112012033392A2 (pt) disposição de imagem em 2d
BRPI0924523B8 (pt) método e sistema para gerar sequências de vídeos em primeira pessoa, e, método para simular movimento de uma câmera virtual em um ambiente virtual
BR112014012955A2 (pt) sistema de planejamento, sistema tendo portas de visualização acopladas operatoriamente, método para o planejamento de um procedimento, e, método para o acoplamento operacional de portas de visualização
BR112015005543A2 (pt) Sistema e método para gerar um resumo de atividades de uma pessoa
BR112014010848A8 (pt) sistema e método para permitir a anotação interativa de uma imagem, estação de trabalho, aparelho gerador de imagens, e, produto de programa de computador
BR112014005616A2 (pt) aparelho de aquisição de imagem por raios x de braço em c para processar uma imagem de projeção 2d obtida de uma estrutura tubular; método assistido por computador para processar uma imagem de projeção 2d obtida por meio de um aparelho de aquisição de imagem por raios x de braço em c; sistema de aquisição de imagem por raios x médica para processar uma imagem de projeção 2d obtida de uma estrutura tubular; elemento de programa de computador para controlar um aparelho; e meio legível por computador
WO2011029209A3 (en) Method and apparatus for generating and processing depth-enhanced images
WO2011108827A3 (ko) 증강현실의 포인팅 장치
WO2012112401A3 (en) Providing an interactive experience using a 3d depth camera and a 3d projector
WO2009122213A3 (en) Storyboard generation method and system
BR112019005855A2 (pt) aparelho de processamento de imagens, sistema de processamento de imagens, e método para fornecer uma imagem
BR112013022668A2 (pt) aparelho e método para gerar uma imagem, e, mídia de gravação
BR112015022240A2 (pt) método e aparelho para o ensino de movimento repetitivo cinestésico
MX341801B (es) Sistema para la filmacion de una pelicula de video.
BR112015008141A2 (pt) Sistema de distribuição de imagens auto- estereoscópicas
BR112016004275A2 (pt) sistema de diagnóstico de tempo de vida de cabo de elevador

Legal Events

Date Code Title Description
B06F Objections, documents and/or translations needed after an examination request according [chapter 6.6 patent gazette]
B06U Preliminary requirement: requests with searches performed by other patent offices: procedure suspended [chapter 6.21 patent gazette]
B09A Decision: intention to grant [chapter 9.1 patent gazette]
B09W Correction of the decision to grant [chapter 9.1.4 patent gazette]

Free format text: O PRESENTE PEDIDO TEVE UM PARECER DE DEFERIMENTO NOTIFICADO NA RPI NO 2630 DE01/06/2021. ATRAVES DA MENSAGEM FALE CONOSCO 936994, A REQUERENTE SOLICITA CORRIGIR ERROS DETRADUCAO NO QUADRO REIVINDICATORIO DA PETICAO DE DEFERIMENTO. AS CORRECOES QUE DEVERAOCOMPOR A CARTA-PATENTE SAO APRESENTADAS NA PETICAO 870210053585 DE 15/06/2021. DIANTEDISTO, CONCLUO PELA RETIFICACAO DO PARECER DE DEFERIMENTO, DEVENDO INTEGRAR A CARTA PATENTEOS DOCUMENTOS QUE CONSTAM NO QUADRO 1 DESTE PARECER.

B350 Update of information on the portal [chapter 15.35 patent gazette]
B16A Patent or certificate of addition of invention granted [chapter 16.1 patent gazette]

Free format text: PRAZO DE VALIDADE: 20 (VINTE) ANOS CONTADOS A PARTIR DE 08/11/2012, OBSERVADAS AS CONDICOES LEGAIS.