CN106716490B - 用于视频译码的同时定位与地图构建 - Google Patents

用于视频译码的同时定位与地图构建 Download PDF

Info

Publication number
CN106716490B
CN106716490B CN201580047818.1A CN201580047818A CN106716490B CN 106716490 B CN106716490 B CN 106716490B CN 201580047818 A CN201580047818 A CN 201580047818A CN 106716490 B CN106716490 B CN 106716490B
Authority
CN
China
Prior art keywords
image
composite image
scene structure
current
structure map
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201580047818.1A
Other languages
English (en)
Chinese (zh)
Other versions
CN106716490A (zh
Inventor
菲利普·格拉斯米格
迪特尔·施马尔施蒂格
格哈德·赖特迈尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of CN106716490A publication Critical patent/CN106716490A/zh
Application granted granted Critical
Publication of CN106716490B publication Critical patent/CN106716490B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
    • H04N19/27—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding involving both synthetic and natural picture components, e.g. synthetic natural hybrid coding [SNHC]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • G06T9/001—Model-based coding, e.g. wire frame
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
    • H04N19/23—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding with coding of regions that are present throughout a whole video segment, e.g. sprites, background or mosaic
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
CN201580047818.1A 2014-09-09 2015-09-04 用于视频译码的同时定位与地图构建 Expired - Fee Related CN106716490B (zh)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201462048041P 2014-09-09 2014-09-09
US62/048,041 2014-09-09
US14/845,076 US10484697B2 (en) 2014-09-09 2015-09-03 Simultaneous localization and mapping for video coding
US14/845,076 2015-09-03
PCT/US2015/048569 WO2016040161A1 (en) 2014-09-09 2015-09-04 Simultaneous localization and mapping for video coding

Publications (2)

Publication Number Publication Date
CN106716490A CN106716490A (zh) 2017-05-24
CN106716490B true CN106716490B (zh) 2020-03-13

Family

ID=55438749

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201580047818.1A Expired - Fee Related CN106716490B (zh) 2014-09-09 2015-09-04 用于视频译码的同时定位与地图构建

Country Status (6)

Country Link
US (1) US10484697B2 (enExample)
EP (1) EP3192055A1 (enExample)
JP (1) JP2017530626A (enExample)
KR (1) KR102126610B1 (enExample)
CN (1) CN106716490B (enExample)
WO (1) WO2016040161A1 (enExample)

Families Citing this family (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014082541A (ja) * 2012-10-12 2014-05-08 National Institute Of Information & Communication Technology 互いに類似した情報を含む複数画像のデータサイズを低減する方法、プログラムおよび装置
KR102623680B1 (ko) 2015-02-10 2024-01-12 모빌아이 비젼 테크놀로지스 엘티디. 자율 주행을 위한 약도
US20160241838A1 (en) * 2015-02-17 2016-08-18 Nextvr Inc. Methods and apparatus for generating and using reduced resolution images and/or communicating such images to a playback or content distribution device
US10362290B2 (en) 2015-02-17 2019-07-23 Nextvr Inc. Methods and apparatus for processing content based on viewing information and/or communicating content
US10243604B2 (en) * 2015-12-08 2019-03-26 Uber Technologies, Inc. Autonomous vehicle mesh networking configuration
US9603158B1 (en) 2015-12-08 2017-03-21 Uber Technologies, Inc. Optimizing communication for automated vehicles
US9432929B1 (en) 2015-12-08 2016-08-30 Uber Technologies, Inc. Communication configuration system for a fleet of automated vehicles
US9557183B1 (en) 2015-12-08 2017-01-31 Uber Technologies, Inc. Backend system for route planning of autonomous vehicles
US10050760B2 (en) 2015-12-08 2018-08-14 Uber Technologies, Inc. Backend communications system for a fleet of autonomous vehicles
US10036642B2 (en) 2015-12-08 2018-07-31 Uber Technologies, Inc. Automated vehicle communications system
US9969326B2 (en) 2016-02-22 2018-05-15 Uber Technologies, Inc. Intention signaling for an autonomous vehicle
US9902311B2 (en) 2016-02-22 2018-02-27 Uber Technologies, Inc. Lighting device for a vehicle
US11228754B2 (en) 2016-05-06 2022-01-18 Qualcomm Incorporated Hybrid graphics and pixel domain architecture for 360 degree video
CN116777994A (zh) 2016-06-30 2023-09-19 奇跃公司 估计3d空间中的姿态
US10558222B2 (en) 2016-07-21 2020-02-11 Mobileye Vision Technologies Ltd. Navigating a vehicle using a crowdsourced sparse map
WO2018025660A1 (ja) * 2016-08-05 2018-02-08 ソニー株式会社 画像処理装置および画像処理方法
US10699466B2 (en) * 2016-12-06 2020-06-30 Koninklijke Philips N.V. Apparatus and method for generating a light intensity image
US10293818B2 (en) 2017-03-07 2019-05-21 Uber Technologies, Inc. Teleassistance data prioritization for self-driving vehicles
US10202126B2 (en) 2017-03-07 2019-02-12 Uber Technologies, Inc. Teleassistance data encoding for self-driving vehicles
US11031113B1 (en) 2017-06-16 2021-06-08 Walgreen Co. Technology for processing prescription medications for pickup by individuals
US11328801B1 (en) 2017-06-16 2022-05-10 Walgreen Co. Technology for managing priorities for on-site prescription pickup
EP3419286A1 (en) * 2017-06-23 2018-12-26 Koninklijke Philips N.V. Processing of 3d image information based on texture maps and meshes
GB2563895B (en) * 2017-06-29 2019-09-18 Sony Interactive Entertainment Inc Video generation method and apparatus
US10493622B2 (en) 2017-07-14 2019-12-03 Uatc, Llc Systems and methods for communicating future vehicle actions to be performed by an autonomous vehicle
US10779011B2 (en) 2017-07-31 2020-09-15 Qualcomm Incorporated Error concealment in virtual reality system
EP3496388A1 (en) * 2017-12-05 2019-06-12 Thomson Licensing A method and apparatus for encoding a point cloud representing three-dimensional objects
CN110049323B (zh) 2018-01-17 2021-09-07 华为技术有限公司 编码方法、解码方法和装置
US10742337B2 (en) * 2018-03-23 2020-08-11 Buildscale, Inc. Device, system and method for real-time personalization of streaming video
CN112352264A (zh) * 2018-06-25 2021-02-09 索尼公司 图像处理装置和图像处理方法
CN109117718B (zh) * 2018-07-02 2021-11-26 东南大学 一种面向道路场景的三维语义地图构建和存储方法
KR102131502B1 (ko) * 2018-08-07 2020-07-07 재단법인 다차원 스마트 아이티 융합시스템 연구단 실시간 3차원 비디오 인코딩 및 디코딩 방법
KR20200084698A (ko) * 2019-01-03 2020-07-13 삼성전자주식회사 3차원 데이터를 압축하는 방법 및 장치 및 3차원 데이터를 재구성하는 방법 및 장치
US11217022B1 (en) * 2019-06-28 2022-01-04 Snap Inc. Light invariant pattern mapping
KR102289900B1 (ko) * 2019-08-07 2021-08-17 구글 엘엘씨 비디오 콜을 위한 얼굴 기반 프레임 레이트 업샘플링
US12169951B2 (en) * 2019-08-29 2024-12-17 Interdigital Ce Patent Holdings, Sas Transporting format of a coded point cloud
CN110650328A (zh) * 2019-09-20 2020-01-03 北京三快在线科技有限公司 一种图像传输的方法及装置
US20220414944A1 (en) * 2019-11-28 2022-12-29 Sony Group Corporation Display terminal device
US11189007B2 (en) * 2019-12-03 2021-11-30 Imagry (Israel) Ltd Real-time generation of functional road maps
US11830302B2 (en) 2020-03-24 2023-11-28 Uatc, Llc Computer system for utilizing ultrasonic signals to implement operations for autonomous vehicles
WO2022076020A1 (en) * 2020-10-08 2022-04-14 Google Llc Few-shot synthesis of talking heads
WO2023020710A1 (en) * 2021-08-20 2023-02-23 Telefonaktiebolaget Lm Ericsson (Publ) Improved depth prediction for depth image compression
JP2024100225A (ja) * 2023-01-13 2024-07-26 キヤノン株式会社 撮像装置及びその制御方法、プログラム及び記憶媒体

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1402852A (zh) * 1999-10-22 2003-03-12 动感天空公司 面向目标的视频系统
WO2013130208A1 (en) * 2012-03-02 2013-09-06 Qualcomm Incorporated Scene structure-based self-pose estimation

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2614918B2 (ja) 1989-05-12 1997-05-28 日本電信電話株式会社 画像符号化方法
JPH082107B2 (ja) 1990-03-02 1996-01-10 国際電信電話株式会社 動画像のハイブリッド符号化方法及びその装置
US6023301A (en) 1995-07-14 2000-02-08 Sharp Kabushiki Kaisha Video coding device and video decoding device
US20060132482A1 (en) * 2004-11-12 2006-06-22 Oh Byong M Method for inter-scene transitions
JP4929848B2 (ja) 2006-06-02 2012-05-09 ソニー株式会社 映像データの伝送システムとその方法、送信処理装置とその方法
WO2009122760A1 (ja) 2008-04-04 2009-10-08 富士フイルム株式会社 画像処理装置、画像処理方法、およびコンピュータ読取可能な媒体
JP2009273116A (ja) 2008-04-07 2009-11-19 Fujifilm Corp 画像処理装置、画像処理方法、およびプログラム
EP2216750A1 (en) 2009-02-06 2010-08-11 Thomson Licensing Method and apparatus for encoding 3D mesh models, and method and apparatus for decoding encoded 3D mesh models
US9131163B2 (en) 2012-02-07 2015-09-08 Stmicroelectronics S.R.L. Efficient compact descriptors in visual search systems
JP2014067372A (ja) 2012-09-27 2014-04-17 Kddi Corp 運動視差再現プログラムおよび装置ならびにその三次元モデル生成プログラムおよび装置
US9083960B2 (en) 2013-01-30 2015-07-14 Qualcomm Incorporated Real-time 3D reconstruction with power efficient depth sensor usage
US9269003B2 (en) * 2013-04-30 2016-02-23 Qualcomm Incorporated Diminished and mediated reality effects from reconstruction
US20140369557A1 (en) 2013-06-14 2014-12-18 Qualcomm Incorporated Systems and Methods for Feature-Based Tracking
KR101854003B1 (ko) 2013-07-02 2018-06-14 경희대학교 산학협력단 복수의 레이어를 포함하는 영상의 부호화 및 복호화 방법

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1402852A (zh) * 1999-10-22 2003-03-12 动感天空公司 面向目标的视频系统
WO2013130208A1 (en) * 2012-03-02 2013-09-06 Qualcomm Incorporated Scene structure-based self-pose estimation

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Face tracking for model-based coding and face animation;J. Ahlberg等;《International Journal of Imaging Systems and Technology》;20030101;第13卷(第1期);11-12 *
Model-based video compression for real world data;Christian Feller等;《2013 IEEE Third international conference on consumer electroics-Berlin》;20131227;210-211 *
Object-oriented analysis-synthesis coding of moving images;H.G. Musmann等;《Signal Processing: Image Communication》;19891001;第1卷(第2期);118,124-131 *

Also Published As

Publication number Publication date
KR102126610B1 (ko) 2020-06-25
KR20170056516A (ko) 2017-05-23
JP2017530626A (ja) 2017-10-12
US10484697B2 (en) 2019-11-19
CN106716490A (zh) 2017-05-24
WO2016040161A1 (en) 2016-03-17
US20160073117A1 (en) 2016-03-10
EP3192055A1 (en) 2017-07-19

Similar Documents

Publication Publication Date Title
CN106716490B (zh) 用于视频译码的同时定位与地图构建
CN109997358B (zh) 用于自由视点视频流式传输的以解码器为中心的uv编解码器
EP3900363B1 (en) Streaming volumetric and non-volumetric video
JP2019534606A (ja) ライトフィールドデータを使用して場面を表す点群を再構築するための方法および装置
US12356006B2 (en) Method and apparatus for encoding volumetric video represented as a multiplane image
JP7692408B2 (ja) 容積ビデオを符号化、送信、及び復号化するための方法及び装置
US10284810B1 (en) Using low-resolution frames to increase frame rate of high-resolution frames
CN112153391B (zh) 视频编码的方法、装置、电子设备及存储介质
WO2019229293A1 (en) An apparatus, a method and a computer program for volumetric video
WO2020185383A1 (en) A method and apparatus for encoding and rendering a 3d scene with inpainting patches
US11968349B2 (en) Method and apparatus for encoding and decoding of multiple-viewpoint 3DoF+ content
JP2022517118A (ja) 点群コーディングにおける効率的なパッチ回転
CN102823241A (zh) 立体三维图像的低带宽内容保留压缩方法和设备
WO2024076716A1 (en) Fast computation of local coordinate system for displacement vectors in mesh coding
JP2022513487A (ja) 没入型ビデオビットストリーム処理
US20250175617A1 (en) Face count reduction for lossy mesh compression
US20240244260A1 (en) Integrating duplicated vertices and vertices grouping in mesh motion vector coding
US20250159254A1 (en) Middle point position coding for lossless compression
CN112188201B (zh) 对视频流进行编码的方法、装置、电子设备及存储介质
HK40084467A (en) Method and apparatus for encoding video code stream using video point cloud coding, computer device, and storage medium
CN115997380A (zh) 基于视频的点云编解码的附条件的重新着色
CN117337570A (zh) 有长期分块实体存储器的体积视频
JP2015092700A (ja) 立体的三次元画像の圧縮を維持する低帯域コンテンツのための方法及び装置

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20200313