CN106716490B - 用于视频译码的同时定位与地图构建 - Google Patents

用于视频译码的同时定位与地图构建 Download PDF

Info

Publication number
CN106716490B
CN106716490B CN201580047818.1A CN201580047818A CN106716490B CN 106716490 B CN106716490 B CN 106716490B CN 201580047818 A CN201580047818 A CN 201580047818A CN 106716490 B CN106716490 B CN 106716490B
Authority
CN
China
Prior art keywords
image
composite image
scene structure
current
structure map
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201580047818.1A
Other languages
English (en)
Chinese (zh)
Other versions
CN106716490A (zh
Inventor
菲利普·格拉斯米格
迪特尔·施马尔施蒂格
格哈德·赖特迈尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of CN106716490A publication Critical patent/CN106716490A/zh
Application granted granted Critical
Publication of CN106716490B publication Critical patent/CN106716490B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
    • H04N19/27—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding involving both synthetic and natural picture components, e.g. synthetic natural hybrid coding [SNHC]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • G06T9/001—Model-based coding, e.g. wire frame
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
    • H04N19/23—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding with coding of regions that are present throughout a whole video segment, e.g. sprites, background or mosaic
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
CN201580047818.1A 2014-09-09 2015-09-04 用于视频译码的同时定位与地图构建 Expired - Fee Related CN106716490B (zh)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201462048041P 2014-09-09 2014-09-09
US62/048,041 2014-09-09
US14/845,076 US10484697B2 (en) 2014-09-09 2015-09-03 Simultaneous localization and mapping for video coding
US14/845,076 2015-09-03
PCT/US2015/048569 WO2016040161A1 (en) 2014-09-09 2015-09-04 Simultaneous localization and mapping for video coding

Publications (2)

Publication Number Publication Date
CN106716490A CN106716490A (zh) 2017-05-24
CN106716490B true CN106716490B (zh) 2020-03-13

Family

ID=55438749

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201580047818.1A Expired - Fee Related CN106716490B (zh) 2014-09-09 2015-09-04 用于视频译码的同时定位与地图构建

Country Status (6)

Country Link
US (1) US10484697B2 (enExample)
EP (1) EP3192055A1 (enExample)
JP (1) JP2017530626A (enExample)
KR (1) KR102126610B1 (enExample)
CN (1) CN106716490B (enExample)
WO (1) WO2016040161A1 (enExample)

Families Citing this family (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014082541A (ja) * 2012-10-12 2014-05-08 National Institute Of Information & Communication Technology 互いに類似した情報を含む複数画像のデータサイズを低減する方法、プログラムおよび装置
CN118816924A (zh) 2015-02-10 2024-10-22 御眼视觉技术有限公司 用于自主车辆导航的稀疏地图
US10362290B2 (en) 2015-02-17 2019-07-23 Nextvr Inc. Methods and apparatus for processing content based on viewing information and/or communicating content
KR102533555B1 (ko) 2015-02-17 2023-05-18 네버마인드 캐피탈 엘엘씨 감축된 해상도 이미지들을 생성 및 이용하고 및/또는 재생 또는 컨텐트 분배 디바이스에 이러한 이미지들을 통신하기 위한 방법들 및 장치
US10243604B2 (en) * 2015-12-08 2019-03-26 Uber Technologies, Inc. Autonomous vehicle mesh networking configuration
US10036642B2 (en) 2015-12-08 2018-07-31 Uber Technologies, Inc. Automated vehicle communications system
US9557183B1 (en) 2015-12-08 2017-01-31 Uber Technologies, Inc. Backend system for route planning of autonomous vehicles
US9603158B1 (en) 2015-12-08 2017-03-21 Uber Technologies, Inc. Optimizing communication for automated vehicles
US10050760B2 (en) 2015-12-08 2018-08-14 Uber Technologies, Inc. Backend communications system for a fleet of autonomous vehicles
US9432929B1 (en) 2015-12-08 2016-08-30 Uber Technologies, Inc. Communication configuration system for a fleet of automated vehicles
US9902311B2 (en) 2016-02-22 2018-02-27 Uber Technologies, Inc. Lighting device for a vehicle
US9969326B2 (en) 2016-02-22 2018-05-15 Uber Technologies, Inc. Intention signaling for an autonomous vehicle
US11228754B2 (en) 2016-05-06 2022-01-18 Qualcomm Incorporated Hybrid graphics and pixel domain architecture for 360 degree video
CN116777994A (zh) * 2016-06-30 2023-09-19 奇跃公司 估计3d空间中的姿态
US10558222B2 (en) 2016-07-21 2020-02-11 Mobileye Vision Technologies Ltd. Navigating a vehicle using a crowdsourced sparse map
US11006135B2 (en) * 2016-08-05 2021-05-11 Sony Corporation Image processing apparatus and image processing method
US10699466B2 (en) * 2016-12-06 2020-06-30 Koninklijke Philips N.V. Apparatus and method for generating a light intensity image
US10202126B2 (en) 2017-03-07 2019-02-12 Uber Technologies, Inc. Teleassistance data encoding for self-driving vehicles
US10293818B2 (en) 2017-03-07 2019-05-21 Uber Technologies, Inc. Teleassistance data prioritization for self-driving vehicles
US11031113B1 (en) 2017-06-16 2021-06-08 Walgreen Co. Technology for processing prescription medications for pickup by individuals
US11328801B1 (en) 2017-06-16 2022-05-10 Walgreen Co. Technology for managing priorities for on-site prescription pickup
EP3419286A1 (en) * 2017-06-23 2018-12-26 Koninklijke Philips N.V. Processing of 3d image information based on texture maps and meshes
GB2563895B (en) * 2017-06-29 2019-09-18 Sony Interactive Entertainment Inc Video generation method and apparatus
US10493622B2 (en) 2017-07-14 2019-12-03 Uatc, Llc Systems and methods for communicating future vehicle actions to be performed by an autonomous vehicle
US10779011B2 (en) 2017-07-31 2020-09-15 Qualcomm Incorporated Error concealment in virtual reality system
EP3496388A1 (en) * 2017-12-05 2019-06-12 Thomson Licensing A method and apparatus for encoding a point cloud representing three-dimensional objects
CN110049323B (zh) 2018-01-17 2021-09-07 华为技术有限公司 编码方法、解码方法和装置
US10742337B2 (en) * 2018-03-23 2020-08-11 Buildscale, Inc. Device, system and method for real-time personalization of streaming video
EP3813024A4 (en) * 2018-06-25 2022-01-05 Sony Group Corporation IMAGE PROCESSING DEVICE AND METHOD
CN109117718B (zh) * 2018-07-02 2021-11-26 东南大学 一种面向道路场景的三维语义地图构建和存储方法
KR102131502B1 (ko) * 2018-08-07 2020-07-07 재단법인 다차원 스마트 아이티 융합시스템 연구단 실시간 3차원 비디오 인코딩 및 디코딩 방법
KR20200084698A (ko) * 2019-01-03 2020-07-13 삼성전자주식회사 3차원 데이터를 압축하는 방법 및 장치 및 3차원 데이터를 재구성하는 방법 및 장치
US11217022B1 (en) * 2019-06-28 2022-01-04 Snap Inc. Light invariant pattern mapping
US11321555B2 (en) 2019-08-07 2022-05-03 Google Llc Face-based frame rate upsampling for video calls
WO2021037613A1 (en) * 2019-08-29 2021-03-04 Interdigital Vc Holdings France, Sas Transporting format of a coded point cloud
CN110650328A (zh) * 2019-09-20 2020-01-03 北京三快在线科技有限公司 一种图像传输的方法及装置
CN114731383B (zh) * 2019-11-28 2025-04-29 索尼集团公司 显示终端设备
US11189007B2 (en) * 2019-12-03 2021-11-30 Imagry (Israel) Ltd Real-time generation of functional road maps
US11830302B2 (en) 2020-03-24 2023-11-28 Uatc, Llc Computer system for utilizing ultrasonic signals to implement operations for autonomous vehicles
CN114631127B (zh) * 2020-10-08 2025-04-29 谷歌有限责任公司 说话头的小样本合成
WO2023020710A1 (en) * 2021-08-20 2023-02-23 Telefonaktiebolaget Lm Ericsson (Publ) Improved depth prediction for depth image compression
JP2024100225A (ja) * 2023-01-13 2024-07-26 キヤノン株式会社 撮像装置及びその制御方法、プログラム及び記憶媒体
US20260012689A1 (en) * 2024-07-08 2026-01-08 Samsung Electronics Co., Ltd. Optimized Transmission of Real-Time Synthetic Media

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1402852A (zh) * 1999-10-22 2003-03-12 动感天空公司 面向目标的视频系统
WO2013130208A1 (en) * 2012-03-02 2013-09-06 Qualcomm Incorporated Scene structure-based self-pose estimation

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2614918B2 (ja) 1989-05-12 1997-05-28 日本電信電話株式会社 画像符号化方法
JPH082107B2 (ja) 1990-03-02 1996-01-10 国際電信電話株式会社 動画像のハイブリッド符号化方法及びその装置
US6023301A (en) 1995-07-14 2000-02-08 Sharp Kabushiki Kaisha Video coding device and video decoding device
KR20070086037A (ko) * 2004-11-12 2007-08-27 목3, 인크. 장면 간 전환 방법
JP4929848B2 (ja) 2006-06-02 2012-05-09 ソニー株式会社 映像データの伝送システムとその方法、送信処理装置とその方法
WO2009122760A1 (ja) 2008-04-04 2009-10-08 富士フイルム株式会社 画像処理装置、画像処理方法、およびコンピュータ読取可能な媒体
JP2009273116A (ja) 2008-04-07 2009-11-19 Fujifilm Corp 画像処理装置、画像処理方法、およびプログラム
EP2216750A1 (en) 2009-02-06 2010-08-11 Thomson Licensing Method and apparatus for encoding 3D mesh models, and method and apparatus for decoding encoded 3D mesh models
US9204112B2 (en) 2012-02-07 2015-12-01 Stmicroelectronics S.R.L. Systems, circuits, and methods for efficient hierarchical object recognition based on clustered invariant features
JP2014067372A (ja) 2012-09-27 2014-04-17 Kddi Corp 運動視差再現プログラムおよび装置ならびにその三次元モデル生成プログラムおよび装置
US9083960B2 (en) 2013-01-30 2015-07-14 Qualcomm Incorporated Real-time 3D reconstruction with power efficient depth sensor usage
US9269003B2 (en) * 2013-04-30 2016-02-23 Qualcomm Incorporated Diminished and mediated reality effects from reconstruction
US20140369557A1 (en) 2013-06-14 2014-12-18 Qualcomm Incorporated Systems and Methods for Feature-Based Tracking
KR101854003B1 (ko) 2013-07-02 2018-06-14 경희대학교 산학협력단 복수의 레이어를 포함하는 영상의 부호화 및 복호화 방법

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1402852A (zh) * 1999-10-22 2003-03-12 动感天空公司 面向目标的视频系统
WO2013130208A1 (en) * 2012-03-02 2013-09-06 Qualcomm Incorporated Scene structure-based self-pose estimation

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Face tracking for model-based coding and face animation;J. Ahlberg等;《International Journal of Imaging Systems and Technology》;20030101;第13卷(第1期);11-12 *
Model-based video compression for real world data;Christian Feller等;《2013 IEEE Third international conference on consumer electroics-Berlin》;20131227;210-211 *
Object-oriented analysis-synthesis coding of moving images;H.G. Musmann等;《Signal Processing: Image Communication》;19891001;第1卷(第2期);118,124-131 *

Also Published As

Publication number Publication date
KR20170056516A (ko) 2017-05-23
CN106716490A (zh) 2017-05-24
KR102126610B1 (ko) 2020-06-25
EP3192055A1 (en) 2017-07-19
JP2017530626A (ja) 2017-10-12
WO2016040161A1 (en) 2016-03-17
US20160073117A1 (en) 2016-03-10
US10484697B2 (en) 2019-11-19

Similar Documents

Publication Publication Date Title
CN106716490B (zh) 用于视频译码的同时定位与地图构建
CN109997358B (zh) 用于自由视点视频流式传输的以解码器为中心的uv编解码器
EP3900363B1 (en) Streaming volumetric and non-volumetric video
JP2019534606A (ja) ライトフィールドデータを使用して場面を表す点群を再構築するための方法および装置
US12356006B2 (en) Method and apparatus for encoding volumetric video represented as a multiplane image
US10284810B1 (en) Using low-resolution frames to increase frame rate of high-resolution frames
JP7692408B2 (ja) 容積ビデオを符号化、送信、及び復号化するための方法及び装置
CN112153391B (zh) 视频编码的方法、装置、电子设备及存储介质
US11968349B2 (en) Method and apparatus for encoding and decoding of multiple-viewpoint 3DoF+ content
WO2019229293A1 (en) An apparatus, a method and a computer program for volumetric video
EP3939315A1 (en) A method and apparatus for encoding and rendering a 3d scene with inpainting patches
JP2022517118A (ja) 点群コーディングにおける効率的なパッチ回転
US20240137564A1 (en) Fast computation of local coordinate system for displacement vectors in mesh coding
JP2022513487A (ja) 没入型ビデオビットストリーム処理
US20250175617A1 (en) Face count reduction for lossy mesh compression
US20240244260A1 (en) Integrating duplicated vertices and vertices grouping in mesh motion vector coding
US20250159254A1 (en) Middle point position coding for lossless compression
CN112188201B (zh) 对视频流进行编码的方法、装置、电子设备及存储介质
HK40084467A (en) Method and apparatus for encoding video code stream using video point cloud coding, computer device, and storage medium
CN115997380A (zh) 基于视频的点云编解码的附条件的重新着色
CN117337570A (zh) 有长期分块实体存储器的体积视频
JP2015092700A (ja) 立体的三次元画像の圧縮を維持する低帯域コンテンツのための方法及び装置

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20200313