KR102126610B1 - 비디오 코딩을 위한 동시 로컬리제이션 및 맵핑 - Google Patents

비디오 코딩을 위한 동시 로컬리제이션 및 맵핑 Download PDF

Info

Publication number
KR102126610B1
KR102126610B1 KR1020177004391A KR20177004391A KR102126610B1 KR 102126610 B1 KR102126610 B1 KR 102126610B1 KR 1020177004391 A KR1020177004391 A KR 1020177004391A KR 20177004391 A KR20177004391 A KR 20177004391A KR 102126610 B1 KR102126610 B1 KR 102126610B1
Authority
KR
South Korea
Prior art keywords
image
scene structure
composite image
structure map
current image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
KR1020177004391A
Other languages
English (en)
Korean (ko)
Other versions
KR20170056516A (ko
Inventor
필립 그라스무크
디터 슈말슈티크
게르하르트 라이트마이어
Original Assignee
퀄컴 인코포레이티드
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 퀄컴 인코포레이티드 filed Critical 퀄컴 인코포레이티드
Publication of KR20170056516A publication Critical patent/KR20170056516A/ko
Application granted granted Critical
Publication of KR102126610B1 publication Critical patent/KR102126610B1/ko
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
    • H04N19/27—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding involving both synthetic and natural picture components, e.g. synthetic natural hybrid coding [SNHC]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • G06T9/001—Model-based coding, e.g. wire frame
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
    • H04N19/23—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding with coding of regions that are present throughout a whole video segment, e.g. sprites, background or mosaic
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
KR1020177004391A 2014-09-09 2015-09-04 비디오 코딩을 위한 동시 로컬리제이션 및 맵핑 Expired - Fee Related KR102126610B1 (ko)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201462048041P 2014-09-09 2014-09-09
US62/048,041 2014-09-09
US14/845,076 US10484697B2 (en) 2014-09-09 2015-09-03 Simultaneous localization and mapping for video coding
US14/845,076 2015-09-03
PCT/US2015/048569 WO2016040161A1 (en) 2014-09-09 2015-09-04 Simultaneous localization and mapping for video coding

Publications (2)

Publication Number Publication Date
KR20170056516A KR20170056516A (ko) 2017-05-23
KR102126610B1 true KR102126610B1 (ko) 2020-06-25

Family

ID=55438749

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020177004391A Expired - Fee Related KR102126610B1 (ko) 2014-09-09 2015-09-04 비디오 코딩을 위한 동시 로컬리제이션 및 맵핑

Country Status (6)

Country Link
US (1) US10484697B2 (enExample)
EP (1) EP3192055A1 (enExample)
JP (1) JP2017530626A (enExample)
KR (1) KR102126610B1 (enExample)
CN (1) CN106716490B (enExample)
WO (1) WO2016040161A1 (enExample)

Families Citing this family (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014082541A (ja) * 2012-10-12 2014-05-08 National Institute Of Information & Communication Technology 互いに類似した情報を含む複数画像のデータサイズを低減する方法、プログラムおよび装置
KR102623680B1 (ko) 2015-02-10 2024-01-12 모빌아이 비젼 테크놀로지스 엘티디. 자율 주행을 위한 약도
US20160241838A1 (en) * 2015-02-17 2016-08-18 Nextvr Inc. Methods and apparatus for generating and using reduced resolution images and/or communicating such images to a playback or content distribution device
US10362290B2 (en) 2015-02-17 2019-07-23 Nextvr Inc. Methods and apparatus for processing content based on viewing information and/or communicating content
US10243604B2 (en) * 2015-12-08 2019-03-26 Uber Technologies, Inc. Autonomous vehicle mesh networking configuration
US9603158B1 (en) 2015-12-08 2017-03-21 Uber Technologies, Inc. Optimizing communication for automated vehicles
US9432929B1 (en) 2015-12-08 2016-08-30 Uber Technologies, Inc. Communication configuration system for a fleet of automated vehicles
US9557183B1 (en) 2015-12-08 2017-01-31 Uber Technologies, Inc. Backend system for route planning of autonomous vehicles
US10050760B2 (en) 2015-12-08 2018-08-14 Uber Technologies, Inc. Backend communications system for a fleet of autonomous vehicles
US10036642B2 (en) 2015-12-08 2018-07-31 Uber Technologies, Inc. Automated vehicle communications system
US9969326B2 (en) 2016-02-22 2018-05-15 Uber Technologies, Inc. Intention signaling for an autonomous vehicle
US9902311B2 (en) 2016-02-22 2018-02-27 Uber Technologies, Inc. Lighting device for a vehicle
US11228754B2 (en) 2016-05-06 2022-01-18 Qualcomm Incorporated Hybrid graphics and pixel domain architecture for 360 degree video
CN116777994A (zh) 2016-06-30 2023-09-19 奇跃公司 估计3d空间中的姿态
US10558222B2 (en) 2016-07-21 2020-02-11 Mobileye Vision Technologies Ltd. Navigating a vehicle using a crowdsourced sparse map
WO2018025660A1 (ja) * 2016-08-05 2018-02-08 ソニー株式会社 画像処理装置および画像処理方法
US10699466B2 (en) * 2016-12-06 2020-06-30 Koninklijke Philips N.V. Apparatus and method for generating a light intensity image
US10293818B2 (en) 2017-03-07 2019-05-21 Uber Technologies, Inc. Teleassistance data prioritization for self-driving vehicles
US10202126B2 (en) 2017-03-07 2019-02-12 Uber Technologies, Inc. Teleassistance data encoding for self-driving vehicles
US11031113B1 (en) 2017-06-16 2021-06-08 Walgreen Co. Technology for processing prescription medications for pickup by individuals
US11328801B1 (en) 2017-06-16 2022-05-10 Walgreen Co. Technology for managing priorities for on-site prescription pickup
EP3419286A1 (en) * 2017-06-23 2018-12-26 Koninklijke Philips N.V. Processing of 3d image information based on texture maps and meshes
GB2563895B (en) * 2017-06-29 2019-09-18 Sony Interactive Entertainment Inc Video generation method and apparatus
US10493622B2 (en) 2017-07-14 2019-12-03 Uatc, Llc Systems and methods for communicating future vehicle actions to be performed by an autonomous vehicle
US10779011B2 (en) 2017-07-31 2020-09-15 Qualcomm Incorporated Error concealment in virtual reality system
EP3496388A1 (en) * 2017-12-05 2019-06-12 Thomson Licensing A method and apparatus for encoding a point cloud representing three-dimensional objects
CN110049323B (zh) 2018-01-17 2021-09-07 华为技术有限公司 编码方法、解码方法和装置
US10742337B2 (en) * 2018-03-23 2020-08-11 Buildscale, Inc. Device, system and method for real-time personalization of streaming video
CN112352264A (zh) * 2018-06-25 2021-02-09 索尼公司 图像处理装置和图像处理方法
CN109117718B (zh) * 2018-07-02 2021-11-26 东南大学 一种面向道路场景的三维语义地图构建和存储方法
KR102131502B1 (ko) * 2018-08-07 2020-07-07 재단법인 다차원 스마트 아이티 융합시스템 연구단 실시간 3차원 비디오 인코딩 및 디코딩 방법
KR20200084698A (ko) * 2019-01-03 2020-07-13 삼성전자주식회사 3차원 데이터를 압축하는 방법 및 장치 및 3차원 데이터를 재구성하는 방법 및 장치
US11217022B1 (en) * 2019-06-28 2022-01-04 Snap Inc. Light invariant pattern mapping
KR102289900B1 (ko) * 2019-08-07 2021-08-17 구글 엘엘씨 비디오 콜을 위한 얼굴 기반 프레임 레이트 업샘플링
US12169951B2 (en) * 2019-08-29 2024-12-17 Interdigital Ce Patent Holdings, Sas Transporting format of a coded point cloud
CN110650328A (zh) * 2019-09-20 2020-01-03 北京三快在线科技有限公司 一种图像传输的方法及装置
US20220414944A1 (en) * 2019-11-28 2022-12-29 Sony Group Corporation Display terminal device
US11189007B2 (en) * 2019-12-03 2021-11-30 Imagry (Israel) Ltd Real-time generation of functional road maps
US11830302B2 (en) 2020-03-24 2023-11-28 Uatc, Llc Computer system for utilizing ultrasonic signals to implement operations for autonomous vehicles
WO2022076020A1 (en) * 2020-10-08 2022-04-14 Google Llc Few-shot synthesis of talking heads
WO2023020710A1 (en) * 2021-08-20 2023-02-23 Telefonaktiebolaget Lm Ericsson (Publ) Improved depth prediction for depth image compression
JP2024100225A (ja) * 2023-01-13 2024-07-26 キヤノン株式会社 撮像装置及びその制御方法、プログラム及び記憶媒体

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2614918B2 (ja) 1989-05-12 1997-05-28 日本電信電話株式会社 画像符号化方法
JPH082107B2 (ja) 1990-03-02 1996-01-10 国際電信電話株式会社 動画像のハイブリッド符号化方法及びその装置
US6023301A (en) 1995-07-14 2000-02-08 Sharp Kabushiki Kaisha Video coding device and video decoding device
NZ518774A (en) 1999-10-22 2004-09-24 Activesky Inc An object oriented video system
US20060132482A1 (en) * 2004-11-12 2006-06-22 Oh Byong M Method for inter-scene transitions
JP4929848B2 (ja) 2006-06-02 2012-05-09 ソニー株式会社 映像データの伝送システムとその方法、送信処理装置とその方法
WO2009122760A1 (ja) 2008-04-04 2009-10-08 富士フイルム株式会社 画像処理装置、画像処理方法、およびコンピュータ読取可能な媒体
JP2009273116A (ja) 2008-04-07 2009-11-19 Fujifilm Corp 画像処理装置、画像処理方法、およびプログラム
EP2216750A1 (en) 2009-02-06 2010-08-11 Thomson Licensing Method and apparatus for encoding 3D mesh models, and method and apparatus for decoding encoded 3D mesh models
US9131163B2 (en) 2012-02-07 2015-09-08 Stmicroelectronics S.R.L. Efficient compact descriptors in visual search systems
US8965057B2 (en) 2012-03-02 2015-02-24 Qualcomm Incorporated Scene structure-based self-pose estimation
JP2014067372A (ja) 2012-09-27 2014-04-17 Kddi Corp 運動視差再現プログラムおよび装置ならびにその三次元モデル生成プログラムおよび装置
US9083960B2 (en) 2013-01-30 2015-07-14 Qualcomm Incorporated Real-time 3D reconstruction with power efficient depth sensor usage
US9269003B2 (en) * 2013-04-30 2016-02-23 Qualcomm Incorporated Diminished and mediated reality effects from reconstruction
US20140369557A1 (en) 2013-06-14 2014-12-18 Qualcomm Incorporated Systems and Methods for Feature-Based Tracking
KR101854003B1 (ko) 2013-07-02 2018-06-14 경희대학교 산학협력단 복수의 레이어를 포함하는 영상의 부호화 및 복호화 방법

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
C. Feller, et al. Model-based video compression for real world data. 2013 IEEE 3rd Int'l Conf. on Consumer Electronics. Sep. 2013, pp.210-214
H. Musmann, et al. Object-oriented analysis-synthesis coding of moving images. Signal Processing: Image Communication. Oct 1989, Vol.1, No.2, pp.117-138

Also Published As

Publication number Publication date
KR20170056516A (ko) 2017-05-23
JP2017530626A (ja) 2017-10-12
US10484697B2 (en) 2019-11-19
CN106716490A (zh) 2017-05-24
CN106716490B (zh) 2020-03-13
WO2016040161A1 (en) 2016-03-17
US20160073117A1 (en) 2016-03-10
EP3192055A1 (en) 2017-07-19

Similar Documents

Publication Publication Date Title
KR102126610B1 (ko) 비디오 코딩을 위한 동시 로컬리제이션 및 맵핑
US10499033B2 (en) Apparatus, a method and a computer program for coding and rendering volumetric video
CN110419221B (zh) 自适应扰动立方体的地图投影
CN116325769B (zh) 从多个视点流式传输场景的全景视频
CN113243112B (zh) 流式传输体积视频和非体积视频
TW201911863A (zh) 用於360度視訊寫碼之參考圖推導及動作補償
JP7217226B2 (ja) グローバルな回転における動き補償画像を符号化する方法、デバイス及びストリーム
JP2023529748A (ja) ディスオクルージョンアトラスを用いたマルチビュービデオ動作のサポート
US10284810B1 (en) Using low-resolution frames to increase frame rate of high-resolution frames
CN112153391B (zh) 视频编码的方法、装置、电子设备及存储介质
WO2019229293A1 (en) An apparatus, a method and a computer program for volumetric video
JP7692408B2 (ja) 容積ビデオを符号化、送信、及び復号化するための方法及び装置
CN116250234A (zh) 用于对基于mpi的体积视频进行编码的方法和装置
JP2022517118A (ja) 点群コーディングにおける効率的なパッチ回転
CN110663068A (zh) 用于渲染全景场景的坐标映射
KR20230173678A (ko) 장기 패치 엔터티 메모리가 있는 볼류메트릭 비디오
US20240137564A1 (en) Fast computation of local coordinate system for displacement vectors in mesh coding
US20240244260A1 (en) Integrating duplicated vertices and vertices grouping in mesh motion vector coding
CN115997380B (zh) 使用视频点云编码对视频码流进行编码的方法、装置、计算机设备和存储介质
US20250175617A1 (en) Face count reduction for lossy mesh compression
CN116648904B (zh) 视频编码的方法、视频解码的方法、装置及存储介质
US20240282010A1 (en) Adaptive integrating duplicated vertices in mesh motion vector coding
US20240346702A1 (en) Vertex position coding in lossless mesh compression
US20240236305A1 (en) Vertices grouping in mesh motion vector coding
CN118525308A (zh) 网格编码中的位移矢量局部坐标系的快速计算

Legal Events

Date Code Title Description
PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

PA0302 Request for accelerated examination

St.27 status event code: A-1-2-D10-D17-exm-PA0302

St.27 status event code: A-1-2-D10-D16-exm-PA0302

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

St.27 status event code: A-1-2-D10-D22-exm-PE0701

GRNT Written decision to grant
PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U12-oth-PR1002

Fee payment year number: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 4

PC1903 Unpaid annual fee

St.27 status event code: A-4-4-U10-U13-oth-PC1903

Not in force date: 20240619

Payment event data comment text: Termination Category : DEFAULT_OF_REGISTRATION_FEE

PC1903 Unpaid annual fee

St.27 status event code: N-4-6-H10-H13-oth-PC1903

Ip right cessation event data comment text: Termination Category : DEFAULT_OF_REGISTRATION_FEE

Not in force date: 20240619