JP2019523921A - ３６０度ビデオのためのレンズひずみ補正を用いた魚眼レンダリング - Google Patents

３６０度ビデオのためのレンズひずみ補正を用いた魚眼レンダリング Download PDF

Info

Publication number
JP2019523921A
JP2019523921A JP2018560066A JP2018560066A JP2019523921A JP 2019523921 A JP2019523921 A JP 2019523921A JP 2018560066 A JP2018560066 A JP 2018560066A JP 2018560066 A JP2018560066 A JP 2018560066A JP 2019523921 A JP2019523921 A JP 2019523921A
Authority
JP
Japan
Prior art keywords
image
video
mapping
dimensional
video data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2018560066A
Other languages
English (en)
Japanese (ja)
Other versions
JP2019523921A5 (cg-RX-API-DMAC7.html
Inventor
ヘルト・ファン・デル・アウウェラ
ムハンマド・コバン
マルタ・カルチェヴィッチ
Original Assignee
クアルコム，インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by クアルコム，インコーポレイテッド filed Critical クアルコム，インコーポレイテッド
Publication of JP2019523921A publication Critical patent/JP2019523921A/ja
Publication of JP2019523921A5 publication Critical patent/JP2019523921A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/80—Geometric correction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/18—Image warping, e.g. rearranging pixels individually
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/08—Projecting images onto non-planar surfaces, e.g. geodetic screens
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Processing (AREA)
  • Studio Devices (AREA)
  • Geometry (AREA)
  • Controls And Circuits For Display Device (AREA)
JP2018560066A 2016-05-24 2017-04-25 ３６０度ビデオのためのレンズひずみ補正を用いた魚眼レンダリング Pending JP2019523921A (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201662340914P 2016-05-24 2016-05-24
US62/340,914 2016-05-24
US15/495,709 US10699389B2 (en) 2016-05-24 2017-04-24 Fisheye rendering with lens distortion correction for 360-degree video
US15/495,709 2017-04-24
PCT/US2017/029441 WO2017204971A1 (en) 2016-05-24 2017-04-25 Fisheye rendering with lens distortion correction for 360-degree video

Publications (2)

Publication Number Publication Date
JP2019523921A true JP2019523921A (ja) 2019-08-29
JP2019523921A5 JP2019523921A5 (cg-RX-API-DMAC7.html) 2020-05-21

Family

ID=58800890

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018560066A Pending JP2019523921A (ja) 2016-05-24 2017-04-25 ３６０度ビデオのためのレンズひずみ補正を用いた魚眼レンダリング

Country Status (9)

Country Link
US (1) US10699389B2 (cg-RX-API-DMAC7.html)
EP (1) EP3465607B1 (cg-RX-API-DMAC7.html)
JP (1) JP2019523921A (cg-RX-API-DMAC7.html)
KR (1) KR102373921B1 (cg-RX-API-DMAC7.html)
CN (1) CN109155056B (cg-RX-API-DMAC7.html)
BR (1) BR112018073986A2 (cg-RX-API-DMAC7.html)
SG (1) SG11201808923QA (cg-RX-API-DMAC7.html)
TW (1) TW201742435A (cg-RX-API-DMAC7.html)
WO (1) WO2017204971A1 (cg-RX-API-DMAC7.html)

Families Citing this family (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10200672B2 (en) * 2016-08-17 2019-02-05 Nextvr Inc. Methods and apparatus for capturing images of an environment
KR20190052129A (ko) 2016-10-04 2019-05-15 김기백 영상 데이터 부호화/복호화 방법 및 장치
US20190238888A1 (en) 2017-07-17 2019-08-01 Ki Baek Kim Image data encoding/decoding method and apparatus
CN107967665B (zh) * 2016-10-20 2021-07-13 株式会社理光 图像处理方法和图像处理装置
US10332242B2 (en) 2017-02-02 2019-06-25 OrbViu Inc. Method and system for reconstructing 360-degree video
US10915986B2 (en) * 2017-03-20 2021-02-09 Qualcomm Incorporated Adaptive perturbed cube map projection
US10467775B1 (en) * 2017-05-03 2019-11-05 Amazon Technologies, Inc. Identifying pixel locations using a transformation function
US10469751B2 (en) * 2017-05-12 2019-11-05 Garmin Switzerland Gmbh Smart stabilization and reorientation for an omnidirectional camera
GB201713052D0 (en) * 2017-08-15 2017-09-27 Imagination Tech Ltd Single pass rendering for head mounted displays
TWI640747B (zh) * 2017-11-28 2018-11-11 寶成工業股份有限公司 鞋件的視覺檢測裝置
EP3745719B1 (en) * 2018-01-23 2025-10-01 LG Electronics Inc. Method and apparatus for transmitting or receiving 360-degree video including camera lens information
US20190236416A1 (en) * 2018-01-31 2019-08-01 Microsoft Technology Licensing, Llc Artificial intelligence system utilizing microphone array and fisheye camera
US11245919B2 (en) * 2018-03-16 2022-02-08 Sony Corporation Image processing device and image processing method
CN110351492B (zh) * 2018-04-06 2021-11-19 中兴通讯股份有限公司 一种视频数据处理方法、装置及介质
TWI681366B (zh) * 2018-05-31 2020-01-01 廣達電腦股份有限公司 非線性延展裁切影像之方法及系統
US10878595B2 (en) * 2018-07-02 2020-12-29 Intel Corporation Dual model for fisheye lens distortion and an algorithm for calibrating model parameters
CN120876699A (zh) * 2018-09-26 2025-10-31 相干逻辑公司 任何世界视图生成
EP3651119A1 (en) * 2018-11-06 2020-05-13 Koninklijke Philips N.V. Disparity estimation from a wide angle image
CN111263037B (zh) * 2018-11-30 2023-04-18 株式会社理光 图像处理装置、拍摄装置、视频播放系统、方法以及程序
US11756153B2 (en) * 2018-12-31 2023-09-12 Intel Corporation Hemisphere cube map projection format in imaging environments
US10812921B1 (en) 2019-04-30 2020-10-20 Microsoft Technology Licensing, Llc Audio stream processing for distributed device meeting
US11875796B2 (en) 2019-04-30 2024-01-16 Microsoft Technology Licensing, Llc Audio-visual diarization to identify meeting attendees
WO2020250387A1 (ja) * 2019-06-13 2020-12-17 日本電気株式会社 画像処理装置、画像処理方法及びプログラム
US11822081B2 (en) * 2019-08-29 2023-11-21 Apple Inc. Optical module for head-mounted device
US11885965B1 (en) 2019-09-23 2024-01-30 Apple Inc. Head-mounted display and display modules thereof
KR102263540B1 (ko) * 2019-09-27 2021-06-14 (주)베이다스 왜곡 영상 내에 gt 영역 설정 방법 및 장치
US11127111B2 (en) * 2019-11-14 2021-09-21 Qualcomm Incorporated Selective allocation of processing resources for processing image data
CN110930299A (zh) * 2019-12-06 2020-03-27 杭州视洞科技有限公司 一种基于半球展开的圆形鱼眼视频显示方案
CN111787300B (zh) * 2020-07-29 2022-07-01 北京金山云网络技术有限公司 Vr视频的处理方法、装置及电子设备
CN112565730B (zh) * 2020-12-03 2023-07-25 阿波罗智联(北京)科技有限公司 路侧感知方法、装置、电子设备、存储介质及路侧设备
CN112669429A (zh) * 2021-01-07 2021-04-16 稿定（厦门）科技有限公司 图像扭曲渲染方法及装置
JPWO2022210661A1 (cg-RX-API-DMAC7.html) * 2021-03-30 2022-10-06
US11720995B2 (en) 2021-06-04 2023-08-08 Ford Global Technologies, Llc Image rectification
CN117616447A (zh) 2021-07-09 2024-02-27 三星电子株式会社 电子装置和电子装置的操作方法
CN115222615B (zh) * 2022-05-20 2025-09-19 云南北方光电仪器有限公司 一种视频图像数据实时校正方法及存储介质
CN115100026B (zh) * 2022-06-15 2023-07-14 佳都科技集团股份有限公司 基于目标对象的标签坐标转换方法、装置、设备及存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0793526A (ja) * 1993-02-08 1995-04-07 Telerobotics Internatl Inc 全視覚静止カメラ監視システム
US20050062869A1 (en) * 1999-04-08 2005-03-24 Zimmermann Steven Dwain Immersive video presentations
JP2009124627A (ja) * 2007-11-19 2009-06-04 Alps Electric Co Ltd 撮像装置
JP2016506693A (ja) * 2013-01-04 2016-03-03 クゥアルコム・インコーポレイテッドＱｕａｌｃｏｍｍ Ｉｎｃｏｒｐｏｒａｔｅｄ マルチビューコード化プラス深度のためのトラックにおけるテクスチャビューと深度ビューの存在の指示

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5185667A (en) * 1991-05-13 1993-02-09 Telerobotics International, Inc. Omniview motionless camera orientation system
US6002430A (en) 1994-01-31 1999-12-14 Interactive Pictures Corporation Method and apparatus for simultaneous capture of a spherical image
US5796426A (en) * 1994-05-27 1998-08-18 Warp, Ltd. Wide-angle image dewarping method and apparatus
CN1125568C (zh) * 1996-01-22 2003-10-22 松下电器产业株式会社 预测图像解码方法以及预测图像编码方法
US6833843B2 (en) * 2001-12-03 2004-12-21 Tempest Microsystems Panoramic imaging and display system with canonical magnifier
US7308131B2 (en) * 2002-12-03 2007-12-11 Ntt Docomo, Inc. Representation and coding of panoramic and omnidirectional images
US7336299B2 (en) * 2003-07-03 2008-02-26 Physical Optics Corporation Panoramic video system with real-time distortion-free imaging
US8594180B2 (en) * 2007-02-21 2013-11-26 Qualcomm Incorporated 3D video encoding
JP4629131B2 (ja) * 2008-09-03 2011-02-09 大日本印刷株式会社 画像変換装置
JP5046132B2 (ja) * 2008-12-24 2012-10-10 株式会社富士通ゼネラル 画像データ変換装置
US9124874B2 (en) * 2009-06-05 2015-09-01 Qualcomm Incorporated Encoding of three-dimensional conversion information with two-dimensional video sequence
JP5843033B1 (ja) * 2014-05-15 2016-01-13 株式会社リコー 撮像システム、撮像装置、プログラムおよびシステム
US10104361B2 (en) * 2014-11-14 2018-10-16 Samsung Electronics Co., Ltd. Coding of 360 degree videos using region adaptive smoothing

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0793526A (ja) * 1993-02-08 1995-04-07 Telerobotics Internatl Inc 全視覚静止カメラ監視システム
US20050062869A1 (en) * 1999-04-08 2005-03-24 Zimmermann Steven Dwain Immersive video presentations
JP2009124627A (ja) * 2007-11-19 2009-06-04 Alps Electric Co Ltd 撮像装置
JP2016506693A (ja) * 2013-01-04 2016-03-03 クゥアルコム・インコーポレイテッドＱｕａｌｃｏｍｍ Ｉｎｃｏｒｐｏｒａｔｅｄ マルチビューコード化プラス深度のためのトラックにおけるテクスチャビューと深度ビューの存在の指示

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
PAUL BOURKE: "Computer generated angular fisheye projections", INTERNET CITATION, JPN7021002391, 1 May 2001 (2001-05-01), ISSN: 0004544810 *
YASUSHI YAGI: "Omnidirectional Sensing and Its Applications", IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, vol. 82, no. 3, JPN7021002390, 25 March 1999 (1999-03-25), pages 568 - 579, ISSN: 0004544811 *

Also Published As

Publication number Publication date
WO2017204971A1 (en) 2017-11-30
SG11201808923QA (en) 2018-12-28
CN109155056B (zh) 2023-07-21
US20170345136A1 (en) 2017-11-30
KR20190009753A (ko) 2019-01-29
CN109155056A (zh) 2019-01-04
BR112018073986A2 (pt) 2019-02-26
KR102373921B1 (ko) 2022-03-11
US10699389B2 (en) 2020-06-30
TW201742435A (zh) 2017-12-01
EP3465607B1 (en) 2021-02-17
EP3465607A1 (en) 2019-04-10

Similar Documents

Publication Publication Date Title
KR102373921B1 (ko) ３６０ 도 비디오에 대한 렌즈 왜곡 보정을 갖는 어안 렌더링
US11798166B2 (en) Sphere pole projections for efficient compression of 360-degree video
US10915986B2 (en) Adaptive perturbed cube map projection
US10620441B2 (en) Viewport-aware quality metric for 360-degree video
US10904531B2 (en) Adaptive parameters for coding of 360-degree video
US10319071B2 (en) Truncated square pyramid geometry and frame packing structure for representing virtual reality video content
US20180276789A1 (en) Sphere equator projection for efficient compression of 360-degree video

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20181127

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200406

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20200406

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20210519

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20210531

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210705

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20220214