CN109155056B - 具有用于360度视频的透镜失真校正的鱼眼呈现 - Google Patents

具有用于360度视频的透镜失真校正的鱼眼呈现 Download PDF

Info

Publication number
CN109155056B
CN109155056B CN201780028837.9A CN201780028837A CN109155056B CN 109155056 B CN109155056 B CN 109155056B CN 201780028837 A CN201780028837 A CN 201780028837A CN 109155056 B CN109155056 B CN 109155056B
Authority
CN
China
Prior art keywords
image
mapping
dimensional
video
video data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201780028837.9A
Other languages
English (en)
Chinese (zh)
Other versions
CN109155056A (zh
Inventor
G·范德奥维拉
M·科班
M·卡切维奇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of CN109155056A publication Critical patent/CN109155056A/zh
Application granted granted Critical
Publication of CN109155056B publication Critical patent/CN109155056B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/80—Geometric correction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/18—Image warping, e.g. rearranging pixels individually
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/08—Projecting images onto non-planar surfaces, e.g. geodetic screens
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Processing (AREA)
  • Studio Devices (AREA)
  • Geometry (AREA)
  • Controls And Circuits For Display Device (AREA)
CN201780028837.9A 2016-05-24 2017-04-25 具有用于360度视频的透镜失真校正的鱼眼呈现 Active CN109155056B (zh)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201662340914P 2016-05-24 2016-05-24
US62/340,914 2016-05-24
US15/495,709 US10699389B2 (en) 2016-05-24 2017-04-24 Fisheye rendering with lens distortion correction for 360-degree video
US15/495,709 2017-04-24
PCT/US2017/029441 WO2017204971A1 (en) 2016-05-24 2017-04-25 Fisheye rendering with lens distortion correction for 360-degree video

Publications (2)

Publication Number Publication Date
CN109155056A CN109155056A (zh) 2019-01-04
CN109155056B true CN109155056B (zh) 2023-07-21

Family

ID=58800890

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201780028837.9A Active CN109155056B (zh) 2016-05-24 2017-04-25 具有用于360度视频的透镜失真校正的鱼眼呈现

Country Status (9)

Country Link
US (1) US10699389B2 (enExample)
EP (1) EP3465607B1 (enExample)
JP (1) JP2019523921A (enExample)
KR (1) KR102373921B1 (enExample)
CN (1) CN109155056B (enExample)
BR (1) BR112018073986A2 (enExample)
SG (1) SG11201808923QA (enExample)
TW (1) TW201742435A (enExample)
WO (1) WO2017204971A1 (enExample)

Families Citing this family (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10200672B2 (en) * 2016-08-17 2019-02-05 Nextvr Inc. Methods and apparatus for capturing images of an environment
US20190238888A1 (en) 2017-07-17 2019-08-01 Ki Baek Kim Image data encoding/decoding method and apparatus
KR20230010060A (ko) 2016-10-04 2023-01-17 주식회사 비원영상기술연구소 영상 데이터 부호화/복호화 방법 및 장치
CN107967665B (zh) * 2016-10-20 2021-07-13 株式会社理光 图像处理方法和图像处理装置
US10332242B2 (en) 2017-02-02 2019-06-25 OrbViu Inc. Method and system for reconstructing 360-degree video
US10915986B2 (en) * 2017-03-20 2021-02-09 Qualcomm Incorporated Adaptive perturbed cube map projection
US10467775B1 (en) * 2017-05-03 2019-11-05 Amazon Technologies, Inc. Identifying pixel locations using a transformation function
US10469751B2 (en) * 2017-05-12 2019-11-05 Garmin Switzerland Gmbh Smart stabilization and reorientation for an omnidirectional camera
GB201713052D0 (en) * 2017-08-15 2017-09-27 Imagination Tech Ltd Single pass rendering for head mounted displays
TWI640747B (zh) * 2017-11-28 2018-11-11 寶成工業股份有限公司 鞋件的視覺檢測裝置
EP3745719B1 (en) * 2018-01-23 2025-10-01 LG Electronics Inc. Method and apparatus for transmitting or receiving 360-degree video including camera lens information
US20190236416A1 (en) * 2018-01-31 2019-08-01 Microsoft Technology Licensing, Llc Artificial intelligence system utilizing microphone array and fisheye camera
CN111837394B (zh) * 2018-03-16 2024-01-26 索尼公司 图像处理装置和图像处理方法
CN110351492B (zh) * 2018-04-06 2021-11-19 中兴通讯股份有限公司 一种视频数据处理方法、装置及介质
TWI681366B (zh) * 2018-05-31 2020-01-01 廣達電腦股份有限公司 非線性延展裁切影像之方法及系統
US10878595B2 (en) * 2018-07-02 2020-12-29 Intel Corporation Dual model for fisheye lens distortion and an algorithm for calibrating model parameters
CN112930557B (zh) * 2018-09-26 2025-09-02 相干逻辑公司 任何世界视图生成
EP3651119A1 (en) * 2018-11-06 2020-05-13 Koninklijke Philips N.V. Disparity estimation from a wide angle image
US11128814B2 (en) * 2018-11-30 2021-09-21 Vecnos Inc. Image processing apparatus, image capturing apparatus, video reproducing system, method and program
US11756153B2 (en) * 2018-12-31 2023-09-12 Intel Corporation Hemisphere cube map projection format in imaging environments
US10812921B1 (en) 2019-04-30 2020-10-20 Microsoft Technology Licensing, Llc Audio stream processing for distributed device meeting
US11875796B2 (en) 2019-04-30 2024-01-16 Microsoft Technology Licensing, Llc Audio-visual diarization to identify meeting attendees
US11822081B2 (en) 2019-08-29 2023-11-21 Apple Inc. Optical module for head-mounted device
US11885965B1 (en) 2019-09-23 2024-01-30 Apple Inc. Head-mounted display and display modules thereof
KR102263540B1 (ko) * 2019-09-27 2021-06-14 (주)베이다스 왜곡 영상 내에 gt 영역 설정 방법 및 장치
US11127111B2 (en) * 2019-11-14 2021-09-21 Qualcomm Incorporated Selective allocation of processing resources for processing image data
CN110930299A (zh) * 2019-12-06 2020-03-27 杭州视洞科技有限公司 一种基于半球展开的圆形鱼眼视频显示方案
CN111787300B (zh) * 2020-07-29 2022-07-01 北京金山云网络技术有限公司 Vr视频的处理方法、装置及电子设备
CN112565730B (zh) * 2020-12-03 2023-07-25 阿波罗智联(北京)科技有限公司 路侧感知方法、装置、电子设备、存储介质及路侧设备
CN112669429A (zh) * 2021-01-07 2021-04-16 稿定（厦门）科技有限公司 图像扭曲渲染方法及装置
JPWO2022210661A1 (enExample) * 2021-03-30 2022-10-06
US11720995B2 (en) 2021-06-04 2023-08-08 Ford Global Technologies, Llc Image rectification
CN117616447A (zh) 2021-07-09 2024-02-27 三星电子株式会社 电子装置和电子装置的操作方法
CN115222615B (zh) * 2022-05-20 2025-09-19 云南北方光电仪器有限公司 一种视频图像数据实时校正方法及存储介质
CN115100026B (zh) * 2022-06-15 2023-07-14 佳都科技集团股份有限公司 基于目标对象的标签坐标转换方法、装置、设备及存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1209933A (zh) * 1996-01-22 1999-03-03 松下电器产业株式会社 数字图像编码解码方法及使用它的数字图像编码解码装置
US6002430A (en) * 1994-01-31 1999-12-14 Interactive Pictures Corporation Method and apparatus for simultaneous capture of a spherical image
CN101627635A (zh) * 2007-02-21 2010-01-13 高通股份有限公司 三维视频编码

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5359363A (en) * 1991-05-13 1994-10-25 Telerobotics International, Inc. Omniview motionless camera surveillance system
US5185667A (en) * 1991-05-13 1993-02-09 Telerobotics International, Inc. Omniview motionless camera orientation system
US5796426A (en) * 1994-05-27 1998-08-18 Warp, Ltd. Wide-angle image dewarping method and apparatus
AU4336400A (en) * 1999-04-08 2000-10-23 Internet Pictures Corporation Method and apparatus for providing virtual processing effects for wide-angle video images
US6833843B2 (en) * 2001-12-03 2004-12-21 Tempest Microsystems Panoramic imaging and display system with canonical magnifier
US7308131B2 (en) * 2002-12-03 2007-12-11 Ntt Docomo, Inc. Representation and coding of panoramic and omnidirectional images
US7336299B2 (en) * 2003-07-03 2008-02-26 Physical Optics Corporation Panoramic video system with real-time distortion-free imaging
JP4975592B2 (ja) * 2007-11-19 2012-07-11 アルプス電気株式会社 撮像装置
JP4629131B2 (ja) * 2008-09-03 2011-02-09 大日本印刷株式会社 画像変換装置
JP5046132B2 (ja) * 2008-12-24 2012-10-10 株式会社富士通ゼネラル 画像データ変換装置
US9124874B2 (en) * 2009-06-05 2015-09-01 Qualcomm Incorporated Encoding of three-dimensional conversion information with two-dimensional video sequence
US9357199B2 (en) * 2013-01-04 2016-05-31 Qualcomm Incorporated Separate track storage of texture and depth views for multiview coding plus depth
JP5843033B1 (ja) * 2014-05-15 2016-01-13 株式会社リコー 撮像システム、撮像装置、プログラムおよびシステム
US10104361B2 (en) * 2014-11-14 2018-10-16 Samsung Electronics Co., Ltd. Coding of 360 degree videos using region adaptive smoothing

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6002430A (en) * 1994-01-31 1999-12-14 Interactive Pictures Corporation Method and apparatus for simultaneous capture of a spherical image
CN1209933A (zh) * 1996-01-22 1999-03-03 松下电器产业株式会社 数字图像编码解码方法及使用它的数字图像编码解码装置
US7016544B2 (en) * 1996-01-22 2006-03-21 Matsushita Electric Industrial Co., Ltd. Digital image encoding and decoding method and digital image encoding and decoding device using the same
CN101627635A (zh) * 2007-02-21 2010-01-13 高通股份有限公司 三维视频编码

Also Published As

Publication number Publication date
TW201742435A (zh) 2017-12-01
KR102373921B1 (ko) 2022-03-11
EP3465607B1 (en) 2021-02-17
BR112018073986A2 (pt) 2019-02-26
EP3465607A1 (en) 2019-04-10
CN109155056A (zh) 2019-01-04
SG11201808923QA (en) 2018-12-28
US20170345136A1 (en) 2017-11-30
JP2019523921A (ja) 2019-08-29
US10699389B2 (en) 2020-06-30
KR20190009753A (ko) 2019-01-29
WO2017204971A1 (en) 2017-11-30

Similar Documents

Publication Publication Date Title
CN109155056B (zh) 具有用于360度视频的透镜失真校正的鱼眼呈现
US11798166B2 (en) Sphere pole projections for efficient compression of 360-degree video
US10620441B2 (en) Viewport-aware quality metric for 360-degree video
US10915986B2 (en) Adaptive perturbed cube map projection
US10904531B2 (en) Adaptive parameters for coding of 360-degree video
US10319071B2 (en) Truncated square pyramid geometry and frame packing structure for representing virtual reality video content
US10839480B2 (en) Sphere equator projection for efficient compression of 360-degree video

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1259260

Country of ref document: HK

GR01 Patent grant
GR01 Patent grant
REG Reference to a national code

Ref country code: HK

Ref legal event code: WD

Ref document number: 1259260

Country of ref document: HK