CN113366825B - 用于生成表示场景的图像信号的装置和方法 - Google Patents

用于生成表示场景的图像信号的装置和方法 Download PDF

Info

Publication number
CN113366825B
CN113366825B CN202080011498.5A CN202080011498A CN113366825B CN 113366825 B CN113366825 B CN 113366825B CN 202080011498 A CN202080011498 A CN 202080011498A CN 113366825 B CN113366825 B CN 113366825B
Authority
CN
China
Prior art keywords
image
ray
pixel
scene
origin
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202080011498.5A
Other languages
English (en)
Chinese (zh)
Other versions
CN113366825A (zh
Inventor
W·H·A·布鲁斯
C·韦雷坎普
B·克龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of CN113366825A publication Critical patent/CN113366825A/zh
Application granted granted Critical
Publication of CN113366825B publication Critical patent/CN113366825B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/06—Ray-tracing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H04N13/178—Metadata, e.g. disparity information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Library & Information Science (AREA)
  • Databases & Information Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Graphics (AREA)
  • Processing Or Creating Images (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Image Processing (AREA)
CN202080011498.5A 2019-01-29 2020-01-17 用于生成表示场景的图像信号的装置和方法 Active CN113366825B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP19154195.2 2019-01-29
EP19154195.2A EP3691249A1 (en) 2019-01-29 2019-01-29 Image signal representing a scene
PCT/EP2020/051075 WO2020156827A1 (en) 2019-01-29 2020-01-17 Image signal representing a scene

Publications (2)

Publication Number Publication Date
CN113366825A CN113366825A (zh) 2021-09-07
CN113366825B true CN113366825B (zh) 2024-06-14

Family

ID=65268744

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202080011498.5A Active CN113366825B (zh) 2019-01-29 2020-01-17 用于生成表示场景的图像信号的装置和方法

Country Status (12)

Country Link
US (1) US12249020B2 (enExample)
EP (2) EP3691249A1 (enExample)
JP (1) JP7479386B2 (enExample)
KR (1) KR102731194B1 (enExample)
CN (1) CN113366825B (enExample)
BR (1) BR112021014627A2 (enExample)
CA (1) CA3127847A1 (enExample)
MX (1) MX2021008953A (enExample)
PH (1) PH12021551793A1 (enExample)
TW (1) TWI846808B (enExample)
WO (1) WO2020156827A1 (enExample)
ZA (1) ZA202106244B (enExample)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3945720A1 (en) 2020-07-31 2022-02-02 Koninklijke Philips N.V. Packing of views for image or video coding
US12002146B2 (en) * 2022-03-28 2024-06-04 Snap Inc. 3D modeling based on neural light field
EP4297400A1 (en) * 2022-06-22 2023-12-27 Koninklijke Philips N.V. Data signal comprising a representation of a three dimensional scene
CN117496783B (zh) * 2023-12-14 2026-03-03 北京数易科技有限公司 一种基于虚拟现实的单兵训练方法、系统及介质

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3419301A1 (en) * 2016-02-17 2018-12-26 Samsung Electronics Co., Ltd. Method for transmitting and receiving metadata of omnidirectional image

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4625957B2 (ja) * 2005-10-07 2011-02-02 国立大学法人 東京大学 全周囲ステレオ画像撮影装置
US8350846B2 (en) 2009-01-28 2013-01-08 International Business Machines Corporation Updating ray traced acceleration data structures between frames based on changing perspective
US20150189140A1 (en) * 2009-02-23 2015-07-02 Gary Edwin Sutton Curved sensor array camera
US8442306B2 (en) * 2010-08-13 2013-05-14 Mitsubishi Electric Research Laboratories, Inc. Volume-based coverage analysis for sensor placement in 3D environments
US8638989B2 (en) 2012-01-17 2014-01-28 Leap Motion, Inc. Systems and methods for capturing motion in three-dimensional space
US9086558B2 (en) * 2013-03-05 2015-07-21 Apple Inc. Small form factor high-resolution camera
CN104299258A (zh) * 2013-07-15 2015-01-21 超威半导体(上海)有限公司 立体图形处理方法和设备
JP5920897B2 (ja) * 2014-07-03 2016-05-18 株式会社ソニー・インタラクティブエンタテインメント 画像生成装置および画像生成方法
US10750153B2 (en) * 2014-09-22 2020-08-18 Samsung Electronics Company, Ltd. Camera system for three-dimensional video
DE102016103891A1 (de) 2015-03-03 2016-09-08 Imagination Technologies Limited Systeme und Verfahren zur weichen Schattierung in 3D-Rendering
US10341632B2 (en) * 2015-04-15 2019-07-02 Google Llc. Spatial random access enabled video system with a three-dimensional viewing volume
US10638119B2 (en) * 2015-05-05 2020-04-28 Koninklijke Philips N.V. Generation of image for an autostereoscopic display
US20170363949A1 (en) * 2015-05-27 2017-12-21 Google Inc Multi-tier camera rig for stereoscopic image capture
JP6427688B2 (ja) * 2015-05-27 2018-11-21 グーグル エルエルシー パノラマバーチャルリアリティコンテンツの全方位ステレオキャプチャおよびレンダリング
EP3144888A1 (en) * 2015-09-17 2017-03-22 Thomson Licensing An apparatus and a method for generating data representing a pixel beam
WO2017149875A1 (ja) 2016-02-29 2017-09-08 ソニー株式会社 撮像制御装置、撮像装置及び撮像制御方法
US10200624B2 (en) * 2016-04-06 2019-02-05 Facebook, Inc. Three-dimensional, 360-degree virtual reality exposure control
DE202017104934U1 (de) 2016-08-17 2017-11-20 Google Inc. Mehrstufiges Kameraträgersystem für die stereoskope Bildaufnahme
KR102358757B1 (ko) * 2016-08-25 2022-02-07 엘지전자 주식회사 전방향 비디오를 전송하는 방법, 전방향 비디오를 수신하는 방법, 전방향 비디오 전송 장치, 전방향 비디오 수신 장치
KR102697559B1 (ko) * 2016-12-22 2024-08-23 삼성전자주식회사 영상 표시 방법, 저장 매체 및 전자 장치
EP3616403A1 (en) * 2017-04-27 2020-03-04 Google LLC Synthetic stereoscopic content capture
US10373362B2 (en) * 2017-07-06 2019-08-06 Humaneyes Technologies Ltd. Systems and methods for adaptive stitching of digital images
US11178377B2 (en) * 2017-07-12 2021-11-16 Mediatek Singapore Pte. Ltd. Methods and apparatus for spherical region presentation
US10950043B1 (en) * 2018-04-03 2021-03-16 A9.Com, Inc. Rendering three-dimensional models on mobile devices
EP3690822A1 (en) 2019-01-30 2020-08-05 Koninklijke Philips N.V. Image representation of a scene

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3419301A1 (en) * 2016-02-17 2018-12-26 Samsung Electronics Co., Ltd. Method for transmitting and receiving metadata of omnidirectional image

Also Published As

Publication number Publication date
KR102731194B1 (ko) 2024-11-19
US20220165015A1 (en) 2022-05-26
CN113366825A (zh) 2021-09-07
PH12021551793A1 (en) 2022-03-21
TWI846808B (zh) 2024-07-01
MX2021008953A (es) 2021-08-24
CA3127847A1 (en) 2020-08-06
EP3918782A1 (en) 2021-12-08
JP7479386B2 (ja) 2024-05-08
WO2020156827A1 (en) 2020-08-06
US12249020B2 (en) 2025-03-11
EP3691249A1 (en) 2020-08-05
ZA202106244B (en) 2023-04-26
KR20210118458A (ko) 2021-09-30
JP2022518285A (ja) 2022-03-14
TW202034688A (zh) 2020-09-16
BR112021014627A2 (pt) 2021-10-05

Similar Documents

Publication Publication Date Title
CN113795863B (zh) 用于图像的深度图的处理
CN113366825B (zh) 用于生成表示场景的图像信号的装置和方法
TW201921318A (zh) 用於產生場景之舖磚式三維影像表示之設備及方法
US20250184467A1 (en) Image signal representing a scene
TWI878371B (zh) 影像合成系統及其方法
TWI850320B (zh) 場景的影像表示
JP7556352B2 (ja) 画像特性画素構造の生成および処理
TWI917319B (zh) 表示場景之影像信號

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant