CN109074161B - 用于360度视频的混合图形及像素域架构 - Google Patents

用于360度视频的混合图形及像素域架构 Download PDF

Info

Publication number
CN109074161B
CN109074161B CN201780024291.XA CN201780024291A CN109074161B CN 109074161 B CN109074161 B CN 109074161B CN 201780024291 A CN201780024291 A CN 201780024291A CN 109074161 B CN109074161 B CN 109074161B
Authority
CN
China
Prior art keywords
video
video data
tiles
user
graphics
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201780024291.XA
Other languages
English (en)
Chinese (zh)
Other versions
CN109074161A (zh
Inventor
维贾雅拉克希米·拉贾孙达拉姆·拉韦恩德拉恩
米纳·艾曼·萨利赫·扬尼·马卡尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of CN109074161A publication Critical patent/CN109074161A/zh
Application granted granted Critical
Publication of CN109074161B publication Critical patent/CN109074161B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/349—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking
    • H04N13/351—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking for displaying simultaneously
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/06—Topological mapping of higher dimensional structures onto lower dimensional surfaces
    • G06T3/073—Transforming surfaces of revolution to planar images, e.g. cylindrical surfaces to planar images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Image Analysis (AREA)
CN201780024291.XA 2016-05-06 2017-03-10 用于360度视频的混合图形及像素域架构 Active CN109074161B (zh)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201662332918P 2016-05-06 2016-05-06
US62/332,918 2016-05-06
US15/269,157 US11228754B2 (en) 2016-05-06 2016-09-19 Hybrid graphics and pixel domain architecture for 360 degree video
US15/269,157 2016-09-19
PCT/US2017/021914 WO2017192207A1 (en) 2016-05-06 2017-03-10 Hybrid graphics and pixel domain architecture for 360 degree video

Publications (2)

Publication Number Publication Date
CN109074161A CN109074161A (zh) 2018-12-21
CN109074161B true CN109074161B (zh) 2021-10-01

Family

ID=58455654

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201780024291.XA Active CN109074161B (zh) 2016-05-06 2017-03-10 用于360度视频的混合图形及像素域架构

Country Status (7)

Country Link
US (1) US11228754B2 (enExample)
EP (1) EP3452978A1 (enExample)
JP (1) JP2019517191A (enExample)
KR (1) KR20190004280A (enExample)
CN (1) CN109074161B (enExample)
BR (1) BR112018072791A2 (enExample)
WO (1) WO2017192207A1 (enExample)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3301929A1 (en) * 2016-09-30 2018-04-04 Thomson Licensing Method and apparatus for encoding and decoding a large field of view video
EP3301928A1 (en) * 2016-09-30 2018-04-04 Thomson Licensing Methods, devices and stream to encode global rotation motion compensated images
US10536691B2 (en) * 2016-10-04 2020-01-14 Facebook, Inc. Controls and interfaces for user interactions in virtual spaces
WO2018129186A1 (en) 2017-01-04 2018-07-12 Nvidia Corporation Stereoscopic rendering using raymarching and a virtual view broadcaster for such rendering
AU2018218182B2 (en) 2017-02-08 2022-12-15 Immersive Robotics Pty Ltd Antenna control for mobile device communication
US10819907B2 (en) * 2017-03-30 2020-10-27 Mediatek Inc. Method and apparatus for signaling spherical region information in ISOBMFF
AU2018252853A1 (en) * 2017-04-13 2019-12-05 Lg Electronics Inc. Image encoding/decoding method and device therefor
CN110999287A (zh) * 2017-06-05 2020-04-10 因默希弗机器人私人有限公司 数字内容流压缩
WO2019100108A1 (en) 2017-11-21 2019-05-31 Immersive Robotics Pty Ltd Image compression for digital reality
TWI875684B (zh) 2017-11-21 2025-03-11 澳大利亞商伊門斯機器人控股有限公司 用於影像壓縮之頻率分量選擇
US10812828B2 (en) 2018-04-10 2020-10-20 At&T Intellectual Property I, L.P. System and method for segmenting immersive video
US10567780B2 (en) * 2018-06-14 2020-02-18 Telefonaktiebolaget Lm Ericsson (Publ) System and method for encoding 360° immersive video
WO2020009344A1 (ko) 2018-07-06 2020-01-09 엘지전자 주식회사 360 비디오 데이터의 서브픽처 기반 처리 방법 및 그 장치
US10939139B2 (en) 2018-11-29 2021-03-02 Apple Inc. Adaptive coding and streaming of multi-directional video
US11397909B2 (en) * 2019-07-02 2022-07-26 Tattle Systems Technology Inc. Long term sensor monitoring for remote assets
US10972753B1 (en) 2019-09-13 2021-04-06 Apple Inc. Versatile tile coding for multi-view video streaming
US11956295B2 (en) 2019-09-27 2024-04-09 Apple Inc. Client-end enhanced view prediction for multi-view video streaming exploiting pre-fetched data and side information
WO2021072498A1 (en) 2019-10-18 2021-04-22 Immersive Robotics Pty Ltd Content compression for network transmission
US11184601B2 (en) * 2019-12-19 2021-11-23 Shenzhen Yunyinggu Technology Co., Ltd. Apparatus and method for display encoding
US11343439B2 (en) * 2020-01-30 2022-05-24 Semiconductor Components Industries, Llc High dynamic range imaging pixels with multiple photodiodes
US11743442B2 (en) * 2020-11-09 2023-08-29 Tencent America LLC Bitstream structure for immersive teleconferencing and telepresence for remote terminals

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1625246A (zh) * 1999-11-29 2005-06-08 索尼公司 处理和浏览所提供的视频/音频信号的方法和设备

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2002334705A1 (en) 2001-09-27 2003-04-07 Eyesee360, Inc. System and method for panoramic imaging
US20030095131A1 (en) * 2001-11-08 2003-05-22 Michael Rondinelli Method and apparatus for processing photographic images
US7495659B2 (en) 2003-11-25 2009-02-24 Apple Inc. Touch pad for handheld device
US8992318B2 (en) 2012-09-26 2015-03-31 Igt Wearable display system and method
US20140098185A1 (en) * 2012-10-09 2014-04-10 Shahram Davari Interactive user selected video/audio views by real time stitching and selective delivery of multiple video/audio sources
JP6432029B2 (ja) 2013-05-26 2018-12-05 ピクセルロット エルティーディー．Ｐｉｘｅｌｌｏｔ Ｌｔｄ． 低コストでテレビ番組を制作する方法及びシステム
US9699437B2 (en) 2014-03-03 2017-07-04 Nextvr Inc. Methods and apparatus for streaming content
US9905046B2 (en) 2014-04-03 2018-02-27 Intel Corporation Mapping multi-rate shading to monolithic programs
JP6075889B2 (ja) 2014-06-10 2017-02-08 日本電信電話株式会社 映像配信装置及び映像再生装置
JP6471418B2 (ja) 2014-06-25 2019-02-20 株式会社リコー 画像・音声配信システム、画像・音声配信装置および画像・音声配信プログラム
US9449363B2 (en) 2014-06-27 2016-09-20 Intel Corporation Sampling, fault management, and/or context switching via a compute pipeline
US10204658B2 (en) 2014-07-14 2019-02-12 Sony Interactive Entertainment Inc. System and method for use in playing back panorama video content
US9704213B2 (en) 2014-08-13 2017-07-11 Qualcomm Incorporated Texture element streaming
US9558718B2 (en) 2014-09-03 2017-01-31 Qualcomm Incorporated Streaming video data in the graphics domain
US10484697B2 (en) 2014-09-09 2019-11-19 Qualcomm Incorporated Simultaneous localization and mapping for video coding
US10021161B2 (en) 2014-11-05 2018-07-10 Qualcomm Incorporated Compression of graphical commands for remote display
US20160241838A1 (en) * 2015-02-17 2016-08-18 Nextvr Inc. Methods and apparatus for generating and using reduced resolution images and/or communicating such images to a playback or content distribution device

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1625246A (zh) * 1999-11-29 2005-06-08 索尼公司 处理和浏览所提供的视频/音频信号的方法和设备

Also Published As

Publication number Publication date
US20170324951A1 (en) 2017-11-09
JP2019517191A (ja) 2019-06-20
WO2017192207A1 (en) 2017-11-09
CN109074161A (zh) 2018-12-21
BR112018072791A2 (pt) 2019-03-12
US11228754B2 (en) 2022-01-18
EP3452978A1 (en) 2019-03-13
KR20190004280A (ko) 2019-01-11

Similar Documents

Publication Publication Date Title
CN109074161B (zh) 用于360度视频的混合图形及像素域架构
US10620441B2 (en) Viewport-aware quality metric for 360-degree video
CN111937396B (zh) 基于子图像码流视角相关视频编码中的误差抑制的文件格式指示
TWI712313B (zh) 感興趣區之發信號之系統及方法
JP2022537576A (ja) ビデオエンコーディングおよびデコーディングのための装置、方法、およびコンピュータプログラム
EP3934255B1 (en) Executable program implementing an encoding and a decoding method
RU2559691C2 (ru) Способ декодирования, декодер, программный продукт, программное приложение для мобильного устройства беспроводной связи и электронный потребительский продукт
US12294716B2 (en) Image encoding/decoding method and device for signaling HLS, and computer-readable recording medium in which bitstream is stored
TW201840178A (zh) 適應性擾動立方體之地圖投影
JP2022513715A (ja) 無指向性媒体符号化及び復号のためのラップアラウンドパディングの方法
AU2018239448A1 (en) Sphere equator projection for efficient compression of 360-degree video
TW201911863A (zh) 用於360度視訊寫碼之參考圖推導及動作補償
JP2020526958A (ja) コンテナファイルおよびビデオビットストリームにおける関心領域の発展型シグナリング
TW201742435A (zh) 具有用於360度視訊之透鏡失真校正之魚眼呈現
CN110121065B (zh) 空间排序视频编码应用中的多向图像处理
CN113632463A (zh) 用视频码流中的偏移对参考图片进行重采样的方法
CN114127800A (zh) 已编码视频流中跨层对齐的方法
CN115022715B (zh) 一种沉浸媒体的数据处理方法及设备
KR102768259B1 (ko) 비디오 코딩에서의 널 타일 코딩
US12328440B2 (en) Method and apparatus for encoding/decoding image on basis of CPI SEI message, and recording medium having bitstream stored therein
HK40055144A (en) Video decoding method, encoding method, decoding device and electronic device
HK40090345A (zh) 使用众包生成全息或光场视图
HK40035758B (en) Video decoding method and apparatus, and computer-readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant