JP2019517191A - ３６０度ビデオのためのハイブリッドなグラフィックスおよびピクセル領域アーキテクチャ - Google Patents

３６０度ビデオのためのハイブリッドなグラフィックスおよびピクセル領域アーキテクチャ Download PDF

Info

Publication number
JP2019517191A
JP2019517191A JP2018557810A JP2018557810A JP2019517191A JP 2019517191 A JP2019517191 A JP 2019517191A JP 2018557810 A JP2018557810 A JP 2018557810A JP 2018557810 A JP2018557810 A JP 2018557810A JP 2019517191 A JP2019517191 A JP 2019517191A
Authority
JP
Japan
Prior art keywords
video data
user
video
graphics
adaptation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2018557810A
Other languages
English (en)
Japanese (ja)
Other versions
JP2019517191A5 (enExample
Inventor
ラビーンドラン、ビジャヤラクシュミ・ラジャスンダラム
マカール、ミナ・アイマン・サーレハ・ヤーニ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of JP2019517191A publication Critical patent/JP2019517191A/ja
Publication of JP2019517191A5 publication Critical patent/JP2019517191A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/349—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking
    • H04N13/351—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking for displaying simultaneously
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/06—Topological mapping of higher dimensional structures onto lower dimensional surfaces
    • G06T3/073—Transforming surfaces of revolution to planar images, e.g. cylindrical surfaces to planar images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Image Analysis (AREA)
  • Closed-Circuit Television Systems (AREA)
JP2018557810A 2016-05-06 2017-03-10 ３６０度ビデオのためのハイブリッドなグラフィックスおよびピクセル領域アーキテクチャ Pending JP2019517191A (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201662332918P 2016-05-06 2016-05-06
US62/332,918 2016-05-06
US15/269,157 US11228754B2 (en) 2016-05-06 2016-09-19 Hybrid graphics and pixel domain architecture for 360 degree video
US15/269,157 2016-09-19
PCT/US2017/021914 WO2017192207A1 (en) 2016-05-06 2017-03-10 Hybrid graphics and pixel domain architecture for 360 degree video

Publications (2)

Publication Number Publication Date
JP2019517191A true JP2019517191A (ja) 2019-06-20
JP2019517191A5 JP2019517191A5 (enExample) 2020-03-26

Family

ID=58455654

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018557810A Pending JP2019517191A (ja) 2016-05-06 2017-03-10 ３６０度ビデオのためのハイブリッドなグラフィックスおよびピクセル領域アーキテクチャ

Country Status (7)

Country Link
US (1) US11228754B2 (enExample)
EP (1) EP3452978A1 (enExample)
JP (1) JP2019517191A (enExample)
KR (1) KR20190004280A (enExample)
CN (1) CN109074161B (enExample)
BR (1) BR112018072791A2 (enExample)
WO (1) WO2017192207A1 (enExample)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3301929A1 (en) * 2016-09-30 2018-04-04 Thomson Licensing Method and apparatus for encoding and decoding a large field of view video
EP3301928A1 (en) * 2016-09-30 2018-04-04 Thomson Licensing Methods, devices and stream to encode global rotation motion compensated images
US10536691B2 (en) * 2016-10-04 2020-01-14 Facebook, Inc. Controls and interfaces for user interactions in virtual spaces
WO2018129186A1 (en) 2017-01-04 2018-07-12 Nvidia Corporation Stereoscopic rendering using raymarching and a virtual view broadcaster for such rendering
AU2018218182B2 (en) 2017-02-08 2022-12-15 Immersive Robotics Pty Ltd Antenna control for mobile device communication
US10819907B2 (en) * 2017-03-30 2020-10-27 Mediatek Inc. Method and apparatus for signaling spherical region information in ISOBMFF
AU2018252853A1 (en) * 2017-04-13 2019-12-05 Lg Electronics Inc. Image encoding/decoding method and device therefor
CN110999287A (zh) * 2017-06-05 2020-04-10 因默希弗机器人私人有限公司 数字内容流压缩
WO2019100108A1 (en) 2017-11-21 2019-05-31 Immersive Robotics Pty Ltd Image compression for digital reality
TWI875684B (zh) 2017-11-21 2025-03-11 澳大利亞商伊門斯機器人控股有限公司 用於影像壓縮之頻率分量選擇
US10812828B2 (en) 2018-04-10 2020-10-20 At&T Intellectual Property I, L.P. System and method for segmenting immersive video
US10567780B2 (en) * 2018-06-14 2020-02-18 Telefonaktiebolaget Lm Ericsson (Publ) System and method for encoding 360° immersive video
WO2020009344A1 (ko) 2018-07-06 2020-01-09 엘지전자 주식회사 360 비디오 데이터의 서브픽처 기반 처리 방법 및 그 장치
US10939139B2 (en) 2018-11-29 2021-03-02 Apple Inc. Adaptive coding and streaming of multi-directional video
US11397909B2 (en) * 2019-07-02 2022-07-26 Tattle Systems Technology Inc. Long term sensor monitoring for remote assets
US10972753B1 (en) 2019-09-13 2021-04-06 Apple Inc. Versatile tile coding for multi-view video streaming
US11956295B2 (en) 2019-09-27 2024-04-09 Apple Inc. Client-end enhanced view prediction for multi-view video streaming exploiting pre-fetched data and side information
WO2021072498A1 (en) 2019-10-18 2021-04-22 Immersive Robotics Pty Ltd Content compression for network transmission
US11184601B2 (en) * 2019-12-19 2021-11-23 Shenzhen Yunyinggu Technology Co., Ltd. Apparatus and method for display encoding
US11343439B2 (en) * 2020-01-30 2022-05-24 Semiconductor Components Industries, Llc High dynamic range imaging pixels with multiple photodiodes
US11743442B2 (en) * 2020-11-09 2023-08-29 Tencent America LLC Bitstream structure for immersive teleconferencing and telepresence for remote terminals

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015134400A1 (en) * 2014-03-03 2015-09-11 Nextvr Inc. Methods and apparatus for streaming content
JP2016010021A (ja) * 2014-06-25 2016-01-18 株式会社リコー 画像・音声配信システム、画像・音声配信装置および画像・音声配信プログラム
WO2016010668A1 (en) * 2014-07-14 2016-01-21 Sony Computer Entertainment Inc. System and method for use in playing back panorama video content
JP2016015705A (ja) * 2014-06-10 2016-01-28 日本電信電話株式会社 映像配信装置及び映像再生装置
WO2016040161A1 (en) * 2014-09-09 2016-03-17 Qualcomm Incorporated Simultaneous localization and mapping for video coding

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100348032C (zh) 1999-11-29 2007-11-07 索尼公司 处理和浏览所提供的视频/音频信号的方法和设备
AU2002334705A1 (en) 2001-09-27 2003-04-07 Eyesee360, Inc. System and method for panoramic imaging
US20030095131A1 (en) * 2001-11-08 2003-05-22 Michael Rondinelli Method and apparatus for processing photographic images
US7495659B2 (en) 2003-11-25 2009-02-24 Apple Inc. Touch pad for handheld device
US8992318B2 (en) 2012-09-26 2015-03-31 Igt Wearable display system and method
US20140098185A1 (en) * 2012-10-09 2014-04-10 Shahram Davari Interactive user selected video/audio views by real time stitching and selective delivery of multiple video/audio sources
JP6432029B2 (ja) 2013-05-26 2018-12-05 ピクセルロット エルティーディー．Ｐｉｘｅｌｌｏｔ Ｌｔｄ． 低コストでテレビ番組を制作する方法及びシステム
US9905046B2 (en) 2014-04-03 2018-02-27 Intel Corporation Mapping multi-rate shading to monolithic programs
US9449363B2 (en) 2014-06-27 2016-09-20 Intel Corporation Sampling, fault management, and/or context switching via a compute pipeline
US9704213B2 (en) 2014-08-13 2017-07-11 Qualcomm Incorporated Texture element streaming
US9558718B2 (en) 2014-09-03 2017-01-31 Qualcomm Incorporated Streaming video data in the graphics domain
US10021161B2 (en) 2014-11-05 2018-07-10 Qualcomm Incorporated Compression of graphical commands for remote display
US20160241838A1 (en) * 2015-02-17 2016-08-18 Nextvr Inc. Methods and apparatus for generating and using reduced resolution images and/or communicating such images to a playback or content distribution device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015134400A1 (en) * 2014-03-03 2015-09-11 Nextvr Inc. Methods and apparatus for streaming content
JP2016015705A (ja) * 2014-06-10 2016-01-28 日本電信電話株式会社 映像配信装置及び映像再生装置
JP2016010021A (ja) * 2014-06-25 2016-01-18 株式会社リコー 画像・音声配信システム、画像・音声配信装置および画像・音声配信プログラム
WO2016010668A1 (en) * 2014-07-14 2016-01-21 Sony Computer Entertainment Inc. System and method for use in playing back panorama video content
WO2016040161A1 (en) * 2014-09-09 2016-03-17 Qualcomm Incorporated Simultaneous localization and mapping for video coding

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
DAISUKE OCHI ET AL.: "Live streaming system for omnidirectional video", 2015 IEEE VIRTUAL REALITY (VR), JPN6021008128, 23 March 2015 (2015-03-23), pages 349 - 350, ISSN: 0004614821 *

Also Published As

Publication number Publication date
US20170324951A1 (en) 2017-11-09
WO2017192207A1 (en) 2017-11-09
CN109074161A (zh) 2018-12-21
BR112018072791A2 (pt) 2019-03-12
US11228754B2 (en) 2022-01-18
EP3452978A1 (en) 2019-03-13
CN109074161B (zh) 2021-10-01
KR20190004280A (ko) 2019-01-11

Similar Documents

Publication Publication Date Title
CN109074161B (zh) 用于360度视频的混合图形及像素域架构
TWI712313B (zh) 感興趣區之發信號之系統及方法
US10620441B2 (en) Viewport-aware quality metric for 360-degree video
US11062738B2 (en) Signalling of video content including sub-picture bitstreams for video coding
JP6874169B2 (ja) コンテナファイルおよびビデオビットストリームにおける関心領域の発展型シグナリング
US10917564B2 (en) Systems and methods of generating and processing files for partial decoding and most interested regions
JP2022537576A (ja) ビデオエンコーディングおよびデコーディングのための装置、方法、およびコンピュータプログラム
RU2559691C2 (ru) Способ декодирования, декодер, программный продукт, программное приложение для мобильного устройства беспроводной связи и электронный потребительский продукт
TW201742444A (zh) 虛擬實境中之圓形魚眼視訊
TW201911863A (zh) 用於360度視訊寫碼之參考圖推導及動作補償
US11356663B2 (en) Encoder, decoder, encoding method, and decoding method
US20250220223A1 (en) Image encoding/decoding method and apparatus based on wrap-around motion compensation, and recording medium storing bitstream
TW201322735A (zh) 用於三維視訊編碼之發信深度範圍
JP2022522841A (ja) ビデオビットストリームにおける適応画像サイズのシグナリング
CN115514972A (zh) 视频编解码的方法、装置、电子设备及存储介质
CN113632463A (zh) 用视频码流中的偏移对参考图片进行重采样的方法
CN115022715B (zh) 一种沉浸媒体的数据处理方法及设备
KR102768259B1 (ko) 비디오 코딩에서의 널 타일 코딩
CN114270329A (zh) 清单内更新事件
WO2024147900A1 (en) Early notification for a low latency video decoder
HK40080399A (en) Video encoding and decoding method, device, electronic equipment and storage medium
HK40090345A (zh) 使用众包生成全息或光场视图
HK40055144A (en) Video decoding method, encoding method, decoding device and electronic device

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20190118

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200212

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20200212

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20210222

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210309

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20211012