KR20190004280A - 360도 비디오에 대한 하이브리드 그래픽들 및 픽셀 도메인 아키텍처 - Google Patents

360도 비디오에 대한 하이브리드 그래픽들 및 픽셀 도메인 아키텍처 Download PDF

Info

Publication number
KR20190004280A
KR20190004280A KR1020187031973A KR20187031973A KR20190004280A KR 20190004280 A KR20190004280 A KR 20190004280A KR 1020187031973 A KR1020187031973 A KR 1020187031973A KR 20187031973 A KR20187031973 A KR 20187031973A KR 20190004280 A KR20190004280 A KR 20190004280A
Authority
KR
South Korea
Prior art keywords
video data
tiles
video
user
adaptations
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
KR1020187031973A
Other languages
English (en)
Korean (ko)
Inventor
비자야락쉬미 라자순다람 라빈드란
미나 아이만 사레 야니 마카르
Original Assignee
퀄컴 인코포레이티드
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 퀄컴 인코포레이티드 filed Critical 퀄컴 인코포레이티드
Publication of KR20190004280A publication Critical patent/KR20190004280A/ko
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G06T3/0043—
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/06—Topological mapping of higher dimensional structures onto lower dimensional surfaces
    • G06T3/073—Transforming surfaces of revolution to planar images, e.g. cylindrical surfaces to planar images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/349—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking
    • H04N13/351—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking for displaying simultaneously
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Image Analysis (AREA)
KR1020187031973A 2016-05-06 2017-03-10 360도 비디오에 대한 하이브리드 그래픽들 및 픽셀 도메인 아키텍처 Ceased KR20190004280A (ko)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201662332918P 2016-05-06 2016-05-06
US62/332,918 2016-05-06
US15/269,157 2016-09-19
US15/269,157 US11228754B2 (en) 2016-05-06 2016-09-19 Hybrid graphics and pixel domain architecture for 360 degree video
PCT/US2017/021914 WO2017192207A1 (en) 2016-05-06 2017-03-10 Hybrid graphics and pixel domain architecture for 360 degree video

Publications (1)

Publication Number Publication Date
KR20190004280A true KR20190004280A (ko) 2019-01-11

Family

ID=58455654

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020187031973A Ceased KR20190004280A (ko) 2016-05-06 2017-03-10 360도 비디오에 대한 하이브리드 그래픽들 및 픽셀 도메인 아키텍처

Country Status (7)

Country Link
US (1) US11228754B2 (enExample)
EP (1) EP3452978A1 (enExample)
JP (1) JP2019517191A (enExample)
KR (1) KR20190004280A (enExample)
CN (1) CN109074161B (enExample)
BR (1) BR112018072791A2 (enExample)
WO (1) WO2017192207A1 (enExample)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3301929A1 (en) * 2016-09-30 2018-04-04 Thomson Licensing Method and apparatus for encoding and decoding a large field of view video
EP3301928A1 (en) * 2016-09-30 2018-04-04 Thomson Licensing Methods, devices and stream to encode global rotation motion compensated images
US20180096504A1 (en) * 2016-10-04 2018-04-05 Facebook, Inc. Controls and Interfaces for User Interactions in Virtual Spaces
DE112018000311B4 (de) * 2017-01-04 2025-12-24 Nvidia Corporation Stereoskopisches Rendering unter Verwendung von Raymarching und ein Broadcaster für eine virtuelle Ansicht für solches Rendering
EP3579941A4 (en) 2017-02-08 2020-10-28 Immersive Robotics Pty Ltd ANTENNA CONTROL FOR COMMUNICATION BETWEEN MOBILE DEVICES
WO2018177373A1 (en) * 2017-03-30 2018-10-04 Mediatek Inc. Method and apparatus for signaling spherical region information in isobmff
KR102302797B1 (ko) * 2017-04-13 2021-09-16 엘지전자 주식회사 영상의 부호화/복호화 방법 및 이를 위한 장치
US12096031B2 (en) * 2017-06-05 2024-09-17 Immersive Robotics Pty Ltd. Method and apparatus for digital content stream compression and decompression
WO2019100109A1 (en) 2017-11-21 2019-05-31 Immersive Robotics Pty Ltd Frequency component selection for image compression
CN111699693A (zh) 2017-11-21 2020-09-22 因默希弗机器人私人有限公司 用于数字现实的图像压缩
US10812828B2 (en) 2018-04-10 2020-10-20 At&T Intellectual Property I, L.P. System and method for segmenting immersive video
US10567780B2 (en) * 2018-06-14 2020-02-18 Telefonaktiebolaget Lm Ericsson (Publ) System and method for encoding 360° immersive video
KR102188270B1 (ko) 2018-07-06 2020-12-09 엘지전자 주식회사 360 비디오 데이터의 서브픽처 기반 처리 방법 및 그 장치
US10939139B2 (en) 2018-11-29 2021-03-02 Apple Inc. Adaptive coding and streaming of multi-directional video
US11397909B2 (en) * 2019-07-02 2022-07-26 Tattle Systems Technology Inc. Long term sensor monitoring for remote assets
US10972753B1 (en) 2019-09-13 2021-04-06 Apple Inc. Versatile tile coding for multi-view video streaming
US11956295B2 (en) 2019-09-27 2024-04-09 Apple Inc. Client-end enhanced view prediction for multi-view video streaming exploiting pre-fetched data and side information
WO2021072498A1 (en) 2019-10-18 2021-04-22 Immersive Robotics Pty Ltd Content compression for network transmission
US11184601B2 (en) * 2019-12-19 2021-11-23 Shenzhen Yunyinggu Technology Co., Ltd. Apparatus and method for display encoding
US11343439B2 (en) * 2020-01-30 2022-05-24 Semiconductor Components Industries, Llc High dynamic range imaging pixels with multiple photodiodes
US11743442B2 (en) * 2020-11-09 2023-08-29 Tencent America LLC Bitstream structure for immersive teleconferencing and telepresence for remote terminals

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100348032C (zh) 1999-11-29 2007-11-07 索尼公司 处理和浏览所提供的视频/音频信号的方法和设备
WO2003027766A2 (en) 2001-09-27 2003-04-03 Eyesee360, Inc. System and method for panoramic imaging
WO2003041011A2 (en) 2001-11-08 2003-05-15 Eyesee360, Inc. Method and apparatus for the computation of panoramic views and _perspective projections from omnidirectional images
US7495659B2 (en) 2003-11-25 2009-02-24 Apple Inc. Touch pad for handheld device
US8992318B2 (en) 2012-09-26 2015-03-31 Igt Wearable display system and method
US20140098185A1 (en) * 2012-10-09 2014-04-10 Shahram Davari Interactive user selected video/audio views by real time stitching and selective delivery of multiple video/audio sources
EP3005677A1 (en) * 2013-05-26 2016-04-13 Pixellot Ltd. Method and system for low cost television production
US9699437B2 (en) 2014-03-03 2017-07-04 Nextvr Inc. Methods and apparatus for streaming content
US9905046B2 (en) 2014-04-03 2018-02-27 Intel Corporation Mapping multi-rate shading to monolithic programs
JP6075889B2 (ja) 2014-06-10 2017-02-08 日本電信電話株式会社 映像配信装置及び映像再生装置
JP6471418B2 (ja) 2014-06-25 2019-02-20 株式会社リコー 画像・音声配信システム、画像・音声配信装置および画像・音声配信プログラム
US9449363B2 (en) 2014-06-27 2016-09-20 Intel Corporation Sampling, fault management, and/or context switching via a compute pipeline
US10204658B2 (en) 2014-07-14 2019-02-12 Sony Interactive Entertainment Inc. System and method for use in playing back panorama video content
US9704213B2 (en) 2014-08-13 2017-07-11 Qualcomm Incorporated Texture element streaming
US9558718B2 (en) 2014-09-03 2017-01-31 Qualcomm Incorporated Streaming video data in the graphics domain
US10484697B2 (en) 2014-09-09 2019-11-19 Qualcomm Incorporated Simultaneous localization and mapping for video coding
US10021161B2 (en) 2014-11-05 2018-07-10 Qualcomm Incorporated Compression of graphical commands for remote display
US20160241838A1 (en) * 2015-02-17 2016-08-18 Nextvr Inc. Methods and apparatus for generating and using reduced resolution images and/or communicating such images to a playback or content distribution device

Also Published As

Publication number Publication date
EP3452978A1 (en) 2019-03-13
BR112018072791A2 (pt) 2019-03-12
CN109074161A (zh) 2018-12-21
WO2017192207A1 (en) 2017-11-09
CN109074161B (zh) 2021-10-01
JP2019517191A (ja) 2019-06-20
US11228754B2 (en) 2022-01-18
US20170324951A1 (en) 2017-11-09

Similar Documents

Publication Publication Date Title
CN109074161B (zh) 用于360度视频的混合图形及像素域架构
US10620441B2 (en) Viewport-aware quality metric for 360-degree video
JP6799159B2 (ja) 関心領域のシグナリングのシステムおよび方法
CN111937396B (zh) 基于子图像码流视角相关视频编码中的误差抑制的文件格式指示
US10839480B2 (en) Sphere equator projection for efficient compression of 360-degree video
KR102343700B1 (ko) 독립적으로 인코딩된 배경 업데이트들에 기초한 비디오 송신
CN112771884B (zh) 具有多个机位的虚拟现实内容的沉浸式媒体度量
JP2022537576A (ja) ビデオエンコーディングおよびデコーディングのための装置、方法、およびコンピュータプログラム
AU2018239451A1 (en) Sphere pole projections for efficient compression of 360-degree video
TW201742435A (zh) 具有用於360度視訊之透鏡失真校正之魚眼呈現
KR102558495B1 (ko) Hls를 시그널링하는 영상 부호화/복호화 방법, 장치 및 비트스트림을 저장한 컴퓨터 판독 가능한 기록 매체
CN113632463B (zh) 视频的解码方法、编码方法、解码设备以及电子设备
TW201322735A (zh) 用於三維視訊編碼之發信深度範圍
US20170374283A1 (en) Video transmission based on independently encoded background updates
CA3018600C (en) Method, apparatus and stream of formatting an immersive video for legacy and immersive rendering devices
CN115514972A (zh) 视频编解码的方法、装置、电子设备及存储介质
CN118317101A (zh) 视频编码方法、装置、计算机设备和存储介质
CN114127800A (zh) 已编码视频流中跨层对齐的方法
KR102768259B1 (ko) 비디오 코딩에서의 널 타일 코딩
US12375636B2 (en) Generating holographic or lightfield views using crowdsourcing
RU2787713C2 (ru) Способ и устройство предсказания блока цветности
HK40090345A (zh) 使用众包生成全息或光场视图
HK40055144A (en) Video decoding method, encoding method, decoding device and electronic device
HK40075540A (en) A framework for video conferencing based on face restoration

Legal Events

Date Code Title Description
PA0105 International application

Patent event date: 20181102

Patent event code: PA01051R01D

Comment text: International Patent Application

PG1501 Laying open of application
A201 Request for examination
PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20200225

Comment text: Request for Examination of Application

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20220305

Patent event code: PE09021S01D

E601 Decision to refuse application
PE0601 Decision on rejection of patent

Patent event date: 20220606

Comment text: Decision to Refuse Application

Patent event code: PE06012S01D

Patent event date: 20220305

Comment text: Notification of reason for refusal

Patent event code: PE06011S01I