KR20190004280A - 360도 비디오에 대한 하이브리드 그래픽들 및 픽셀 도메인 아키텍처 - Google Patents

360도 비디오에 대한 하이브리드 그래픽들 및 픽셀 도메인 아키텍처 Download PDF

Info

Publication number
KR20190004280A
KR20190004280A KR1020187031973A KR20187031973A KR20190004280A KR 20190004280 A KR20190004280 A KR 20190004280A KR 1020187031973 A KR1020187031973 A KR 1020187031973A KR 20187031973 A KR20187031973 A KR 20187031973A KR 20190004280 A KR20190004280 A KR 20190004280A
Authority
KR
South Korea
Prior art keywords
video data
tiles
video
user
adaptations
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
KR1020187031973A
Other languages
English (en)
Korean (ko)
Inventor
비자야락쉬미 라자순다람 라빈드란
미나 아이만 사레 야니 마카르
Original Assignee
퀄컴 인코포레이티드
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 퀄컴 인코포레이티드 filed Critical 퀄컴 인코포레이티드
Publication of KR20190004280A publication Critical patent/KR20190004280A/ko
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G06T3/0043—
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/06—Topological mapping of higher dimensional structures onto lower dimensional surfaces
    • G06T3/073—Transforming surfaces of revolution to planar images, e.g. cylindrical surfaces to planar images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/349—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking
    • H04N13/351—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking for displaying simultaneously
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Image Analysis (AREA)
KR1020187031973A 2016-05-06 2017-03-10 360도 비디오에 대한 하이브리드 그래픽들 및 픽셀 도메인 아키텍처 Ceased KR20190004280A (ko)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201662332918P 2016-05-06 2016-05-06
US62/332,918 2016-05-06
US15/269,157 US11228754B2 (en) 2016-05-06 2016-09-19 Hybrid graphics and pixel domain architecture for 360 degree video
US15/269,157 2016-09-19
PCT/US2017/021914 WO2017192207A1 (en) 2016-05-06 2017-03-10 Hybrid graphics and pixel domain architecture for 360 degree video

Publications (1)

Publication Number Publication Date
KR20190004280A true KR20190004280A (ko) 2019-01-11

Family

ID=58455654

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020187031973A Ceased KR20190004280A (ko) 2016-05-06 2017-03-10 360도 비디오에 대한 하이브리드 그래픽들 및 픽셀 도메인 아키텍처

Country Status (7)

Country Link
US (1) US11228754B2 (https=)
EP (1) EP3452978A1 (https=)
JP (1) JP2019517191A (https=)
KR (1) KR20190004280A (https=)
CN (1) CN109074161B (https=)
BR (1) BR112018072791A2 (https=)
WO (1) WO2017192207A1 (https=)

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3301928A1 (en) * 2016-09-30 2018-04-04 Thomson Licensing Methods, devices and stream to encode global rotation motion compensated images
EP3301929A1 (en) * 2016-09-30 2018-04-04 Thomson Licensing Method and apparatus for encoding and decoding a large field of view video
US10602133B2 (en) * 2016-10-04 2020-03-24 Facebook, Inc. Controls and interfaces for user interactions in virtual spaces
WO2018129186A1 (en) * 2017-01-04 2018-07-12 Nvidia Corporation Stereoscopic rendering using raymarching and a virtual view broadcaster for such rendering
AU2018218182B2 (en) 2017-02-08 2022-12-15 Immersive Robotics Pty Ltd Antenna control for mobile device communication
CN110651482B (zh) * 2017-03-30 2022-02-22 联发科技股份有限公司 发信isobmff的球面区域信息的方法和装置
KR102558015B1 (ko) * 2017-04-13 2023-07-21 엘지전자 주식회사 영상의 부호화/복호화 방법 및 이를 위한 장치
US12096031B2 (en) * 2017-06-05 2024-09-17 Immersive Robotics Pty Ltd. Method and apparatus for digital content stream compression and decompression
CN111699693A (zh) 2017-11-21 2020-09-22 因默希弗机器人私人有限公司 用于数字现实的图像压缩
EP3714598A4 (en) 2017-11-21 2021-03-31 Immersive Robotics Pty Ltd SELECTING A FREQUENCY COMPONENT FOR IMAGE COMPRESSION
US10812828B2 (en) 2018-04-10 2020-10-20 At&T Intellectual Property I, L.P. System and method for segmenting immersive video
US10567780B2 (en) * 2018-06-14 2020-02-18 Telefonaktiebolaget Lm Ericsson (Publ) System and method for encoding 360° immersive video
KR102188270B1 (ko) 2018-07-06 2020-12-09 엘지전자 주식회사 360 비디오 데이터의 서브픽처 기반 처리 방법 및 그 장치
US10939139B2 (en) 2018-11-29 2021-03-02 Apple Inc. Adaptive coding and streaming of multi-directional video
US11397909B2 (en) * 2019-07-02 2022-07-26 Tattle Systems Technology Inc. Long term sensor monitoring for remote assets
US10972753B1 (en) 2019-09-13 2021-04-06 Apple Inc. Versatile tile coding for multi-view video streaming
US11956295B2 (en) 2019-09-27 2024-04-09 Apple Inc. Client-end enhanced view prediction for multi-view video streaming exploiting pre-fetched data and side information
US12355984B2 (en) 2019-10-18 2025-07-08 Immersive Robotics Pty Ltd Content compression for network transmission
US11184601B2 (en) * 2019-12-19 2021-11-23 Shenzhen Yunyinggu Technology Co., Ltd. Apparatus and method for display encoding
US11343439B2 (en) * 2020-01-30 2022-05-24 Semiconductor Components Industries, Llc High dynamic range imaging pixels with multiple photodiodes
EP4142292A4 (en) * 2020-05-18 2023-09-27 Samsung Electronics Co., Ltd. IMAGE CONTENT TRANSMISSION METHOD AND APPARATUS USING EDGE COMPUTING SERVICE
US11743442B2 (en) * 2020-11-09 2023-08-29 Tencent America LLC Bitstream structure for immersive teleconferencing and telepresence for remote terminals

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100348032C (zh) 1999-11-29 2007-11-07 索尼公司 处理和浏览所提供的视频/音频信号的方法和设备
WO2003027766A2 (en) 2001-09-27 2003-04-03 Eyesee360, Inc. System and method for panoramic imaging
US20030095131A1 (en) * 2001-11-08 2003-05-22 Michael Rondinelli Method and apparatus for processing photographic images
US7495659B2 (en) 2003-11-25 2009-02-24 Apple Inc. Touch pad for handheld device
US8992318B2 (en) 2012-09-26 2015-03-31 Igt Wearable display system and method
US20140098185A1 (en) * 2012-10-09 2014-04-10 Shahram Davari Interactive user selected video/audio views by real time stitching and selective delivery of multiple video/audio sources
CA2949005C (en) * 2013-05-26 2021-06-29 Pixellot Ltd. Method and system for low cost television production
US9699437B2 (en) 2014-03-03 2017-07-04 Nextvr Inc. Methods and apparatus for streaming content
US9905046B2 (en) 2014-04-03 2018-02-27 Intel Corporation Mapping multi-rate shading to monolithic programs
JP6075889B2 (ja) 2014-06-10 2017-02-08 日本電信電話株式会社 映像配信装置及び映像再生装置
JP6471418B2 (ja) 2014-06-25 2019-02-20 株式会社リコー 画像・音声配信システム、画像・音声配信装置および画像・音声配信プログラム
US9449363B2 (en) 2014-06-27 2016-09-20 Intel Corporation Sampling, fault management, and/or context switching via a compute pipeline
US10204658B2 (en) * 2014-07-14 2019-02-12 Sony Interactive Entertainment Inc. System and method for use in playing back panorama video content
US9704213B2 (en) 2014-08-13 2017-07-11 Qualcomm Incorporated Texture element streaming
US9558718B2 (en) 2014-09-03 2017-01-31 Qualcomm Incorporated Streaming video data in the graphics domain
US10484697B2 (en) 2014-09-09 2019-11-19 Qualcomm Incorporated Simultaneous localization and mapping for video coding
US10021161B2 (en) 2014-11-05 2018-07-10 Qualcomm Incorporated Compression of graphical commands for remote display
WO2016134048A1 (en) * 2015-02-17 2016-08-25 Nextvr Inc. Methods and apparatus for generating and using reduced resolution images and/or communicating such images to a playback or content distribution device

Also Published As

Publication number Publication date
EP3452978A1 (en) 2019-03-13
US11228754B2 (en) 2022-01-18
US20170324951A1 (en) 2017-11-09
BR112018072791A2 (pt) 2019-03-12
WO2017192207A1 (en) 2017-11-09
JP2019517191A (ja) 2019-06-20
CN109074161A (zh) 2018-12-21
CN109074161B (zh) 2021-10-01

Similar Documents

Publication Publication Date Title
CN109074161B (zh) 用于360度视频的混合图形及像素域架构
US10620441B2 (en) Viewport-aware quality metric for 360-degree video
CN111937396B (zh) 基于子图像码流视角相关视频编码中的误差抑制的文件格式指示
JP6799159B2 (ja) 関心領域のシグナリングのシステムおよび方法
KR102343700B1 (ko) 독립적으로 인코딩된 배경 업데이트들에 기초한 비디오 송신
US10839480B2 (en) Sphere equator projection for efficient compression of 360-degree video
JP2022537576A (ja) ビデオエンコーディングおよびデコーディングのための装置、方法、およびコンピュータプログラム
AU2018239451A1 (en) Sphere pole projections for efficient compression of 360-degree video
TW201742435A (zh) 具有用於360度視訊之透鏡失真校正之魚眼呈現
CN113632463B (zh) 视频的解码方法、编码方法、解码设备以及电子设备
KR102558495B1 (ko) Hls를 시그널링하는 영상 부호화/복호화 방법, 장치 및 비트스트림을 저장한 컴퓨터 판독 가능한 기록 매체
TW201322735A (zh) 用於三維視訊編碼之發信深度範圍
CA3018600C (en) Method, apparatus and stream of formatting an immersive video for legacy and immersive rendering devices
US20160219280A1 (en) Video transmission based on independently encoded background updates
CN113632482B (zh) 视频解码方法、装置、计算机设备和存储介质
CN114127800A (zh) 已编码视频流中跨层对齐的方法
KR102768259B1 (ko) 비디오 코딩에서의 널 타일 코딩
US12375636B2 (en) Generating holographic or lightfield views using crowdsourcing
RU2787713C2 (ru) Способ и устройство предсказания блока цветности
HK40090345A (zh) 使用众包生成全息或光场视图
HK40055144A (en) Video decoding method, encoding method, decoding device and electronic device
HK40080399A (en) Video encoding and decoding method, device, electronic equipment and storage medium
CN121970347A (zh) 基于补充增强信息（sei）消息的视频编码/解码方法和设备以及用于存储比特流的记录介质
HK40075540A (en) A framework for video conferencing based on face restoration

Legal Events

Date Code Title Description
PA0105 International application

Patent event date: 20181102

Patent event code: PA01051R01D

Comment text: International Patent Application

PG1501 Laying open of application
A201 Request for examination
PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20200225

Comment text: Request for Examination of Application

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20220305

Patent event code: PE09021S01D

E601 Decision to refuse application
PE0601 Decision on rejection of patent

Patent event date: 20220606

Comment text: Decision to Refuse Application

Patent event code: PE06012S01D

Patent event date: 20220305

Comment text: Notification of reason for refusal

Patent event code: PE06011S01I