SG11201907264UA - Sphere equator projection for efficient compression of 360-degree video - Google Patents

Sphere equator projection for efficient compression of 360-degree video

Info

Publication number
SG11201907264UA
SG11201907264UA SG11201907264UA SG11201907264UA SG 11201907264U A SG11201907264U A SG 11201907264UA SG 11201907264U A SG11201907264U A SG 11201907264UA SG 11201907264U A SG11201907264U A SG 11201907264UA
Authority
SG
Singapore
Prior art keywords
international
california
san diego
degree video
march
Prior art date
Application number
Inventor
Der Auwera Geert Van
Muhammed Coban
Marta Karczewicz
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of SG11201907264UA publication Critical patent/SG11201907264UA/en

Links

Classifications

    • G06T3/12—
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformation in the plane of the image
    • G06T3/40—Scaling the whole image or part thereof
    • G06T3/4038—Scaling the whole image or part thereof for image mosaicing, i.e. plane images composed of plane sub-images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/88—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving rearrangement of data among different coding units, e.g. shuffling, interleaving, scrambling or permutation of pixel data or permutation of transform coefficient data among different blocks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence

Abstract

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) (19) World Intellectual Property Organization International Bureau (43) International Publication Date 27 September 2018 (27.09.2018) WIP0 I PCT O V SID o Ho lulu °limo VII IE (10) International Publication Number WO 2018/175611 Al (51) International Patent Classification: H04N 19/597 (2014.01) H04N 19/88 (2014.01) H04N 19/182 (2014.01) (21) International Application Number: PCT/US2018/023601 (22) International Filing Date: 21 March 2018 (21.03.2018) (25) Filing Language: English (26) Publication Language: English (30) Priority Data: 62/475,103 22 March 2017 (22.03.2017) US 15/926,732 20 March 2018 (20.03.2018) US (71) Applicant: QUALCOMM INCORPORATED [US/US]; ATTN: International IP Administration, 5775 Morehouse Drive, San Diego, California 92121-1714 (US). (72) Inventors: VAN DER AUWERA, Geert; 5775 More- house Drive, San Diego, California 92121-1714 (US). COBAN, Muhammed; 5775 Morehouse Drive, San Diego, California 92121-1714 (US). KARCZEWICZ, Marta; 5775 Morehouse Drive, San Diego, California 92121-1714 (US). (74) Agent: WONG, Claudine et al.; Kilpatrick Townsend & Stockton LLP, Mailstop: IP Docketing - 22, 1100 Peachtree Street, N.E., Suite 2800, Atlanta, Georgia 30309 (US). (81) Designated States (unless otherwise indicated, for every kind of national protection available): AE, AG, AL, AM, AO, AT, AU, AZ, BA, BB, BG, BH, BN, BR, BW, BY, BZ, CA, CH, CL, CN, CO, CR, CU, CZ, DE, DJ, DK, DM, DO, DZ, EC, EE, EG, ES, FI, GB, GD, GE, GH, GM, GT, HN, HR, HU, ID, IL, IN, IR, IS, JO, JP, KE, KG, KH, KN, KP, KR, KW, KZ, LA, LC, LK, LR, LS, LU, LY, MA, MD, ME, MG, MK, MN, MW, MX, MY, MZ, NA, NG, NI, NO, NZ, OM, PA, PE, PG, PH, PL, PT, QA, RO, RS, RU, RW, SA, SC, SD, SE, SG, SK, SL, SM, ST, SV, SY, TH, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, VC, VN, ZA, ZM, ZW. (84) Designated States (unless otherwise indicated, for every kind of regional protection available): ARIPO (BW, GH, GM, KE, LR, LS, MW, MZ, NA, RW, SD, SL, ST, SZ, TZ, UG, ZM, ZW), Eurasian (AM, AZ, BY, KG, KZ, RU, TJ, TM), European (AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LT, LU, LV, = (54) Title: SPHERE EQUATOR PROJECTION FOR EFFICIENT COMPRESSION OF 360-DEGREE VIDEO (57) : Provided are systems and methods for processing 360-degree video data. In various implementations, a spherical rep- resentation of a 360-degree video frame can be segmented into a top region, a bottom region, and a middle region. Using a cylindrical equal area projection, such as the Lambert cylindrical equal area projection, the middle region can be mapped into one or more rectan- gular areas of an output video frame. [Continued on next page] WO 2018/175611 Al 11111101M01101DEIMMERIOMOINIDEIHOIE011111110110111111 MC, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, TR), OAPI (BF, BJ, CF, CG, CI, CM, GA, GN, GQ, GW, KM, ML, MR, NE, SN, TD, TG). Published: — with international search report (Art. 21(3))
SG11201907264U 2017-03-22 2018-03-21 Sphere equator projection for efficient compression of 360-degree video SG11201907264UA (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762475103P 2017-03-22 2017-03-22
US15/926,732 US10839480B2 (en) 2017-03-22 2018-03-20 Sphere equator projection for efficient compression of 360-degree video
PCT/US2018/023601 WO2018175611A1 (en) 2017-03-22 2018-03-21 Sphere equator projection for efficient compression of 360-degree video

Publications (1)

Publication Number Publication Date
SG11201907264UA true SG11201907264UA (en) 2019-10-30

Family

ID=63582713

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11201907264U SG11201907264UA (en) 2017-03-22 2018-03-21 Sphere equator projection for efficient compression of 360-degree video

Country Status (9)

Country Link
US (1) US10839480B2 (en)
EP (1) EP3603073A1 (en)
KR (1) KR20190128211A (en)
CN (1) CN110383843B (en)
AU (1) AU2018239448A1 (en)
BR (1) BR112019019163A2 (en)
SG (1) SG11201907264UA (en)
TW (1) TW201903710A (en)
WO (1) WO2018175611A1 (en)

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10999602B2 (en) 2016-12-23 2021-05-04 Apple Inc. Sphere projected motion estimation/compensation and mode decision
US11259046B2 (en) 2017-02-15 2022-02-22 Apple Inc. Processing of equirectangular object data to compensate for distortion by spherical projections
US10924747B2 (en) 2017-02-27 2021-02-16 Apple Inc. Video coding techniques for multi-view video
US10593012B2 (en) * 2017-03-22 2020-03-17 Mediatek Inc. Method and apparatus for generating and encoding projection-based frame with 360-degree content represented in projection faces packed in segmented sphere projection layout
US10839480B2 (en) * 2017-03-22 2020-11-17 Qualcomm Incorporated Sphere equator projection for efficient compression of 360-degree video
US10506255B2 (en) * 2017-04-01 2019-12-10 Intel Corporation MV/mode prediction, ROI-based transmit, metadata capture, and format detection for 360 video
US20180288436A1 (en) * 2017-04-03 2018-10-04 Gopro, Inc. Methods and apparatus for providing in-loop padding techniques for rotated sphere projections
US10579898B2 (en) * 2017-04-16 2020-03-03 Facebook, Inc. Systems and methods for provisioning content using barrel projection representation
US11093752B2 (en) 2017-06-02 2021-08-17 Apple Inc. Object tracking in multi-view video
US20190005709A1 (en) * 2017-06-30 2019-01-03 Apple Inc. Techniques for Correction of Visual Artifacts in Multi-View Images
US10754242B2 (en) 2017-06-30 2020-08-25 Apple Inc. Adaptive resolution and projection format in multi-direction video
EP3518087A1 (en) * 2018-01-29 2019-07-31 Thomson Licensing Method and network equipment for tiling a sphere representing a spherical multimedia content
US11212438B2 (en) 2018-02-14 2021-12-28 Qualcomm Incorporated Loop filter padding for 360-degree video coding
US11069026B2 (en) 2018-03-02 2021-07-20 Mediatek Inc. Method for processing projection-based frame that includes projection faces packed in cube-based projection layout with padding
US10922783B2 (en) * 2018-03-02 2021-02-16 Mediatek Inc. Cube-based projection method that applies different mapping functions to different square projection faces, different axes, and/or different locations of axis
US10715832B2 (en) * 2018-03-16 2020-07-14 Mediatek Inc. Method and apparatus of block partition for VR360 video coding
CN110349226B (en) * 2018-04-01 2021-06-01 浙江大学 Panoramic image processing method and device
CN109934764A (en) * 2019-01-31 2019-06-25 北京奇艺世纪科技有限公司 Processing method, device, terminal, server and the storage medium of panoramic video file
US20220156880A1 (en) * 2019-03-15 2022-05-19 STX Financing, LLC Systems and methods for compressing and decompressing a sequence of images
US11816757B1 (en) * 2019-12-11 2023-11-14 Meta Platforms Technologies, Llc Device-side capture of data representative of an artificial reality environment
CN110933395A (en) * 2019-12-23 2020-03-27 中科院微电子研究所昆山分所 720-degree panoramic stereo environment mapping method and related device
CN110958444A (en) * 2019-12-23 2020-04-03 中科院微电子研究所昆山分所 720-degree view field environment situation sensing method and situation sensing system
CN112203079A (en) * 2020-07-17 2021-01-08 中国科学院空天信息创新研究院 Three-dimensional sphere-oriented visualization system
CN114554195A (en) * 2020-11-25 2022-05-27 腾讯科技（深圳）有限公司 Image processing method, apparatus and storage medium
US11622100B2 (en) * 2021-02-17 2023-04-04 flexxCOACH VR 360-degree virtual-reality system for dynamic events

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6331869B1 (en) * 1998-08-07 2001-12-18 Be Here Corporation Method and apparatus for electronically distributing motion panoramic images
US6466254B1 (en) * 1997-05-08 2002-10-15 Be Here Corporation Method and apparatus for electronically distributing motion panoramic images
JP2003141562A (en) * 2001-10-29 2003-05-16 Sony Corp Image processing apparatus and method for nonplanar image, storage medium, and computer program
KR100882011B1 (en) * 2007-07-29 2009-02-04 주식회사 나노포토닉스 Methods of obtaining panoramic images using rotationally symmetric wide-angle lenses and devices thereof
US7961980B2 (en) * 2007-08-06 2011-06-14 Imay Software Co., Ltd. Method for providing output image in either cylindrical mode or perspective mode
US10068373B2 (en) * 2014-07-01 2018-09-04 Samsung Electronics Co., Ltd. Electronic device for providing map information
CN104333675B (en) * 2014-10-20 2017-09-05 长春理工大学 A kind of panorama electronic image stabilization method based on spherical projection
US20160112713A1 (en) * 2014-10-20 2016-04-21 Google Inc. Mapping spherical image to 2d representations
US10104361B2 (en) * 2014-11-14 2018-10-16 Samsung Electronics Co., Ltd. Coding of 360 degree videos using region adaptive smoothing
WO2016140082A1 (en) * 2015-03-05 2016-09-09 ソニー株式会社 Image processing device and image processing method
WO2016140083A1 (en) * 2015-03-05 2016-09-09 ソニー株式会社 Image processing device and image processing method
US9723206B1 (en) * 2015-03-11 2017-08-01 Vsn Technologies, Inc. Enabling a true surround view of a 360 panorama via a dynamic cylindrical projection of the panorama
US20170302714A1 (en) * 2016-04-15 2017-10-19 Diplloid Inc. Methods and systems for conversion, playback and tagging and streaming of spherical images and video
EP3451675A4 (en) * 2016-04-26 2019-12-04 LG Electronics Inc. -1- Method for transmitting 360-degree video, method for receiving 360-degree video, apparatus for transmitting 360-degree video, apparatus for receiving 360-degree video
US10762597B2 (en) * 2016-05-13 2020-09-01 Sony Corporation Generation apparatus, generation method, reproduction apparatus, and reproduction method
KR20190039669A (en) * 2016-05-26 2019-04-15 엘지전자 주식회사 360 how to transfer video, 360 how to receive video, 360 video transmission device, 360 video receiving device
US20180054613A1 (en) * 2016-08-22 2018-02-22 Mediatek Inc. Video encoding method and apparatus with in-loop filtering process not applied to reconstructed blocks located at image content discontinuity edge and associated video decoding method and apparatus
GB2555788A (en) * 2016-11-08 2018-05-16 Nokia Technologies Oy An apparatus, a method and a computer program for video coding and decoding
US20180192074A1 (en) * 2017-01-03 2018-07-05 Mediatek Inc. Video processing method for processing projection-based frame with 360-degree content represented by projection faces packed in 360-degree virtual reality projection layout
WO2018128247A1 (en) * 2017-01-03 2018-07-12 엘지전자 주식회사 Intra-prediction method and device in image coding system for 360-degree video
CN108282449B (en) * 2017-01-06 2020-10-09 华为技术有限公司 Streaming media transmission method and client applied to virtual reality technology
US10742999B2 (en) * 2017-01-06 2020-08-11 Mediatek Inc. Methods and apparatus for signaling viewports and regions of interest
US10560682B2 (en) * 2017-01-13 2020-02-11 Gopro, Inc. Methods and apparatus for providing a frame packing arrangement for panoramic content
CN108537721B (en) * 2017-03-02 2021-09-07 株式会社理光 Panoramic image processing method and device and electronic equipment
US20180253820A1 (en) * 2017-03-03 2018-09-06 Immersive Enterprises, LLC Systems, methods, and devices for generating virtual reality content from two-dimensional images
US10915986B2 (en) * 2017-03-20 2021-02-09 Qualcomm Incorporated Adaptive perturbed cube map projection
US10593012B2 (en) * 2017-03-22 2020-03-17 Mediatek Inc. Method and apparatus for generating and encoding projection-based frame with 360-degree content represented in projection faces packed in segmented sphere projection layout
US10839480B2 (en) * 2017-03-22 2020-11-17 Qualcomm Incorporated Sphere equator projection for efficient compression of 360-degree video
US10957044B2 (en) * 2017-03-22 2021-03-23 Qualcomm Incorporated Sphere pole projections for efficient compression of 360-degree video
US10614609B2 (en) * 2017-07-19 2020-04-07 Mediatek Inc. Method and apparatus for reduction of artifacts at discontinuous boundaries in coded virtual-reality images
US10817980B2 (en) * 2018-02-07 2020-10-27 Ricoh Company, Ltd. Information processing apparatus, information processing system, data generation method, and recording medium storing program code
US10764605B2 (en) * 2018-02-14 2020-09-01 Qualcomm Incorporated Intra prediction for 360-degree video
US10779006B2 (en) * 2018-02-14 2020-09-15 Qualcomm Incorporated Signaling 360-degree video information

Also Published As

Publication number Publication date
WO2018175611A1 (en) 2018-09-27
CN110383843B (en) 2023-06-06
AU2018239448A1 (en) 2019-08-29
US10839480B2 (en) 2020-11-17
US20180276789A1 (en) 2018-09-27
TW201903710A (en) 2019-01-16
EP3603073A1 (en) 2020-02-05
BR112019019163A2 (en) 2020-04-14
KR20190128211A (en) 2019-11-15
CN110383843A (en) 2019-10-25

Similar Documents

Publication Publication Date Title
SG11201907264UA (en) Sphere equator projection for efficient compression of 360-degree video
SG11201907262QA (en) Sphere pole projections for efficient compression of 360-degree video
SG11201901862YA (en) Method and system for processing 360 degree video data
SG11201909450WA (en) 360-degree video coding using face continuities
SG11201907090WA (en) Affine motion information derivation
SG11201906486SA (en) Coding mcts-nested sei messages
SG11201907574YA (en) Signaling important video information in network video streaming using mime type parameters
SG11201907473WA (en) Signalling of video content including sub-picture bitstreams for video coding
SG11201806739UA (en) Determining prediction parameters for non-square blocks in video coding
SG11201905243YA (en) Bilateral filters in video coding with reduced complexity
SG11201907091PA (en) Intra-prediction mode propagation
SG11201806737RA (en) Decoding video data using a two-level multi-type-tree framework
SG11201908420WA (en) Compositions of plinabulin and use thereof
SG11201907906PA (en) Display screen, mobile terminal having display screen, method and device for controlling display screen
SG11201906877QA (en) Intra filtering flag in video coding
SG11201900967XA (en) Linear model chroma intra prediction for video coding
SG11201907063QA (en) Techniques and apparatuses for control channel monitoring using a wakeup signal
SG11201806862QA (en) System and method for characterizing particulates in a fluid sample
SG11201804915RA (en) Methods for treating huntington's disease
SG11201900111YA (en) Intra video coding using a decoupled tree structure
SG11201804725YA (en) Multi-type-tree framework for video coding
SG11201907476XA (en) Advanced signalling of regions of interest in omnidirectional visual media
SG11201807780XA (en) Customizable facility
SG11201907023UA (en) Method of reducing neutropenia
SG11201906238TA (en) Split sector level sweep using beamforming refinement frames