SG11201907476XA - Advanced signalling of regions of interest in omnidirectional visual media - Google Patents

Advanced signalling of regions of interest in omnidirectional visual media

Info

Publication number
SG11201907476XA
SG11201907476XA SG11201907476XA SG11201907476XA SG 11201907476X A SG11201907476X A SG 11201907476XA SG 11201907476X A SG11201907476X A SG 11201907476XA SG 11201907476X A SG11201907476X A SG 11201907476XA
Authority
SG
Singapore
Prior art keywords
virtual reality
file
international
reality data
track
Prior art date
Application number
Inventor
Yekui Wang
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of SG11201907476XA publication Critical patent/SG11201907476XA/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/003Navigation within 3D models or images
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/005General purpose rendering architectures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • G06T15/20Perspective computation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4728End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61Network physical structure; Signal processing
    • H04N21/6106Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6125Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/816Monomedia components thereof involving special video data, e.g 3D video

Abstract

WO 18/ 175 903 Al (12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) (19) World Intellectual Property Organization International Bureau (43) International Publication Date 27 September 2018 (27.09.2018) WIP0 I PCT ill 1111u°11101VIIIVIIIVIIIolo oloinimoiminiovoimIE (10) International Publication Number WO 2018/175903 Al RECEIVE A FILE CONTAINING VIRTUAL REALITY DATA, WHEREIN THE VIRTUAL REALITY DATA REPRESENTS A 360-DEGREE VIEW OF A VIRTUAL ENVIRONMENT 1002 (51) International Patent Classification: GOOF 3/0481 (2013.01) HO4N 21/61 (2011.01) HO4N 21/4728 (2011.01) (21) International Application Number: PCT/US2018/024057 (22) International Filing Date: 23 March 2018 (23.03.2018) (25) Filing Language: English (26) Publication Language: English (30) Priority Data: 62/475,714 23 March 2017 (23.03.2017) US 15/927,799 21 March 2018 (21.03.2018) US (71) Applicant: QUALCOMM INCORPORATED [US/US]; 5775 Morehouse Drive, Attn: International IP Administra- tion, San Diego, California 92121-1714 (US). (72) Inventor: WANG, Yekui; 6264 Sunrose Crest Way, San Diego, California 92130 (US). (74) Agent: CHIANG, Campbell; 5775 Morehouse Drive, At- tn: International IP Administration, San Diego, California 92121-1714 (US). (81) Designated States (unless otherwise indicated, for every kind of national protection available): AE, AG, AL, AM, AO, AT, AU, AZ, BA, BB, BG, BH, BN, BR, BW, BY, BZ, CA, CH, CL, CN, CO, CR, CU, CZ, DE, DJ, DK, DM, DO, DZ, EC, EE, EG, ES, FI, GB, GD, GE, GH, GM, GT, HN, HR, HU, ID, IL, IN, IR, IS, JO, JP, KE, KG, KH, KN, KP, KR, KW, KZ, LA, LC, LK, LR, LS, LU, LY, MA, MD, ME, MG, MK, MN, MW, MX, MY, MZ, NA, NG, NI, NO, NZ, OM, PA, PE, PG, PH, PL, PT, QA, RO, RS, RU, RW, SA, SC, SD, SE, SG, SK, SL, SM, ST, SV, SY, TH, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, VC, VN, ZA, ZM, ZW. (84) Designated States (unless otherwise indicated, for every kind of regional protection available): ARIPO (BW, GH, GM, KE, LR, LS, MW, MZ, NA, RW, SD, SL, ST, SZ, TZ, UG, ZM, ZW), Eurasian (AM, AZ, BY, KG, KZ, RU, TJ, TM), European (AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LT, LU, LV, MC, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, TR), OAPI (BF, BJ, CF, CG, CI, CM, GA, GN, GQ, GW, KM, ML, MR, NE, SN, TD, TG). Published: — with international search report (Art. 21(3)) (54) Title: ADVANCED SIGNALLING OF REGIONS OF INTEREST IN OMNIDIRECTIONAL VISUAL MEDIA (57) : In various implementations, modifications and/or addi- 1 ow tions to the ISOBMFF can indicate that a file that has been formatted according to the ISOBMFF, or a format derived from the ISOBMFF, in- cludes virtual reality content. The file can include a restricted scheme in- formation box, written into a track box in the file. The restricted scheme information box can indicate a virtual reality scheme for the contents of the track. For example, a signaling mechanism may indicate a most- viewed viewport associated with the virtual reality data. EXTRACT THE VIRTUAL REALITY DATA FROM THE FILE, WHEREIN THE VIRTUAL REALITY DATA IS STORED IN THE FILE IN ACCORDANCE WITH A FILE FORMAT, WHEREIN THE FILE FORMAT SPECIFIES PLACEMENT WITHIN THE FILE OF THE VIRTUAL REALITY DATA AND SPECIFIES PLACEMENT WITHIN THE FILE OF INFORMATION !ASSOCIATED WITH THE VIRTUAL REALITY DATA, WHEREIN THE INFORMATION ASSOCIATED WITH THE VIRTUAL REALITY DATA IS STORED WITHIN A TRACK BOX 1004 EXTRACT A SAMPLE ENTRY FROM THE TRACK BOX, WHEREIN THE SAMPLE ENTRY IS ASSOCIATED WITH ONE OR MORE SAMPLES, WHEREIN THE SAMPLE ENTRY INDICATES THAT THE TRACK IS A TIMED METADATA TRACK THAT CONTAINS INFORMATION ON A MOST- VIEWED VIEWPORT ASSOCIATED WITH THE VIRTUAL REALITY DATA 1 006 FIG. 10
SG11201907476X 2017-03-23 2018-03-23 Advanced signalling of regions of interest in omnidirectional visual media SG11201907476XA (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762475714P 2017-03-23 2017-03-23
US15/927,799 US11532128B2 (en) 2017-03-23 2018-03-21 Advanced signaling of regions of interest in omnidirectional visual media
PCT/US2018/024057 WO2018175903A1 (en) 2017-03-23 2018-03-23 Advanced signalling of regions of interest in omnidirectional visual media

Publications (1)

Publication Number Publication Date
SG11201907476XA true SG11201907476XA (en) 2019-10-30

Family

ID=63581186

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11201907476X SG11201907476XA (en) 2017-03-23 2018-03-23 Advanced signalling of regions of interest in omnidirectional visual media

Country Status (9)

Country Link
US (1) US11532128B2 (en)
EP (1) EP3602261B1 (en)
KR (1) KR102646968B1 (en)
CN (1) CN110431522B (en)
AU (1) AU2018237595A1 (en)
BR (1) BR112019019287A2 (en)
SG (1) SG11201907476XA (en)
TW (1) TW201840201A (en)
WO (1) WO2018175903A1 (en)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10999602B2 (en) 2016-12-23 2021-05-04 Apple Inc. Sphere projected motion estimation/compensation and mode decision
WO2018131813A1 (en) * 2017-01-10 2018-07-19 Samsung Electronics Co., Ltd. Method and apparatus for generating metadata for 3d images
US11259046B2 (en) 2017-02-15 2022-02-22 Apple Inc. Processing of equirectangular object data to compensate for distortion by spherical projections
US10924747B2 (en) 2017-02-27 2021-02-16 Apple Inc. Video coding techniques for multi-view video
WO2018182144A1 (en) * 2017-03-29 2018-10-04 엘지전자 주식회사 360 video transmission method, 360 video reception method, 360 video transmission device, and 360 video reception device
US11093752B2 (en) 2017-06-02 2021-08-17 Apple Inc. Object tracking in multi-view video
US20190005709A1 (en) * 2017-06-30 2019-01-03 Apple Inc. Techniques for Correction of Visual Artifacts in Multi-View Images
US10754242B2 (en) 2017-06-30 2020-08-25 Apple Inc. Adaptive resolution and projection format in multi-direction video
US10679415B2 (en) * 2017-07-05 2020-06-09 Qualcomm Incorporated Enhanced signaling of regions of interest in container files and video bitstreams
WO2019195035A1 (en) 2018-04-03 2019-10-10 Futurewei Technologies, Inc. Error mitigation in sub-picture bitstream based viewport dependent video coding
EP3857904A4 (en) * 2018-09-28 2022-06-22 Nokia Technologies Oy Method and apparatus for enabling multiple timeline support for omnidirectional content playback
US20200213570A1 (en) * 2019-01-02 2020-07-02 Mediatek Inc. Method for processing projection-based frame that includes at least one projection face and at least one padding region packed in 360-degree virtual reality projection layout
US11729243B2 (en) * 2019-09-20 2023-08-15 Intel Corporation Dash-based streaming of point cloud content based on recommended viewports
US20210211723A1 (en) * 2020-01-08 2021-07-08 Mediatek Singapore Pte. Ltd. Methods and apparatus for signaling 2d and 3d regions in immersive media
WO2021242036A1 (en) * 2020-05-28 2021-12-02 엘지전자 주식회사 Point cloud data transmission device, point cloud data transmission method, point cloud data reception device, and point cloud data reception method
BR112023020905A2 (en) * 2021-04-20 2023-12-12 Qualcomm Inc ANCHORING A SCENE DESCRIPTION TO A USER ENVIRONMENT FOR CONTINUOUS STREAMING OF IMMERSIVE MEDIA CONTENT

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101887548B1 (en) 2012-03-23 2018-08-10 삼성전자주식회사 Method and apparatus of processing media file for augmented reality services
US9451162B2 (en) 2013-08-21 2016-09-20 Jaunt Inc. Camera array including camera modules
US9712843B2 (en) 2013-10-23 2017-07-18 Qualcomm Incorporated Multi-layer video file format designs
KR20150068299A (en) * 2013-12-09 2015-06-19 씨제이씨지브이 주식회사 Method and system of generating images for multi-surface display
US20150237351A1 (en) 2014-02-18 2015-08-20 Penne Lee Techniques for inclusion of region of interest indications in compressed video data
US9819945B2 (en) 2014-06-25 2017-11-14 Qualcomm Incorporated Multi-layer video coding
US20160373771A1 (en) 2015-06-18 2016-12-22 Qualcomm Incorporated Design of tracks and operation point signaling in layered hevc file format
US10237589B2 (en) * 2015-12-15 2019-03-19 Telefonaktiebolaget Lm Ericsson (Publ) System and method for facilitating fast channel change
CN105898254B (en) 2016-05-17 2018-10-23 北京金字塔虚拟现实科技有限公司 It saves the VR panoramic videos layout method of bandwidth, device and shows method, system
GB202108749D0 (en) 2016-05-23 2021-08-04 Canon Kk Method, device, and computer program for adaptive streaming of virtual reality media content
WO2017203098A1 (en) * 2016-05-24 2017-11-30 Nokia Technologies Oy Method and an apparatus and a computer program for encoding media content
WO2018038520A1 (en) 2016-08-25 2018-03-01 엘지전자 주식회사 Method for transmitting omnidirectional video, method for receiving omnidirectional video, apparatus for transmitting omnidirectional video, and apparatus for receiving omnidirectional video,
WO2018038523A1 (en) * 2016-08-25 2018-03-01 엘지전자 주식회사 Method for transmitting omnidirectional video, method for receiving omnidirectional video, apparatus for transmitting omnidirectional video, and apparatus for receiving omnidirectional video,
US10887572B2 (en) * 2016-11-17 2021-01-05 Intel Corporation Suggested viewport indication for panoramic video
US20180176468A1 (en) * 2016-12-19 2018-06-21 Qualcomm Incorporated Preferred rendering of signalled regions-of-interest or viewports in virtual reality video
WO2018120474A1 (en) * 2016-12-30 2018-07-05 华为技术有限公司 Information processing method and apparatus
WO2018120294A1 (en) 2016-12-30 2018-07-05 华为技术有限公司 Information processing method and device
US10742999B2 (en) 2017-01-06 2020-08-11 Mediatek Inc. Methods and apparatus for signaling viewports and regions of interest
WO2018128071A1 (en) * 2017-01-08 2018-07-12 Sharp Kabushiki Kaisha Systems and methods for signaling of tiles in most-interested regions for virtual reality applications
EP3804335A4 (en) * 2018-06-01 2022-03-09 Nokia Technologies Oy Method and apparatus for signaling user interactions on overlay and grouping overlays to background for omnidirectional content

Also Published As

Publication number Publication date
EP3602261C0 (en) 2023-09-06
KR102646968B1 (en) 2024-03-12
KR20190131062A (en) 2019-11-25
EP3602261A1 (en) 2020-02-05
US20180276890A1 (en) 2018-09-27
CN110431522A (en) 2019-11-08
CN110431522B (en) 2022-11-18
TW201840201A (en) 2018-11-01
BR112019019287A2 (en) 2020-04-14
WO2018175903A1 (en) 2018-09-27
US11532128B2 (en) 2022-12-20
EP3602261B1 (en) 2023-09-06
AU2018237595A1 (en) 2019-08-29

Similar Documents

Publication Publication Date Title
SG11201907476XA (en) Advanced signalling of regions of interest in omnidirectional visual media
SG11201907574YA (en) Signaling important video information in network video streaming using mime type parameters
SG11201906484YA (en) Extracting mcts sub-bitstreams for video coding
SG11201807334SA (en) Methods, compositions, and devices for information storage
SG11201901862YA (en) Method and system for processing 360 degree video data
SG11201901577SA (en) Method and system for fast tracking navigation of blockchains via data manipulation
SG11201906238TA (en) Split sector level sweep using beamforming refinement frames
SG11201810443SA (en) Invasive medical devices including magnetic region and systems and methods
SG11201806650VA (en) Systems and methods for providing a personal distributed ledger
SG11201907618RA (en) Automated storage and retrieval systems and methods
CA3015496A1 (en) Voice control of a media playback system
SG11201804915RA (en) Methods for treating huntington's disease
SG11201809963XA (en) Application framework using blockchain-based asset ownership
SG11201804807VA (en) Computer architecture and method for modifying data intake parameters based on a predictive model
SG11201804556YA (en) System, method, and device for generating a geographic area heat map
SG11201807823WA (en) Bandwith agnostic tone mapping
SG11201903958SA (en) Intuitive occluded object indicator
SG11201810387YA (en) Magnetized catheters, devices, uses and methods of using magnetized catheters
SG11201907668PA (en) Segment types as delimiters and addressable resource identifiers
SG11201806823YA (en) Extended synchronization signal for symbol index detection
SG11201803703UA (en) Anti-complement factor c1q fab fragments and uses thereof
SG11201900375YA (en) Link error correction in memory system
SG11201806825RA (en) A data source system agnostic fact category partitioned information repository and methods for the insertion and retrieval of data using the information repository
SG11201908760UA (en) Unified access control
SG11201810987TA (en) A thermoplastic optical device