WO2017200804A1 - Most-interested region in an image - Google Patents

Most-interested region in an image Download PDF

Info

Publication number
WO2017200804A1
WO2017200804A1 PCT/US2017/031789 US2017031789W WO2017200804A1 WO 2017200804 A1 WO2017200804 A1 WO 2017200804A1 US 2017031789 W US2017031789 W US 2017031789W WO 2017200804 A1 WO2017200804 A1 WO 2017200804A1
Authority
WO
WIPO (PCT)
Prior art keywords
interested
regions
representative
data
region
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2017/031789
Other languages
English (en)
French (fr)
Inventor
Ye-Kui Wang
Fnu HENDRY
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Priority to EP17724262.5A priority Critical patent/EP3459247B1/en
Priority to ES17724262T priority patent/ES2896687T3/es
Priority to CN201780028714.5A priority patent/CN109076229B/zh
Priority to CA3020511A priority patent/CA3020511A1/en
Priority to BR112018073451-9A priority patent/BR112018073451A2/pt
Priority to JP2018560070A priority patent/JP2019519981A/ja
Priority to KR1020187032877A priority patent/KR102252238B1/ko
Publication of WO2017200804A1 publication Critical patent/WO2017200804A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/167—Position within a video image, e.g. region of interest [ROI]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/70—Media network packetisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80—Responding to QoS
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/162—User input
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/164—Feedback from the receiver or from the transmission channel
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234345—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4728—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments

Definitions

  • Video compression techniques perform spatial prediction and/or temporal prediction to reduce or remove redundancy inherent in video sequences.
  • a video frame or slice may be partitioned into macroblocks or coding tree units (CTUs).
  • CTUs coding tree units
  • FIG. 7 is a flowchart illustrating an example approach for pre-fetching video data in accordance with one or more techniques described in this disclosure.
  • audio source 22 may send data to audio encoder 26 corresponding to a time at which audio data was recorded
  • video source 24 may send data to video encoder 28 corresponding to a time at which video data was recorded
  • audio encoder 26 may encode a sequence identifier in encoded audio data to indicate a relative temporal ordering of encoded audio data but without necessarily indicating an absolute time at which the audio data was recorded
  • video encoder 28 may also use sequence identifiers to indicate a relative temporal ordering of encoded video data.
  • a sequence identifier may be mapped or otherwise correlated with a timestamp.
  • encapsulation unit 30 of content preparation device 20 receives elementary streams comprising coded video data from video encoder 28 and elementary streams comprising coded audio data from audio encoder 26.
  • video encoder 28 and audio encoder 26 may each include packetizers for forming PES packets from encoded data.
  • video encoder 28 and audio encoder 26 may each interface with respective packetizers for forming PES packets from encoded data.
  • encapsulation unit 30 may include packetizers for forming PES packets from encoded audio and video data.
  • Request processing unit 70 may derive one or more most-interested regions from the assembled data. More specifically, for instance, in response to determining that one or more regions of an image are the most-frequently requested regions of the image compared to other regions of the image, request processing unit 70 may select the one or more regions as the one or more most-interested regions of the image. In some examples, request processing unit 70 may select one or more regions as the one or more most-interested regions of the image when the one or more regions have been included in user's field of view at a frequency that satisfies a threshold. For instance, request processing unit 70 may select the one or more regions as the one or more most- interested regions of the image when the assembled data indicates that at least half of the user's field of views include the one or more regions.
  • retrieval unit 52 may retrieve configuration data (not shown) of client device 40 to determine decoding capabilities of video decoder 48 and rendering capabilities of video output 44.
  • the configuration data may also include any or all of a language preference selected by a user of client device 40, one or more camera perspectives corresponding to depth preferences set by the user of client device 40, and/or a rating preference selected by the user of client device 40.
  • Retrieval unit 52 may comprise, for example, a web browser or a media client configured to submit HTTP GET and partial GET requests.
  • Retrieval unit 52 may correspond to software instructions executed by one or more processors or processing units (not shown) of client device 40. In some examples, all or portions of the functionality described with respect to retrieval unit 52 may be implemented in hardware, or a combination of hardware, software, and/or firmware, where requisite hardware may be provided to execute instructions for software or firmware.
  • retrieval unit 52 may be configured to receive data in accordance with a broadcast or multicast network protocol, such as eMBMS or IP multicast.
  • retrieval unit 52 may submit a request to join a multicast network group associated with particular media content. After joining the multicast group, retrieval unit 52 may receive data of the multicast group without further requests issued to server device 60 or content preparation device 20.
  • Retrieval unit 52 may submit a request to leave the multicast group when data of the multicast group is no longer needed, e.g., to stop playback or to change channels to a different multicast group.
  • Using the information on most-interested regions for displaying the most-interested regions without user control may lower VR video experience if the user is actually interested other regions in the VR video. Instead, the information on most-interested regions may be used in other ways for improved VR video experience.
  • the most-interested regions in a particular set of pictures of a VR video may be determined or created by other ways than director's cut.
  • each set may include four syntax element indicating the up, bottom, left and right offsets, in number of luma samples in relative to the full picture, of the four corners of a rectangle that is a most-interested region.
  • each set may include two syntax element indicating the coordinate, in number of luma samples in relative to the full picture, of the upper-left corner of a rectangle that is a most-interested region, and two syntax elements indicating the width and height of the rectangle.
  • SBGP box 162 may include data representative of the one or more most-interested regions.
  • SEI message 172 may include data representative of the one or more most-interested regions.
  • the receiver receives the video bitstream(s) or part thereof, possibly encapsulated in a format, and sends the decoded video signal or part thereof to a rendering device.
  • Client device 40 may pre-fetch high-quality video data for the one or more most- interested regions (304). For example, client device 40 may request video data for the one or more most-interested regions using a relatively high bitrate compared to other regions of the image. Server device 60 may receive the pre-fetch request (306) and may send high-quality video data for the one or more most-interested regions (308). Client device 40 may receive the high-quality video data (310). For example, client device 40 may fetch the video data for the one or more most-interested regions at a lower latency and/or at a higher quality than video data for the other regions of the image.
  • server device 60 may generate file-format data, such as a sample group box (e.g., SBGP box 162 of FIG. 3), including the data representative of the most-interested regions.
  • server device 60 may generate a timed metadata track including the data representative of the most-interested regions.
  • server device 60 may receive data representative of the most-interested regions of an image (360).
  • the data representative of the most-interested regions may be external to VCL data of a bitstream including the video data.
  • server device 60 receives a supplemental enhancement information (SEI) message including the data representative of the most-interested regions.
  • SEI Supplemental Enhancement information
  • server device 60 receives a sample group box (e.g., SBGP box 162 of FIG. 3) including the data representative of the most-interested regions.
  • server device 60 receives a timed metadata track including the data representative of the most-interested regions.
  • server device 60 may pre-fetch high-quality video data for the one or more interested regions (362).

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Graphics (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
PCT/US2017/031789 2016-05-19 2017-05-09 Most-interested region in an image Ceased WO2017200804A1 (en)

Priority Applications (7)

Application Number Priority Date Filing Date Title
EP17724262.5A EP3459247B1 (en) 2016-05-19 2017-05-09 Most-interested region in an image
ES17724262T ES2896687T3 (es) 2016-05-19 2017-05-09 Región más interesada en una imagen
CN201780028714.5A CN109076229B (zh) 2016-05-19 2017-05-09 在图片中最感兴趣的区域
CA3020511A CA3020511A1 (en) 2016-05-19 2017-05-09 Most-interested region in an image
BR112018073451-9A BR112018073451A2 (pt) 2016-05-19 2017-05-09 região de maior interesse em uma imagem
JP2018560070A JP2019519981A (ja) 2016-05-19 2017-05-09 画像中の最上位関心領域
KR1020187032877A KR102252238B1 (ko) 2016-05-19 2017-05-09 이미지에서의 가장 관심있는 영역

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201662339009P 2016-05-19 2016-05-19
US62/339,009 2016-05-19
US15/589,782 US10582201B2 (en) 2016-05-19 2017-05-08 Most-interested region in an image
US15/589,782 2017-05-08

Publications (1)

Publication Number Publication Date
WO2017200804A1 true WO2017200804A1 (en) 2017-11-23

Family

ID=58710167

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2017/031789 Ceased WO2017200804A1 (en) 2016-05-19 2017-05-09 Most-interested region in an image

Country Status (10)

Country Link
US (1) US10582201B2 (enExample)
EP (1) EP3459247B1 (enExample)
JP (1) JP2019519981A (enExample)
KR (1) KR102252238B1 (enExample)
CN (1) CN109076229B (enExample)
BR (1) BR112018073451A2 (enExample)
CA (1) CA3020511A1 (enExample)
ES (1) ES2896687T3 (enExample)
TW (1) TW201810998A (enExample)
WO (1) WO2017200804A1 (enExample)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2021526778A (ja) * 2018-05-22 2021-10-07 華為技術有限公司Ｈｕａｗｅｉ Ｔｅｃｈｎｏｌｏｇｉｅｓ Ｃｏ．，Ｌｔｄ． Ｖｒビデオ再生方法、端末、およびサーバ
US11489900B2 (en) 2016-10-12 2022-11-01 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Spatially unequal streaming

Families Citing this family (56)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10291923B2 (en) 2016-05-24 2019-05-14 Qualcomm Incorporated Mapping of tile grouping and samples in HEVC and L-HEVC file formats
WO2018011054A1 (en) 2016-07-15 2018-01-18 Koninklijke Kpn N.V. Streaming virtual reality video
TWI599218B (zh) * 2016-07-29 2017-09-11 元智大學 即時影音傳輸系統
CN109923867A (zh) * 2016-09-14 2019-06-21 皇家Kpn公司 流式传输虚拟现实视频
US11197040B2 (en) * 2016-10-17 2021-12-07 Mediatek Inc. Deriving and signaling a region or viewport in streaming media
EP3535644B1 (en) 2016-11-04 2023-02-22 Koninklijke KPN N.V. Streaming virtual reality video
US20180176468A1 (en) 2016-12-19 2018-06-21 Qualcomm Incorporated Preferred rendering of signalled regions-of-interest or viewports in virtual reality video
US10999602B2 (en) 2016-12-23 2021-05-04 Apple Inc. Sphere projected motion estimation/compensation and mode decision
US11290755B2 (en) 2017-01-10 2022-03-29 Qualcomm Incorporated Signaling data for prefetching support for streaming media data
US11259046B2 (en) 2017-02-15 2022-02-22 Apple Inc. Processing of equirectangular object data to compensate for distortion by spherical projections
KR102424829B1 (ko) * 2017-02-22 2022-07-25 에스케이텔레콤 주식회사 비디오 데이터가 부호화된 비트스트림을 처리하는 방법
WO2018155939A1 (ko) 2017-02-22 2018-08-30 에스케이텔레콤 주식회사 영상 복호화 방법 및 장치
US10924747B2 (en) 2017-02-27 2021-02-16 Apple Inc. Video coding techniques for multi-view video
US11093752B2 (en) 2017-06-02 2021-08-17 Apple Inc. Object tracking in multi-view video
JP6797755B2 (ja) * 2017-06-20 2020-12-09 キヤノン株式会社 撮像装置、撮像装置の処理方法およびプログラム
US10754242B2 (en) * 2017-06-30 2020-08-25 Apple Inc. Adaptive resolution and projection format in multi-direction video
JP7035401B2 (ja) * 2017-09-15 2022-03-15 ソニーグループ株式会社 画像処理装置およびファイル生成装置
US10931725B2 (en) * 2017-09-29 2021-02-23 Apple Inc. Multiway audio-video conferencing
WO2019070686A1 (en) 2017-10-04 2019-04-11 Vid Scale, Inc. 360 DEGREES MULTIMEDIA VISUALIZATION CUSTOMIZED
US10798455B2 (en) * 2017-12-22 2020-10-06 Comcast Cable Communications, Llc Video delivery
US10390063B2 (en) 2017-12-22 2019-08-20 Comcast Cable Communications, Llc Predictive content delivery for video streaming services
CN111869221B (zh) * 2018-04-05 2021-07-20 华为技术有限公司 Dash对象之间的有效关联
US10623791B2 (en) 2018-06-01 2020-04-14 At&T Intellectual Property I, L.P. Field of view prediction in live panoramic video streaming
US10812774B2 (en) 2018-06-06 2020-10-20 At&T Intellectual Property I, L.P. Methods and devices for adapting the rate of video content streaming
US11108841B2 (en) 2018-06-19 2021-08-31 At&T Intellectual Property I, L.P. Apparatus, storage medium and method for heterogeneous segmentation of video streaming
CN108833976B (zh) * 2018-06-27 2020-01-24 深圳看到科技有限公司 一种全景视频动态切流后的画面质量评估方法及装置
US10616621B2 (en) 2018-06-29 2020-04-07 At&T Intellectual Property I, L.P. Methods and devices for determining multipath routing for panoramic video content
CN110798707B (zh) * 2018-08-02 2023-06-16 华为技术有限公司 传输媒体数据的方法、客户端和服务器
US10708494B2 (en) 2018-08-13 2020-07-07 At&T Intellectual Property I, L.P. Methods, systems and devices for adjusting panoramic video content
US11019361B2 (en) 2018-08-13 2021-05-25 At&T Intellectual Property I, L.P. Methods, systems and devices for adjusting panoramic view of a camera for capturing video content
US10826964B2 (en) 2018-09-05 2020-11-03 At&T Intellectual Property I, L.P. Priority-based tile transmission system and method for panoramic video streaming
US10999583B2 (en) 2018-09-14 2021-05-04 Apple Inc. Scalability of multi-directional video streaming
JP2021192471A (ja) * 2018-09-14 2021-12-16 ソニーグループ株式会社 表示制御装置および表示制御方法、並びにプログラム
US10779014B2 (en) * 2018-10-18 2020-09-15 At&T Intellectual Property I, L.P. Tile scheduler for viewport-adaptive panoramic video streaming
US10560759B1 (en) 2018-10-23 2020-02-11 At&T Intellectual Property I, L.P. Active network support on adaptive virtual reality video transmission
US10939139B2 (en) 2018-11-29 2021-03-02 Apple Inc. Adaptive coding and streaming of multi-directional video
US11032607B2 (en) 2018-12-07 2021-06-08 At&T Intellectual Property I, L.P. Methods, devices, and systems for embedding visual advertisements in video content
WO2020141259A2 (en) 2019-01-04 2020-07-09 Nokia Technologies Oy Method and apparatus for storage and signaling of media segment sizes and priority ranks
KR20200092127A (ko) 2019-01-24 2020-08-03 현대자동차주식회사 형상기억 고분자를 적용한 자동차 패널의 복원방법
US11523185B2 (en) 2019-06-19 2022-12-06 Koninklijke Kpn N.V. Rendering video stream in sub-area of visible display area
CN112312159A (zh) * 2019-07-30 2021-02-02 华为技术有限公司 视频的缓存方法和装置
US11956295B2 (en) 2019-09-27 2024-04-09 Apple Inc. Client-end enhanced view prediction for multi-view video streaming exploiting pre-fetched data and side information
US11303688B2 (en) 2019-09-30 2022-04-12 Tencent America LLC Methods and apparatuses for dynamic adaptive streaming over HTTP
US11503099B2 (en) * 2020-03-31 2022-11-15 Google Llc Methods, systems, and media for selecting video formats for adaptive video streaming
WO2021197447A1 (en) 2020-04-01 2021-10-07 Beijing Bytedance Network Technology Co., Ltd. Controlling quantization parameter delta signaling
JP7425224B2 (ja) * 2020-04-07 2024-01-30 北京字節跳動網絡技術有限公司 高レベル構文におけるインター予測のための信号通知
CN115668917A (zh) 2020-04-09 2023-01-31 抖音视界有限公司 视频编解码中的去块信令通知
WO2021204251A1 (en) 2020-04-10 2021-10-14 Beijing Bytedance Network Technology Co., Ltd. Use of header syntax elements and adaptation parameter set
CN115868159A (zh) 2020-04-17 2023-03-28 抖音视界有限公司 自适应参数集单元的存在
WO2021222037A1 (en) 2020-04-26 2021-11-04 Bytedance Inc. Conditional signaling of weighted prediction information
US20220086387A1 (en) 2020-09-17 2022-03-17 Lemon Inc. Subpicture entity groups in video coding
CN115776585B (zh) * 2020-12-11 2025-10-31 海信视像科技股份有限公司 显示设备和内容展示方法
CN113362438A (zh) * 2021-06-30 2021-09-07 北京百度网讯科技有限公司 全景渲染的方法、装置、电子设备、介质及程序
WO2023015391A1 (en) * 2021-08-09 2023-02-16 Summit-Tech Multimedia Communications Inc. System and method for real-time multi-resolution video stream tile encoding with selective tile delivery by aggregator-server to the client based on user position and depth requirements
WO2023220006A1 (en) * 2022-05-09 2023-11-16 Bytedance Inc. Signaling of picture-in-picture in media files
US20240223780A1 (en) * 2023-01-04 2024-07-04 Meta Platforms Technologies, Llc Generating tile-based region of interest representation of video frames for video encoding

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140092963A1 (en) * 2012-09-28 2014-04-03 Qualcomm Incorporated Signaling of regions of interest and gradual decoding refresh in video coding
WO2015197815A1 (en) * 2014-06-27 2015-12-30 Koninklijke Kpn N.V. Determining a region of interest on the basis of a hevc-tiled video stream

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20080069890A (ko) * 2007-01-24 2008-07-29 강호갑 사용자의 서비스 등급에 따라 차등화된 이미지 품질을제공하는 보호된 이미지 서비스 시스템
EP2174500A2 (en) * 2007-06-29 2010-04-14 Thomson Licensing Video indexing method, and video indexing device
WO2009023188A2 (en) * 2007-08-15 2009-02-19 Thomson Licensing Method and apparatus for improved video encoding using region of interest (roi) information
KR101042352B1 (ko) * 2008-08-29 2011-06-17 한국전자통신연구원 멀티미디어 방송 시스템에서의 방송신호 수신장치 및 그 방법
JP2010212811A (ja) * 2009-03-06 2010-09-24 Panasonic Corp 動画像符号化装置及び動画像復号化装置
EP2424247B1 (en) * 2009-04-21 2016-08-24 LG Electronics Inc. Method and apparatus for processing multi-view video signal
US8667054B2 (en) * 2010-07-12 2014-03-04 Opus Medicus, Inc. Systems and methods for networked, in-context, composed, high resolution image viewing
KR20120059214A (ko) * 2010-11-30 2012-06-08 고려대학교 산학협력단 적응적 관심 영역을 적용한 비디오 스트리밍을 제공하는 비디오 코덱 장치 및 그 방법
US10349077B2 (en) * 2011-11-21 2019-07-09 Canon Kabushiki Kaisha Image coding apparatus, image coding method, image decoding apparatus, image decoding method, and storage medium
ES2614910T3 (es) * 2012-06-29 2017-06-02 Ge Video Compression, Llc Concepto de flujo de datos de vídeo
US10021394B2 (en) * 2012-09-24 2018-07-10 Qualcomm Incorporated Hypothetical reference decoder parameters in video coding
KR101987820B1 (ko) * 2012-10-05 2019-06-11 삼성전자주식회사 고 해상도 컨텐츠를 처리하는 컨텐츠 처리 장치 및 그 방법
EP2907313A1 (en) * 2012-10-12 2015-08-19 Canon Kabushiki Kaisha Method and corresponding device for streaming video data
US9521393B2 (en) * 2013-01-07 2016-12-13 Qualcomm Incorporated Non-nested SEI messages in video coding
WO2014168972A1 (en) * 2013-04-08 2014-10-16 Sony Corporation Region of interest scalability with shvc
CA2949005C (en) * 2013-05-26 2021-06-29 Pixellot Ltd. Method and system for low cost television production
US10003815B2 (en) * 2013-06-03 2018-06-19 Qualcomm Incorporated Hypothetical reference decoder model and conformance for cross-layer random access skipped pictures
CN105359512B (zh) * 2013-07-15 2019-05-28 索尼公司 用于交互性的运动约束贴片集合sei消息的扩展
WO2015058097A1 (en) * 2013-10-18 2015-04-23 Seven Bridges Genomics Inc. Methods and systems for identifying disease-induced mutations
US10645404B2 (en) * 2014-03-24 2020-05-05 Qualcomm Incorporated Generic use of HEVC SEI messages for multi-layer codecs
JP2015222470A (ja) * 2014-05-22 2015-12-10 ソニー株式会社 映像表示装置、情報処理装置、及び映像表示システム
WO2016043637A1 (en) * 2014-09-19 2016-03-24 Telefonaktiebolaget L M Ericsson (Publ) Methods, encoders and decoders for coding of video sequences
US9800898B2 (en) * 2014-10-06 2017-10-24 Microsoft Technology Licensing, Llc Syntax structures indicating completion of coded regions

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140092963A1 (en) * 2012-09-28 2014-04-03 Qualcomm Incorporated Signaling of regions of interest and gradual decoding refresh in video coding
WO2015197815A1 (en) * 2014-06-27 2015-12-30 Koninklijke Kpn N.V. Determining a region of interest on the basis of a hevc-tiled video stream

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
EVGENY KUZYAKOV: "Next-generation video encoding techniques for 360 video and VR | Engineering Blog | Facebook Code | Facebook", 21 January 2016 (2016-01-21), XP055387524, Retrieved from the Internet <URL:https://code.facebook.com/posts/1126354007399553/next-generation-video-encoding-techniques-for-360-video-and-vr/> [retrieved on 20170704] *
JANGWON LEE ET AL: "Additional Requirements for Omnidirectional Media Format", 114. MPEG MEETING; 22-2-2016 - 26-2-2016; SAN DIEGO; (MOTION PICTURE EXPERT GROUP OR ISO/IEC JTC1/SC29/WG11),, no. m37819, 17 February 2016 (2016-02-17), XP030066185 *
YE-KUI WANG ET AL: "Signalling of most-interested regions of VR video", 115. MPEG MEETING; 30-5-2016 - 3-6-2016; GENEVA; (MOTION PICTURE EXPERT GROUP OR ISO/IEC JTC1/SC29/WG11),, no. m38560, 25 May 2016 (2016-05-25), XP030066916 *

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11539778B2 (en) 2016-10-12 2022-12-27 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Spatially unequal streaming
US11546404B2 (en) 2016-10-12 2023-01-03 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Spatially unequal streaming
US11489900B2 (en) 2016-10-12 2022-11-01 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Spatially unequal streaming
US11496541B2 (en) 2016-10-12 2022-11-08 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Spatially unequal streaming
US11496538B2 (en) 2016-10-12 2022-11-08 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E. V. Spatially unequal streaming
US11496540B2 (en) 2016-10-12 2022-11-08 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Spatially unequal streaming
US12519847B2 (en) 2016-10-12 2026-01-06 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Spatially unequal streaming
US11496539B2 (en) 2016-10-12 2022-11-08 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Spatially unequal streaming
JP7550197B2 (ja) 2016-10-12 2024-09-12 フラウンホッファー－ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー．ファオ 空間的不均等ストリーミング
US11516273B2 (en) 2016-10-12 2022-11-29 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Spatially unequal streaming
JP2023011616A (ja) * 2016-10-12 2023-01-24 フラウンホッファー－ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー．ファオ 空間的不均等ストリーミング
JP2023011621A (ja) * 2016-10-12 2023-01-24 フラウンホッファー－ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー．ファオ 空間的不均等ストリーミング
JP7550196B2 (ja) 2016-10-12 2024-09-12 フラウンホッファー－ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー．ファオ 空間的不均等ストリーミング
US11765427B2 (en) 2018-05-22 2023-09-19 Huawei Technologies Co., Ltd. Virtual reality video playing method, terminal, and server
JP2021526778A (ja) * 2018-05-22 2021-10-07 華為技術有限公司Ｈｕａｗｅｉ Ｔｅｃｈｎｏｌｏｇｉｅｓ Ｃｏ．，Ｌｔｄ． Ｖｒビデオ再生方法、端末、およびサーバ
JP7150984B2 (ja) 2018-05-22 2022-10-11 華為技術有限公司 Ｖｒビデオ再生方法、端末、およびサーバ

Also Published As

Publication number Publication date
KR102252238B1 (ko) 2021-05-14
CN109076229A (zh) 2018-12-21
CA3020511A1 (en) 2017-11-23
US10582201B2 (en) 2020-03-03
US20170339415A1 (en) 2017-11-23
JP2019519981A (ja) 2019-07-11
ES2896687T3 (es) 2022-02-25
KR20190009290A (ko) 2019-01-28
EP3459247B1 (en) 2021-10-13
BR112018073451A2 (pt) 2019-03-26
CN109076229B (zh) 2022-04-15
TW201810998A (zh) 2018-03-16
EP3459247A1 (en) 2019-03-27

Similar Documents

Publication Publication Date Title
EP3459247B1 (en) Most-interested region in an image
AU2023200083B2 (en) Signaling important video information in network video streaming using mime type parameters
US11375291B2 (en) Virtual reality video signaling in dynamic adaptive streaming over HTTP
US10565463B2 (en) Advanced signaling of a most-interested region in an image
US11290755B2 (en) Signaling data for prefetching support for streaming media data
US10567734B2 (en) Processing omnidirectional media with dynamic region-wise packing
KR20200030053A (ko) 미디어 콘텐츠를 위한 영역별 패킹, 콘텐츠 커버리지, 및 시그널링 프레임 패킹
EP3652952A1 (en) Processing media data using a generic descriptor for file format boxes
AU2018301313B2 (en) Processing media data using an omnidirectional media format

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 3020511

Country of ref document: CA

ENP Entry into the national phase

Ref document number: 20187032877

Country of ref document: KR

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2018560070

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112018073451

Country of ref document: BR

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17724262

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2017724262

Country of ref document: EP

Effective date: 20181219

ENP Entry into the national phase

Ref document number: 112018073451

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20181113