WO2019078580A3 - 실감형 미디어를 전송하는 방법 및 장치 - Google Patents

실감형 미디어를 전송하는 방법 및 장치 Download PDF

Info

Publication number
WO2019078580A3
WO2019078580A3 PCT/KR2018/012174 KR2018012174W WO2019078580A3 WO 2019078580 A3 WO2019078580 A3 WO 2019078580A3 KR 2018012174 W KR2018012174 W KR 2018012174W WO 2019078580 A3 WO2019078580 A3 WO 2019078580A3
Authority
WO
WIPO (PCT)
Prior art keywords
interest
space
description information
immersive media
transmitting
Prior art date
Application number
PCT/KR2018/012174
Other languages
English (en)
French (fr)
Other versions
WO2019078580A2 (ko
Inventor
김동연
소영완
배재현
양현구
Original Assignee
삼성전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 삼성전자 주식회사 filed Critical 삼성전자 주식회사
Priority to EP18868334.6A priority Critical patent/EP3675489B1/en
Priority to CN201880067795.4A priority patent/CN111295880B/zh
Priority to US16/650,603 priority patent/US11463673B2/en
Publication of WO2019078580A2 publication Critical patent/WO2019078580A2/ko
Publication of WO2019078580A3 publication Critical patent/WO2019078580A3/ko

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/366Image reproducers using viewer tracking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/111Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H04N13/117Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/156Mixing image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/161Encoding, multiplexing or demultiplexing different image signal components
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/172Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H04N13/178Metadata, e.g. disparity information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194Transmission of image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/23614Multiplexing of additional data and video streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2387Stream processing in response to a playback request from an end-user, e.g. for trick-play
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • H04N21/44218Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508Management of client data or end-user data
    • H04N21/4532Management of client data or end-user data involving end-user characteristics, e.g. viewer profile, preferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4728End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6587Control parameters, e.g. trick play commands, viewpoint selection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/816Monomedia components thereof involving special video data, e.g 3D video

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Library & Information Science (AREA)
  • Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)

Abstract

미디어 송신 장치에서 실감형 미디어 서비스를 지원하는 방법이 제공된다. 상기 방법은 관심 공간 설명 정보를 기반으로 복수의 관심 공간 중 적어도 하나의 관심 공간을 결정하는 과정; 및 상기 관심 공간 설명 정보 중 상기 결정된 관심 공간에 상응한 일부 관심 공간 설명 정보와, 실감형 미디어 데이터 중 상기 결정된 적어도 하나의 관심 영역에 상응한 일부 실감형 미디어 데이터를 미디어 수신장치로 전송하는 과정을 포함하고, 여기서, 상기 일부 관심 공간 설명 정보는 상기 적어도 하나의 관심 공간의 식별 정보, 관심 객체에 대한 공간 범위 지시자, 상기 관심 객체에 대한 우선 순위 지시자, 상기 관심 객체에 대한 객체 방향성 중 적어도 하나를 포함함을 특징으로 한다.
PCT/KR2018/012174 2017-10-17 2018-10-16 실감형 미디어를 전송하는 방법 및 장치 WO2019078580A2 (ko)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP18868334.6A EP3675489B1 (en) 2017-10-17 2018-10-16 Method and device for transmitting immersive media
CN201880067795.4A CN111295880B (zh) 2017-10-17 2018-10-16 用于发送沉浸式媒体的方法和设备
US16/650,603 US11463673B2 (en) 2017-10-17 2018-10-16 Method and device for transmitting immersive media

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2017-0134909 2017-10-17
KR1020170134909A KR102390208B1 (ko) 2017-10-17 2017-10-17 멀티미디어 데이터를 전송하는 방법 및 장치

Publications (2)

Publication Number Publication Date
WO2019078580A2 WO2019078580A2 (ko) 2019-04-25
WO2019078580A3 true WO2019078580A3 (ko) 2019-06-13

Family

ID=66173266

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2018/012174 WO2019078580A2 (ko) 2017-10-17 2018-10-16 실감형 미디어를 전송하는 방법 및 장치

Country Status (5)

Country Link
US (1) US11463673B2 (ko)
EP (1) EP3675489B1 (ko)
KR (1) KR102390208B1 (ko)
CN (1) CN111295880B (ko)
WO (1) WO2019078580A2 (ko)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11432099B2 (en) * 2018-04-11 2022-08-30 Dolby International Ab Methods, apparatus and systems for 6DoF audio rendering and data representations and bitstream structures for 6DoF audio rendering
US11200700B2 (en) * 2019-01-10 2021-12-14 Mediatek Singapore Pte. Ltd. Methods and apparatus for signaling viewports and regions of interest for point cloud multimedia data
CN112150603B (zh) * 2019-06-28 2023-03-28 上海交通大学 基于三维点云的初始视角控制和呈现方法及系统
KR102373833B1 (ko) * 2020-01-09 2022-03-14 엘지전자 주식회사 포인트 클라우드 데이터 송신 장치, 포인트 클라우드 데이터 송신 방법, 포인트 클라우드 데이터 수신 장치 및 포인트 클라우드 데이터 수신 방법
US11570417B2 (en) 2021-05-20 2023-01-31 Apple Inc. Immersive video streaming using view-adaptive prefetching and buffer control

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100355990B1 (ko) * 2000-08-12 2002-10-18 (주)아이엠티소프트 인터넷 가상현실 서비스에서 점진적 데이터 전송을 위한vrml 노드 확장 및 처리 방법
KR20150061459A (ko) * 2013-11-27 2015-06-04 주식회사 넥스트이온 다시점 비디오 스트리밍 시스템 및 그 제공방법
JP2016105593A (ja) * 2014-11-26 2016-06-09 ソニー株式会社 ライブ選択的適応帯域幅
KR20160125708A (ko) * 2015-04-22 2016-11-01 삼성전자주식회사 가상현실 스트리밍 서비스를 위한 영상 데이터를 송수신하는 방법 및 장치
KR20170048137A (ko) * 2016-07-05 2017-05-08 안규태 미디어 컨텐츠 송신 방법, 미디어 컨텐츠 송신 장치, 미디어 컨텐츠 수신 방법, 및 미디어 컨텐츠 수신 장치

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102004038494A1 (de) * 2004-08-07 2006-03-16 Robert Bosch Gmbh Verfahren und Vorrichtung zum Betreiben eines Sensorsystems
US20130322697A1 (en) * 2012-05-31 2013-12-05 Hexagon Technology Center Gmbh Speed Calculation of a Moving Object based on Image Data
US9829984B2 (en) 2013-05-23 2017-11-28 Fastvdo Llc Motion-assisted visual language for human computer interfaces
KR102231676B1 (ko) * 2014-12-23 2021-03-25 한국전자통신연구원 실감 효과 메타데이터 생성 장치 및 방법
US10341632B2 (en) 2015-04-15 2019-07-02 Google Llc. Spatial random access enabled video system with a three-dimensional viewing volume
KR102354458B1 (ko) * 2015-08-19 2022-01-21 삼성전자주식회사 디스플레이 장치 및 그의 제어방법
EP3345184A1 (en) * 2015-09-02 2018-07-11 THOMSON Licensing Method, apparatus and system for facilitating navigation in an extended scene
US10096130B2 (en) * 2015-09-22 2018-10-09 Facebook, Inc. Systems and methods for content streaming
US10880535B2 (en) * 2016-02-17 2020-12-29 Lg Electronics Inc. Method for transmitting 360 video, method for receiving 360 video, apparatus for transmitting 360 video, and apparatus for receiving 360 video
CN109155055B (zh) * 2016-04-28 2023-06-20 夏普株式会社 关注区域图像生成装置
CN106231291B (zh) * 2016-07-18 2018-03-30 杭州当虹科技有限公司 一种基于虚拟现实视频的影片故事回溯方法
KR102352933B1 (ko) 2016-09-09 2022-01-20 삼성전자주식회사 3차원 이미지를 프로세싱하기 위한 방법 및 장치
US20180349708A1 (en) * 2017-05-30 2018-12-06 Google Inc. Methods and Systems for Presenting Image Data for Detected Regions of Interest
GB2565302B (en) * 2017-08-08 2022-04-13 Sony Interactive Entertainment Inc Head-mountable apparatus and methods
US11711544B2 (en) * 2019-07-02 2023-07-25 Apple Inc. Point cloud compression with supplemental information messages

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100355990B1 (ko) * 2000-08-12 2002-10-18 (주)아이엠티소프트 인터넷 가상현실 서비스에서 점진적 데이터 전송을 위한vrml 노드 확장 및 처리 방법
KR20150061459A (ko) * 2013-11-27 2015-06-04 주식회사 넥스트이온 다시점 비디오 스트리밍 시스템 및 그 제공방법
JP2016105593A (ja) * 2014-11-26 2016-06-09 ソニー株式会社 ライブ選択的適応帯域幅
KR20160125708A (ko) * 2015-04-22 2016-11-01 삼성전자주식회사 가상현실 스트리밍 서비스를 위한 영상 데이터를 송수신하는 방법 및 장치
KR20170048137A (ko) * 2016-07-05 2017-05-08 안규태 미디어 컨텐츠 송신 방법, 미디어 컨텐츠 송신 장치, 미디어 컨텐츠 수신 방법, 및 미디어 컨텐츠 수신 장치

Also Published As

Publication number Publication date
KR20190043059A (ko) 2019-04-25
EP3675489B1 (en) 2024-03-27
US20200228780A1 (en) 2020-07-16
WO2019078580A2 (ko) 2019-04-25
EP3675489A4 (en) 2020-11-04
CN111295880B (zh) 2022-03-25
US11463673B2 (en) 2022-10-04
KR102390208B1 (ko) 2022-04-25
CN111295880A (zh) 2020-06-16
EP3675489A2 (en) 2020-07-01

Similar Documents

Publication Publication Date Title
WO2019078580A3 (ko) 실감형 미디어를 전송하는 방법 및 장치
WO2017180335A8 (en) System and method for beam management
WO2016159715A3 (ko) 무선 통신 시스템에서 v2x 단말이 신호를 송수신 하는 방법 및 장치
PH12015502267A1 (en) Apparatus and method using backwards-compatible preamble formats for multiple access wlan communication system
WO2016060447A3 (ko) Hdmi를 사용한 데이터 송수신 기기 및 방법
PH12017500025A1 (en) Beacon discovery service
EP3911092A4 (en) METHOD, APPARATUS AND SYSTEM FOR DETERMINING SPATIAL RELATIONSHIP INFORMATION, AND METHOD AND APPARATUS FOR TRANSMITTING INFORMATION ELEMENTS
US11956734B2 (en) Wireless device and power control method
EP4329350A3 (en) Policy notification system and method for electronic vapour provision systems
BR112016020503A2 (pt) método para informar canal estatal de informação, equipamentos de usuário, e estação base
WO2016112308A3 (en) Multiple application module or unit
EP4236546A3 (en) Methods and systems for access point clustering
EP4236177A3 (en) Search space design for machine-type communications
WO2017171408A3 (ko) 무선 통신 시스템에서 채널 상태 정보를 전송하는 방법 및 이를 위한 장치
WO2015020896A3 (en) Systems and methods for determining a user equipment location based on measurements from multiple base stations
WO2008010168A3 (en) Method and system of beacon transmission and reception
JP2011188524A5 (ko)
MX2022000962A (es) Metodos de dispositivo inalambrico y nodo de red, tal dispositivo inalambrico y nodo de red, y programas informaticos de los mismos.
WO2014201159A3 (en) Position location system architecture: peer to peer measurement mode
MX2019000521A (es) Metodo y dispositivo terminal para transmitir datos.
WO2016056166A3 (en) Wireless communication device and communicaton method
WO2012077991A3 (ko) 무선 통신 시스템에서 채널 가용성 질의 및 응답을 송수신하는 방법 및 장치
EP3834534A4 (en) METHODS, APPARATUS, AND SYSTEMS FOR TRANSMITTING INDICATION INFORMATION
WO2012050330A3 (ko) 무선 접속 시스템에서 상향링크 제어정보 전송방법 및 장치
PH12019501398A1 (en) Method and device for transmitting system information

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18868334

Country of ref document: EP

Kind code of ref document: A2

ENP Entry into the national phase

Ref document number: 2018868334

Country of ref document: EP

Effective date: 20200327

NENP Non-entry into the national phase

Ref country code: DE