FR3067199B1 - Procede de transmission d'une video immersive - Google Patents

Procede de transmission d'une video immersive Download PDF

Info

Publication number
FR3067199B1
FR3067199B1 FR1755017A FR1755017A FR3067199B1 FR 3067199 B1 FR3067199 B1 FR 3067199B1 FR 1755017 A FR1755017 A FR 1755017A FR 1755017 A FR1755017 A FR 1755017A FR 3067199 B1 FR3067199 B1 FR 3067199B1
Authority
FR
France
Prior art keywords
immersive video
images
transmitting
blocks
display device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
FR1755017A
Other languages
English (en)
Other versions
FR3067199A1 (fr
Inventor
Pierre Sabatier
Jerome Berger
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sagemcom Broadband SAS
Original Assignee
Sagemcom Broadband SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sagemcom Broadband SAS filed Critical Sagemcom Broadband SAS
Priority to FR1755017A priority Critical patent/FR3067199B1/fr
Priority to BR112019025698-9A priority patent/BR112019025698A2/pt
Priority to CN201880037950.8A priority patent/CN110710221A/zh
Priority to US16/617,887 priority patent/US20200092591A1/en
Priority to PCT/EP2018/064706 priority patent/WO2018224473A1/fr
Priority to EP18728165.4A priority patent/EP3635960A1/fr
Publication of FR3067199A1 publication Critical patent/FR3067199A1/fr
Application granted granted Critical
Publication of FR3067199B1 publication Critical patent/FR3067199B1/fr
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234309Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194Transmission of image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/366Image reproducers using viewer tracking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/115Selection of the code volume for a coding unit prior to coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/164Feedback from the receiver or from the transmission channel
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/167Position within a video image, e.g. region of interest [ROI]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/174Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/231Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234345Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234363Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4728End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/816Monomedia components thereof involving special video data, e.g 3D video

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

L'invention concerne un procédé de transmission d'une vidéo immersive entre une unité réseau et au moins un équipement de visualisation permettant à une pluralité d'utilisateurs de visualiser simultanément ladite vidéo immersive, la vidéo immersive comprenant une suite d'ensembles d'images chacune composée de blocs de pixels, la vidéo immersive étant transmise sous une forme compressée à chaque équipement de visualisation. Le procédé est mis en œuvre par l'unité réseau et comprend pour chaque ensemble d'images : obtenir (501) une information représentative d'un point de vue sur la vidéo immersive de chaque utilisateur ; déterminer (502) au moins une zone d'image, dite zone privilégiée, correspondant à au moins une partie des points de vue ; pour chaque image comprise dans l'ensemble d'images, appliquer (503) aux blocs de pixels n'appartenant pas à une zone privilégiée, un taux de compression en moyenne plus élevé qu'une moyenne des taux de compression appliqués aux blocs de pixels appartenant à une zone privilégiée ; et, transmettre (504) l'ensemble d'images à chaque équipement de visualisation.
FR1755017A 2017-06-06 2017-06-06 Procede de transmission d'une video immersive Expired - Fee Related FR3067199B1 (fr)

Priority Applications (6)

Application Number Priority Date Filing Date Title
FR1755017A FR3067199B1 (fr) 2017-06-06 2017-06-06 Procede de transmission d'une video immersive
BR112019025698-9A BR112019025698A2 (pt) 2017-06-06 2018-06-05 método para transmitir um vídeo imersivo
CN201880037950.8A CN110710221A (zh) 2017-06-06 2018-06-05 用于传输沉浸式视频的方法
US16/617,887 US20200092591A1 (en) 2017-06-06 2018-06-05 Method for transmitting an immersive video
PCT/EP2018/064706 WO2018224473A1 (fr) 2017-06-06 2018-06-05 Procede de transmission d'une video immersive
EP18728165.4A EP3635960A1 (fr) 2017-06-06 2018-06-05 Procede de transmission d'une video immersive

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR1755017A FR3067199B1 (fr) 2017-06-06 2017-06-06 Procede de transmission d'une video immersive
FR1755017 2017-06-06

Publications (2)

Publication Number Publication Date
FR3067199A1 FR3067199A1 (fr) 2018-12-07
FR3067199B1 true FR3067199B1 (fr) 2020-05-22

Family

ID=59521086

Family Applications (1)

Application Number Title Priority Date Filing Date
FR1755017A Expired - Fee Related FR3067199B1 (fr) 2017-06-06 2017-06-06 Procede de transmission d'une video immersive

Country Status (6)

Country Link
US (1) US20200092591A1 (fr)
EP (1) EP3635960A1 (fr)
CN (1) CN110710221A (fr)
BR (1) BR112019025698A2 (fr)
FR (1) FR3067199B1 (fr)
WO (1) WO2018224473A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115225975A (zh) * 2020-03-24 2022-10-21 腾讯科技(深圳)有限公司 多自由度场景下的沉浸式媒体获取方法、设备及存储介质
CN114420066B (zh) * 2022-01-20 2023-04-25 海宁奕斯伟集成电路设计有限公司 图像处理方法、装置、电子设备及计算机可读存储介质

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7027655B2 (en) * 2001-03-29 2006-04-11 Electronics For Imaging, Inc. Digital image compression with spatially varying quality levels determined by identifying areas of interest
CN100496121C (zh) * 2007-04-11 2009-06-03 宁波大学 一种交互式多视点视频系统的图像信号处理方法
CN103002283A (zh) * 2012-11-20 2013-03-27 南京邮电大学 多视角分布式视频压缩的边信息生成方法
EP3113159A1 (fr) * 2015-06-30 2017-01-04 Thomson Licensing Procédé et dispositif pour le traitement d'une partie d'un contenu vidéo immersif selon la position de parties de référence

Also Published As

Publication number Publication date
WO2018224473A1 (fr) 2018-12-13
EP3635960A1 (fr) 2020-04-15
CN110710221A (zh) 2020-01-17
FR3067199A1 (fr) 2018-12-07
US20200092591A1 (en) 2020-03-19
BR112019025698A2 (pt) 2020-09-01

Similar Documents

Publication Publication Date Title
US10404963B1 (en) System for processing 2D content for 3D viewing
TW200704182A (en) A system and method for selective image capture, transimission and reconstruction
US20160205349A1 (en) Timestamp-based audio and video processing method and system thereof
EP4254903A3 (fr) Simulation d'une expérience locale par diffusion par flux continu en direct de points de vue partageables d'un événement en direct
FR3067199B1 (fr) Procede de transmission d'une video immersive
EP3361724A3 (fr) Système et procédé permettant de produire un point de vue virtuel
FR3039673B1 (fr) Terminal mobile et methode de controle associee
US20150244977A1 (en) Multi-Camera Access for Remote Video Access
SG11201900337UA (en) Panoramic video compression method and device
EP3629570A3 (fr) Appareil de capture d'images et procédé d'enregistrement d'images
FR3066671B1 (fr) Procede d'incrustation d'images ou de video au sein d'une autre sequence video
JP2020017871A5 (fr)
FR3066672B1 (fr) Procede de communication d'une video immersive
KR101295976B1 (ko) 3d 화상 회의 시스템
SG10201710280VA (en) System and method for detecting vibrations of a machine using a low frames per second (fps) camera
EP3799415A3 (fr) Procédé et dispositif de traitement de vidéos et support
JP2015506622A (ja) ビデオ監視のための方法、関連するシステム、関連する監視サーバ及び関連する監視カメラ
CA2983339A1 (fr) Systemes d'affichage utilisant la reconnaissance faciale a des fins de surveillance de personnes regardant des dispositifs d'affichage
FR3074948B1 (fr) Systeme et procede de traitement d’images collaboratif et interactif
EP3772219A3 (fr) Appareil et système de détermination à base d'image
FR3098073B1 (fr) Procédé de codage et de décodage d’une image d’une séquence vidéo et dispositif associé
TW202423109A (zh) 主持端視訊裝置、與會端視訊裝置及視訊會議系統
FR3091610B1 (fr) Procédé de traitement d’images numériques
WO2022143426A1 (fr) Dispositif de conférence et système de conférence
Dhodapkar Preprocessing Logic to Enhance Videotelephony Services During Suboptimal Network Conditions

Legal Events

Date Code Title Description
PLFP Fee payment

Year of fee payment: 2

PLSC Publication of the preliminary search report

Effective date: 20181207

PLFP Fee payment

Year of fee payment: 3

PLFP Fee payment

Year of fee payment: 4

ST Notification of lapse

Effective date: 20220205