GB2565301A - Three-dimensional video processing - Google Patents

Three-dimensional video processing Download PDF

Info

Publication number
GB2565301A
GB2565301A GB1712687.1A GB201712687A GB2565301A GB 2565301 A GB2565301 A GB 2565301A GB 201712687 A GB201712687 A GB 201712687A GB 2565301 A GB2565301 A GB 2565301A
Authority
GB
United Kingdom
Prior art keywords
tiles
data
tile
video
video content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
GB1712687.1A
Other languages
English (en)
Other versions
GB201712687D0 (en
Inventor
Pystynen Johannes
Tapio Roimela Kimmo
Pesonen Mika
Rajala Johannes
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nokia Technologies Oy
Original Assignee
Nokia Technologies Oy
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nokia Technologies Oy filed Critical Nokia Technologies Oy
Priority to GB1712687.1A priority Critical patent/GB2565301A/en
Publication of GB201712687D0 publication Critical patent/GB201712687D0/en
Priority to PCT/FI2018/050432 priority patent/WO2019030427A1/fr
Priority to EP18844510.0A priority patent/EP3665656B1/fr
Priority to US16/634,816 priority patent/US11430178B2/en
Publication of GB2565301A publication Critical patent/GB2565301A/en
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/08—Volume rendering
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/30—Clipping
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/2224—Studio circuitry; Studio devices; Studio equipment related to virtual studio applications
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B37/00—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
    • G03B37/04—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe with cameras or projectors providing touching or overlapping fields of view
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/04—Indexing scheme for image data processing or generation, in general involving 3D image data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/32—Indexing scheme for image data processing or generation, in general involving image mosaicing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • General Engineering & Computer Science (AREA)
  • Geometry (AREA)
  • Computer Hardware Design (AREA)
  • Human Computer Interaction (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Processing Or Creating Images (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
GB1712687.1A 2017-08-08 2017-08-08 Three-dimensional video processing Withdrawn GB2565301A (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
GB1712687.1A GB2565301A (en) 2017-08-08 2017-08-08 Three-dimensional video processing
PCT/FI2018/050432 WO2019030427A1 (fr) 2017-08-08 2018-06-11 Traitement de vidéo en trois dimensions
EP18844510.0A EP3665656B1 (fr) 2017-08-08 2018-06-11 Traitement de vidéo en trois dimensions
US16/634,816 US11430178B2 (en) 2017-08-08 2018-06-11 Three-dimensional video processing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GB1712687.1A GB2565301A (en) 2017-08-08 2017-08-08 Three-dimensional video processing

Publications (2)

Publication Number Publication Date
GB201712687D0 GB201712687D0 (en) 2017-09-20
GB2565301A true GB2565301A (en) 2019-02-13

Family

ID=59894953

Family Applications (1)

Application Number Title Priority Date Filing Date
GB1712687.1A Withdrawn GB2565301A (en) 2017-08-08 2017-08-08 Three-dimensional video processing

Country Status (4)

Country Link
US (1) US11430178B2 (fr)
EP (1) EP3665656B1 (fr)
GB (1) GB2565301A (fr)
WO (1) WO2019030427A1 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11430412B2 (en) * 2017-12-19 2022-08-30 Sony Interactive Entertainment Inc. Freely selected point of view image generating apparatus, reference image data generating apparatus, freely selected point of view image generating method, and reference image data generating method
US10742882B1 (en) * 2019-05-17 2020-08-11 Gopro, Inc. Systems and methods for framing videos
US11871114B2 (en) * 2019-10-04 2024-01-09 Visit Inc. System and method for producing panoramic image content

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1950706A2 (fr) * 2007-01-24 2008-07-30 Vivante Corporation Procédé pour détourage distribué en dehors du volume de visualisation
WO2010035223A1 (fr) * 2008-09-25 2010-04-01 Koninklijke Philips Electronics N.V. Traitement de données d'image tridimensionnelles
EP2180449A1 (fr) * 2008-10-21 2010-04-28 Koninklijke Philips Electronics N.V. Procédé et dispositif pour la fourniture d'un modèle de profondeur stratifié
EP3200157A2 (fr) * 2016-02-01 2017-08-02 Imagination Technologies Limited Rendu de tronc de cône

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5990904A (en) 1995-08-04 1999-11-23 Microsoft Corporation Method and system for merging pixel fragments in a graphics rendering system
US6856320B1 (en) * 1997-11-25 2005-02-15 Nvidia U.S. Investment Company Demand-based memory system for graphics applications
US6480205B1 (en) * 1998-07-22 2002-11-12 Nvidia Corporation Method and apparatus for occlusion culling in graphics systems
US6577679B1 (en) 1999-09-30 2003-06-10 Hewlett-Packard Development Company Lp Method and apparatus for transcoding coded picture signals from object-based coding to block-based coding
US7139003B1 (en) 2003-12-15 2006-11-21 Nvidia Corporation Methods of processing graphics data including reading and writing buffers
US7450120B1 (en) 2003-12-19 2008-11-11 Nvidia Corporation Apparatus, system, and method for Z-culling
US7978194B2 (en) 2004-03-02 2011-07-12 Ati Technologies Ulc Method and apparatus for hierarchical Z buffering and stenciling
US8089486B2 (en) * 2005-03-21 2012-01-03 Qualcomm Incorporated Tiled prefetched and cached depth buffer
WO2009041918A1 (fr) * 2007-09-26 2009-04-02 Agency For Science, Technology And Research Procédé et système pour générer une image entièrement bien focalisée d'une grande scène tridimensionnelle
EP2729918A4 (fr) 2011-06-23 2015-12-23 Intel Corp Tramage stochastique avec élimination sélective
EP2742695A4 (fr) * 2011-08-10 2016-08-31 Ericsson Telefon Ab L M Procédé et appareil pour créer une carte de désocclusion utilisée pour le codage d'une vidéo tridimensionnelle
US9311743B2 (en) 2013-10-23 2016-04-12 Qualcomm Incorporated Selectively merging partially-covered tiles to perform hierarchical z-culling
US9324180B2 (en) * 2013-12-09 2016-04-26 Intel Corporation Culling using masked depths
US9418471B2 (en) * 2014-03-18 2016-08-16 Intel Corporation Compact depth plane representation for sort last architectures
WO2015172227A1 (fr) * 2014-05-13 2015-11-19 Pcp Vr Inc. Procédé, système et appareil de production et lecture de contenu multimédia à réalité virtuelle
US10249079B2 (en) * 2014-12-11 2019-04-02 Intel Corporation Relaxed sorting in a position-only pipeline
US10055883B2 (en) 2015-01-08 2018-08-21 Nvidia Corporation Frustum tests for sub-pixel shadows
WO2017210111A1 (fr) * 2016-05-29 2017-12-07 Google Llc Réglage de la déformation temporelle sur la base d'informations de profondeur dans un système de réalité augmentée/virtuelle
US10733695B2 (en) * 2016-09-16 2020-08-04 Intel Corporation Priming hierarchical depth logic within a graphics processor
GB2566006A (en) 2017-08-14 2019-03-06 Nokia Technologies Oy Three-dimensional video processing
JP7145221B2 (ja) * 2017-12-22 2022-09-30 マジック リープ， インコーポレイテッド 稠密３ｄ再構成データのキャッシュおよび更新
US10896523B2 (en) * 2019-04-01 2021-01-19 Microsoft Technology Licensing, Llc Depth image compression

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1950706A2 (fr) * 2007-01-24 2008-07-30 Vivante Corporation Procédé pour détourage distribué en dehors du volume de visualisation
WO2010035223A1 (fr) * 2008-09-25 2010-04-01 Koninklijke Philips Electronics N.V. Traitement de données d'image tridimensionnelles
EP2180449A1 (fr) * 2008-10-21 2010-04-28 Koninklijke Philips Electronics N.V. Procédé et dispositif pour la fourniture d'un modèle de profondeur stratifié
EP3200157A2 (fr) * 2016-02-01 2017-08-02 Imagination Technologies Limited Rendu de tronc de cône

Also Published As

Publication number Publication date
WO2019030427A1 (fr) 2019-02-14
EP3665656A1 (fr) 2020-06-17
US11430178B2 (en) 2022-08-30
EP3665656B1 (fr) 2023-10-25
US20210125399A1 (en) 2021-04-29
EP3665656A4 (fr) 2021-04-21
GB201712687D0 (en) 2017-09-20

Similar Documents

Publication Publication Date Title
JP6643357B2 (ja) 全球状取込方法
US11257233B2 (en) Volumetric depth video recording and playback
EP3954111A1 (fr) Téléconférence immersive asymétrique multi-utilisateurs
US10681276B2 (en) Virtual reality video processing to compensate for movement of a camera during capture
JP2017532847A (ja) 立体録画及び再生
US11189057B2 (en) Provision of virtual reality content
US11430178B2 (en) Three-dimensional video processing
US11818492B2 (en) Communication management apparatus, image communication system, communication management method, and recording medium
TW201921318A (zh) 用於產生場景之舖磚式三維影像表示之設備及方法
US10732706B2 (en) Provision of virtual reality content
US20220103751A1 (en) Communication management apparatus, image communication system, communication management method, and recording medium
US20210065331A1 (en) Image processing apparatus, image communication system, image processing method, and recording medium
WO2019034804A2 (fr) Traitement de vidéo tridimensionnelle
JP2018033107A (ja) 動画の配信装置及び配信方法
WO2022224964A1 (fr) Dispositif de traitement d'informations et procédé de traitement d'informations
US11250612B1 (en) Methods and apparatus rendering images using point clouds representing one or more objects
US20240022688A1 (en) Multiuser teleconferencing with spotlight feature
EP3564905A1 (fr) Convertissement d'un objet volumetrique dans une scène 3d vers un modèle de représentation plus simple
CN117768599A (zh) 处理图像的方法、装置、系统、电子设备和存储介质
KR20180117867A (ko) 가상현실 콘텐츠 서비스를 위한 360도 vr 어안 렌더링 방법

Legal Events

Date Code Title Description
WAP Application withdrawn, taken to be withdrawn or refused ** after publication under section 16(1)