CN112352264A - 图像处理装置和图像处理方法 - Google Patents

图像处理装置和图像处理方法 Download PDF

Info

Publication number
CN112352264A
CN112352264A CN201980041420.5A CN201980041420A CN112352264A CN 112352264 A CN112352264 A CN 112352264A CN 201980041420 A CN201980041420 A CN 201980041420A CN 112352264 A CN112352264 A CN 112352264A
Authority
CN
China
Prior art keywords
image
viewpoint
data
observation
auxiliary
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN201980041420.5A
Other languages
English (en)
Chinese (zh)
Inventor
高桥宏彰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Publication of CN112352264A publication Critical patent/CN112352264A/zh
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/04—Texture mapping
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4053—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234327—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into layers, e.g. base layer and one or more enhancement layers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G06T2207/10012—Stereo images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20004—Adaptive image processing
    • G06T2207/20012—Locally adaptive
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Geometry (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Databases & Information Systems (AREA)
  • Image Generation (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Image Processing (AREA)
  • Processing Or Creating Images (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
CN201980041420.5A 2018-06-25 2019-06-11 图像处理装置和图像处理方法 Withdrawn CN112352264A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2018-119438 2018-06-25
JP2018119438 2018-06-25
PCT/JP2019/023107 WO2020004013A1 (ja) 2018-06-25 2019-06-11 画像処理装置および画像処理方法

Publications (1)

Publication Number Publication Date
CN112352264A true CN112352264A (zh) 2021-02-09

Family

ID=68984838

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201980041420.5A Withdrawn CN112352264A (zh) 2018-06-25 2019-06-11 图像处理装置和图像处理方法

Country Status (5)

Country Link
US (1) US20210233303A1 (enExample)
EP (1) EP3813024A4 (enExample)
JP (1) JPWO2020004013A1 (enExample)
CN (1) CN112352264A (enExample)
WO (1) WO2020004013A1 (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114627223A (zh) * 2022-03-04 2022-06-14 华南师范大学 一种自由视点视频合成方法、装置、电子设备及存储介质

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10733800B2 (en) * 2018-09-17 2020-08-04 Facebook Technologies, Llc Reconstruction of essential visual cues in mixed reality applications
US11620789B2 (en) * 2019-05-03 2023-04-04 Novocure Gmbh Methods, systems, and apparatuses for managing transducer array placement
KR102770795B1 (ko) * 2019-09-09 2025-02-21 삼성전자주식회사 3d 렌더링 방법 및 장치
KR102702493B1 (ko) 2020-03-01 2024-09-05 레이아 인코포레이티드 멀티뷰 스타일 전이 시스템 및 방법
JP7434032B2 (ja) * 2020-03-31 2024-02-20 キヤノン株式会社 情報処理装置、情報処理方法、およびプログラム
US12579729B2 (en) * 2021-04-07 2026-03-17 Interdigital Ce Patent Holdings, Sas Volumetric video supporting light effects
JP7501559B2 (ja) * 2022-03-17 2024-06-18 株式会社リコー 表示端末、表示方法、通信システム、通信方法、及びプログラム
US12175602B2 (en) 2022-08-19 2024-12-24 Meta Platforms Technologies, Llc Method of generating a virtual environment by scanning a real-world environment with a first device and displaying the virtual environment on a second device
WO2024053288A1 (ja) * 2022-09-07 2024-03-14 株式会社Ｎｔｔドコモ ３次元データリダクション装置、及び非一過性の記録媒体
US12518307B1 (en) 2022-09-07 2026-01-06 Meta Platforms Technologies, Llc Human body scanning for size recommendation
US12626470B1 (en) 2023-07-03 2026-05-12 Meta Platforms Technologies, Llc Artificial reality room capture realignment
JPWO2025047368A1 (enExample) * 2023-08-29 2025-03-06
US12661585B2 (en) 2023-11-01 2026-06-23 Meta Platforms Technologies, Llc Accessing artificial reality content through a handheld device

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5011224B2 (ja) * 2008-07-09 2012-08-29 日本放送協会 任意視点映像生成装置及び任意視点映像生成プログラム
US10484697B2 (en) * 2014-09-09 2019-11-19 Qualcomm Incorporated Simultaneous localization and mapping for video coding

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114627223A (zh) * 2022-03-04 2022-06-14 华南师范大学 一种自由视点视频合成方法、装置、电子设备及存储介质

Also Published As

Publication number Publication date
EP3813024A4 (en) 2022-01-05
US20210233303A1 (en) 2021-07-29
EP3813024A1 (en) 2021-04-28
JPWO2020004013A1 (ja) 2021-08-02
WO2020004013A1 (ja) 2020-01-02

Similar Documents

Publication Publication Date Title
EP3813024A1 (en) Image processing device and image processing method
US10600233B2 (en) Parameterizing 3D scenes for volumetric viewing
US20250227297A1 (en) Three-dimensional data encoding method, three-dimensional data decoding method, three-dimensional data encoding device, and three-dimensional data decoding device
TWI691197B (zh) 用於全視差光場壓縮之預處理器
US10419737B2 (en) Data structures and delivery methods for expediting virtual reality playback
US10567464B2 (en) Video compression with adaptive view-dependent lighting removal
US10341632B2 (en) Spatial random access enabled video system with a three-dimensional viewing volume
US10497140B2 (en) Hybrid depth sensing pipeline
US20180089903A1 (en) Layered content delivery for virtual and augmented reality experiences
US20210152848A1 (en) Image processing device, image processing method, program, and image transmission system
US11812066B2 (en) Methods, devices and stream to encode global rotation motion compensated images
JP2020513703A (ja) 自由視点映像ストリーミング用の復号器中心ｕｖコーデック
WO2019124248A1 (ja) 画像処理装置、コンテンツ処理装置、コンテンツ処理システム、および画像処理方法
US20200236370A1 (en) Method and apparatus for coding of omnidirectional video
GB2565301A (en) Three-dimensional video processing
US20210304494A1 (en) Image processing apparatus, 3d data generation apparatus, control program, and recording medium
JP2013150071A (ja) 符号化装置、符号化方法、プログラム及び記憶媒体
JPWO2018186287A1 (ja) 映像データ生成装置、映像再生装置、映像データ生成方法、制御プログラム、及び記録媒体
EP4386678A1 (en) Novel view generation using point clouds
JP4815004B2 (ja) 多視点画像符号化装置
WO2024053371A1 (ja) 情報処理システム、および情報処理システムの作動方法、並びにプログラム
JP2014164497A (ja) 画像処理装置、画像処理方法及びプログラム
WO2019008233A1 (en) METHOD AND APPARATUS FOR ENCODING MULTIMEDIA CONTENT
Lingadahalli-Ravi Machine Learning-based Depth Estimation and View Synthesis for Immersive Video
HK1237881B (en) Preprocessor for full parallax light field compression

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication

Application publication date: 20210209

WW01 Invention patent application withdrawn after publication