JP7005712B2 - 圧縮された画像を生成するための方法、システムおよび媒体 - Google Patents

圧縮された画像を生成するための方法、システムおよび媒体 Download PDF

Info

Publication number
JP7005712B2
JP7005712B2 JP2020150528A JP2020150528A JP7005712B2 JP 7005712 B2 JP7005712 B2 JP 7005712B2 JP 2020150528 A JP2020150528 A JP 2020150528A JP 2020150528 A JP2020150528 A JP 2020150528A JP 7005712 B2 JP7005712 B2 JP 7005712B2
Authority
JP
Japan
Prior art keywords
mdi
mpi
subvolumes
image
mesh
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020150528A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021111335A (ja
JP2021111335A5 (enExample
Inventor
ライアン・オーバーベック
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Google LLC
Original Assignee
Google LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Google LLC filed Critical Google LLC
Publication of JP2021111335A publication Critical patent/JP2021111335A/ja
Publication of JP2021111335A5 publication Critical patent/JP2021111335A5/ja
Application granted granted Critical
Publication of JP7005712B2 publication Critical patent/JP7005712B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/04—Texture mapping
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/184—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
    • H04N25/41—Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/06—Ray-tracing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/08—Volume rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—Denoising; Smoothing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/189—Recording image signals; Reproducing recorded image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/62—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding by frequency transforming in three dimensions [3D]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Image Generation (AREA)
JP2020150528A 2020-01-07 2020-09-08 圧縮された画像を生成するための方法、システムおよび媒体 Active JP7005712B2 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US16/736,469 US11172148B2 (en) 2020-01-07 2020-01-07 Methods, systems, and media for generating compressed images
US16/736,469 2020-01-07

Publications (3)

Publication Number Publication Date
JP2021111335A JP2021111335A (ja) 2021-08-02
JP2021111335A5 JP2021111335A5 (enExample) 2021-09-09
JP7005712B2 true JP7005712B2 (ja) 2022-01-24

Family

ID=72517115

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020150528A Active JP7005712B2 (ja) 2020-01-07 2020-09-08 圧縮された画像を生成するための方法、システムおよび媒体

Country Status (5)

Country Link
US (3) US11172148B2 (enExample)
EP (1) EP3848903B1 (enExample)
JP (1) JP7005712B2 (enExample)
KR (1) KR102493860B1 (enExample)
CN (2) CN112055213B (enExample)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111400521B (zh) * 2020-02-28 2022-06-07 苏州浪潮智能科技有限公司 一种图数据处理方法、装置、设备、介质
TWI899162B (zh) * 2020-05-06 2025-10-01 法商內數位Ｃｅ專利控股公司 具有阿爾法層的3d場景傳輸
JP7715354B2 (ja) 2020-06-19 2025-07-30 インテル・コーポレーション マルチプレーン画像圧縮
US12051175B2 (en) * 2020-11-13 2024-07-30 Adobe Inc. View synthesis with spatial and rotational consistency
US12470681B2 (en) * 2021-01-14 2025-11-11 Interdigital Ce Patent Holdings, Sas Method and apparatus for generating compact multiplane images
WO2023272510A1 (zh) * 2021-06-29 2023-01-05 Oppo广东移动通信有限公司 多平面图像的生成、数据处理、编码和解码方法、装置
EP4120198A1 (en) * 2021-07-14 2023-01-18 Koninklijke Philips N.V. Multi object surface image (mosi) format
WO2023085854A1 (en) * 2021-11-12 2023-05-19 Samsung Electronics Co., Ltd. Method for building scene representation with feed-forward correction for real-time view synthesis
US12382007B2 (en) 2021-11-30 2025-08-05 Electronics And Telecommunications Research Institute Image conversion apparatus and method
US12548230B2 (en) 2022-11-07 2026-02-10 Electronics And Telecommunications Research Institute MPI layer geometry generation method using pixel ray crossing
US12417580B2 (en) 2022-11-07 2025-09-16 Electronics And Telecommunications Research Institute Method and apparatus for filling blank area of MPI view plane based on pixel ray path
KR102824446B1 (ko) * 2022-11-07 2025-06-24 한국전자통신연구원 픽셀 광선 경로에 기반하여 mpi 시점 평면의 공백 영역을 채우는 방법 및 장치
CN120130061A (zh) * 2022-11-15 2025-06-10 谷歌有限责任公司 实时视图合成
US12561777B2 (en) * 2023-05-04 2026-02-24 International Business Machines Corporation Anomaly detection using neural radiance fields
KR20250116428A (ko) * 2024-01-25 2025-08-01 삼성전자주식회사 비디오로부터 다중 평면 이미지를 생성하는 방법 및 전자 장치
KR102846972B1 (ko) * 2024-02-27 2025-08-18 한양대학교 산학협력단 광 신경망 기반의 칼라 비전 시스템 및 그의 동작 방법
WO2026080281A1 (en) * 2024-10-08 2026-04-16 Dolby Laboratories Licensing Corporation Split rendering for volumetric content

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20210250571A1 (en) 2020-02-12 2021-08-12 At&T Intellectual Property I, L.P. Apparatus and method for providing content with multiplane image transcoding

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130317852A1 (en) * 2012-05-22 2013-11-28 Geneva Healthcare, LLC Medical device information portal
US10467820B2 (en) 2018-01-24 2019-11-05 Google Llc Image style transfer for three-dimensional models
US10911732B2 (en) * 2019-01-14 2021-02-02 Fyusion, Inc. Free-viewpoint photorealistic view synthesis from casually captured video
US11363249B2 (en) * 2019-02-22 2022-06-14 Avalon Holographics Inc. Layered scene decomposition CODEC with transparency

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20210250571A1 (en) 2020-02-12 2021-08-12 At&T Intellectual Property I, L.P. Apparatus and method for providing content with multiplane image transcoding

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
MICHAEL BROXTON et al.，Immersive Light Field Video with a Layered Mesh Representation，[online]，2020年07月，https://augmentedperception.github.io/deepviewvideo/
TINGHUI ZHOU et al.，Stereo Magnification: Learning view synthesis using multiplane images，[online]，2018年05月，https://arxiv.org/abs/1805.09817

Also Published As

Publication number Publication date
US11172148B2 (en) 2021-11-09
US20240073551A1 (en) 2024-02-29
KR102493860B1 (ko) 2023-01-31
EP3848903A1 (en) 2021-07-14
CN118250468A (zh) 2024-06-25
US20210211593A1 (en) 2021-07-08
US12192651B2 (en) 2025-01-07
CN112055213B (zh) 2024-04-09
CN112055213A (zh) 2020-12-08
EP3848903B1 (en) 2025-08-20
KR20210089068A (ko) 2021-07-15
US20220030184A1 (en) 2022-01-27
JP2021111335A (ja) 2021-08-02
US11758295B2 (en) 2023-09-12

Similar Documents

Publication Publication Date Title
JP7005712B2 (ja) 圧縮された画像を生成するための方法、システムおよび媒体
KR102940442B1 (ko) 소프트 레이어링 및 깊이 인식 복원을 사용한 단일 이미지 3d 사진
US12034787B2 (en) Hybrid streaming
US11601636B2 (en) Methods, systems, and media for generating an immersive light field video with a layered mesh representation
US11544894B2 (en) Latency-resilient cloud rendering
TWI668577B (zh) 渲染設備、其之渲染方法、程式和記錄媒體
US20100231590A1 (en) Creating and modifying 3d object textures
US12118667B2 (en) Methods and systems for unified rendering of light and sound content for a simulated 3D environment
CN110930492B (zh) 模型渲染的方法、装置、计算机可读介质及电子设备
CN118831318A (zh) 渲染方法、渲染系统以及存储介质
KR20220017536A (ko) 전자 게임에서 카메라 뷰 변경
CN116258738A (zh) 图像处理方法、装置、电子设备及存储介质
WO2024255620A1 (zh) 一种图像处理方法、装置、设备、介质和程序产品
WO2022098512A1 (en) Latency-resilient cloud rendering
CN115187491B (zh) 图像降噪处理方法、图像滤波处理方法及装置
HK40073882A (en) Shadow baking method, device, electronic equipment and storage medium
HK40090123A (zh) 一种图像处理方法、装置、设备及存储介质
HK40090123B (zh) 一种图像处理方法、装置、设备及存储介质
CN120526012A (zh) 一种游戏的渲染方法、装置、电子设备及介质

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20201221

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20201221

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210715

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20211126

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20211207

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20220105

R150 Certificate of patent or registration of utility model

Ref document number: 7005712

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250