JP7105062B2 - 画像処理装置、コンテンツ処理装置、コンテンツ処理システム、および画像処理方法 - Google Patents

画像処理装置、コンテンツ処理装置、コンテンツ処理システム、および画像処理方法 Download PDF

Info

Publication number
JP7105062B2
JP7105062B2 JP2017244861A JP2017244861A JP7105062B2 JP 7105062 B2 JP7105062 B2 JP 7105062B2 JP 2017244861 A JP2017244861 A JP 2017244861A JP 2017244861 A JP2017244861 A JP 2017244861A JP 7105062 B2 JP7105062 B2 JP 7105062B2
Authority
JP
Japan
Prior art keywords
image
depth image
data
depth
distance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2017244861A
Other languages
English (en)
Japanese (ja)
Other versions
JP2019114842A (ja
JP2019114842A5 (https=
Inventor
征志 中田
康範 松井
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Interactive Entertainment Inc
Original Assignee
Sony Interactive Entertainment Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Interactive Entertainment Inc filed Critical Sony Interactive Entertainment Inc
Priority to JP2017244861A priority Critical patent/JP7105062B2/ja
Priority to PCT/JP2018/046100 priority patent/WO2019124248A1/ja
Priority to EP18891483.2A priority patent/EP3731528A4/en
Priority to US16/771,908 priority patent/US11503267B2/en
Publication of JP2019114842A publication Critical patent/JP2019114842A/ja
Publication of JP2019114842A5 publication Critical patent/JP2019114842A5/ja
Application granted granted Critical
Publication of JP7105062B2 publication Critical patent/JP7105062B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124—Quantisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124—Quantisation
    • H04N19/126—Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/167—Position within a video image, e.g. region of interest [ROI]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/587—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/98—Adaptive-dynamic-range coding [ADRC]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2213/00—Details of stereoscopic systems
    • H04N2213/003—Aspects relating to the "2D+depth" image format
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2213/00—Details of stereoscopic systems
    • H04N2213/005—Aspects relating to the "3D+depth" image format
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Studio Devices (AREA)
  • Compression Of Band Width Or Redundancy In Fax (AREA)
JP2017244861A 2017-12-21 2017-12-21 画像処理装置、コンテンツ処理装置、コンテンツ処理システム、および画像処理方法 Active JP7105062B2 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2017244861A JP7105062B2 (ja) 2017-12-21 2017-12-21 画像処理装置、コンテンツ処理装置、コンテンツ処理システム、および画像処理方法
PCT/JP2018/046100 WO2019124248A1 (ja) 2017-12-21 2018-12-14 画像処理装置、コンテンツ処理装置、コンテンツ処理システム、および画像処理方法
EP18891483.2A EP3731528A4 (en) 2017-12-21 2018-12-14 IMAGE PROCESSING DEVICE, CONTENT PROCESSING DEVICE, CONTENT PROCESSING SYSTEM AND IMAGE PROCESSING METHOD
US16/771,908 US11503267B2 (en) 2017-12-21 2018-12-14 Image processing device, content processing device, content processing system, and image processing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2017244861A JP7105062B2 (ja) 2017-12-21 2017-12-21 画像処理装置、コンテンツ処理装置、コンテンツ処理システム、および画像処理方法

Publications (3)

Publication Number Publication Date
JP2019114842A JP2019114842A (ja) 2019-07-11
JP2019114842A5 JP2019114842A5 (https=) 2020-08-13
JP7105062B2 true JP7105062B2 (ja) 2022-07-22

Family

ID=66992666

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2017244861A Active JP7105062B2 (ja) 2017-12-21 2017-12-21 画像処理装置、コンテンツ処理装置、コンテンツ処理システム、および画像処理方法

Country Status (4)

Country Link
US (1) US11503267B2 (https=)
EP (1) EP3731528A4 (https=)
JP (1) JP7105062B2 (https=)
WO (1) WO2019124248A1 (https=)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102647336B1 (ko) * 2019-04-01 2024-03-14 구글 엘엘씨 동적 깊이 이미지를 캡처 및 편집하는 기술
TWI853102B (zh) * 2019-10-07 2024-08-21 日商索尼半導體解決方案公司 電子機器
US12206867B2 (en) * 2020-02-21 2025-01-21 Sony Semiconductor Solutions Corporation Information processing device and method
CN112164017B (zh) * 2020-09-27 2023-11-17 中国兵器工业集团第二一四研究所苏州研发中心 一种基于深度学习的偏振彩色化方法
US12056934B2 (en) 2021-07-30 2024-08-06 Zoox, Inc. Three-dimensional object detection based on image data
US12475725B2 (en) 2021-07-30 2025-11-18 Zoox, Inc. Three-dimensional point clouds based on images and depth data
JP2023160275A (ja) * 2022-04-22 2023-11-02 株式会社ノビアス ２次元動画を３次元的に表示するためのシステム、方法、およびプログラム
JP7711641B2 (ja) * 2022-06-28 2025-07-23 トヨタ自動車株式会社 送信装置及び受信装置
JPWO2024057902A1 (https=) * 2022-09-12 2024-03-21
WO2024186242A1 (en) * 2023-03-08 2024-09-12 Telefonaktiebolaget Lm Ericsson (Publ) Holographic communication system
JP7745854B2 (ja) * 2023-03-28 2025-09-30 Ｐｃｉソリューションズ株式会社 重量推定装置及び教師データ作成方法
JP2025091997A (ja) * 2023-12-08 2025-06-19 株式会社Ｊｖｃケンウッド 画像処理装置、画像処理方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009163717A (ja) 2007-12-10 2009-07-23 Fujifilm Corp 距離画像処理装置および方法、距離画像再生装置および方法並びにプログラム
US20130222534A1 (en) 2011-08-29 2013-08-29 Nokia Corporation Apparatus, a Method and a Computer Program for Video Coding and Decoding
EP2693753A1 (en) 2012-07-31 2014-02-05 Samsung Electronics Co., Ltd Method of converting 2-dimension images into 3-dimension images and display apparatus thereof

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3159230B2 (ja) 1993-06-10 2001-04-23 日本電信電話株式会社 画像信号用可変レート符号化装置
US20090148038A1 (en) * 2007-12-10 2009-06-11 Youichi Sawachi Distance image processing apparatus and method
KR101367282B1 (ko) 2007-12-21 2014-03-12 삼성전자주식회사 깊이 정보에 대한 적응적 정보 표현 방법 및 그 장치
KR101158491B1 (ko) 2008-12-08 2012-06-20 한국전자통신연구원 다시점 영상 부호화, 복호화 방법 및 그 장치.
CN102348415A (zh) * 2009-01-19 2012-02-08 超声医疗设备公司 用于获取和处理部分三维超声数据的系统和方法
JP5682437B2 (ja) 2010-09-07 2015-03-11 ソニー株式会社 固体撮像素子、固体撮像装置、撮像機器、及び、偏光素子の製造方法
JP5755111B2 (ja) 2011-11-14 2015-07-29 キヤノン株式会社 撮像装置の駆動方法
US20130287093A1 (en) * 2012-04-25 2013-10-31 Nokia Corporation Method and apparatus for video coding
WO2014130849A1 (en) * 2013-02-21 2014-08-28 Pelican Imaging Corporation Generating compressed light field representation data
WO2014165244A1 (en) * 2013-03-13 2014-10-09 Pelican Imaging Corporation Systems and methods for synthesizing images from image data captured by an array camera using restricted depth of field depth maps in which depth estimation precision varies
JP6672070B2 (ja) 2016-05-17 2020-03-25 キヤノン株式会社 圧縮センシングを用いた撮像装置、撮像方法および撮像プログラム
CN108389226A (zh) 2018-02-12 2018-08-10 北京工业大学 一种基于卷积神经网络和双目视差的无监督深度预测方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009163717A (ja) 2007-12-10 2009-07-23 Fujifilm Corp 距離画像処理装置および方法、距離画像再生装置および方法並びにプログラム
US20130222534A1 (en) 2011-08-29 2013-08-29 Nokia Corporation Apparatus, a Method and a Computer Program for Video Coding and Decoding
EP2693753A1 (en) 2012-07-31 2014-02-05 Samsung Electronics Co., Ltd Method of converting 2-dimension images into 3-dimension images and display apparatus thereof

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Ayan Chakrabarti, et al.，"Depth from a Single Image by Harmonizing Overcomplete Local Network Predictions"，arXiv:1605.07081v2，version v2，[online], arXiv (Cornell University)，2016年09月07日，Pages 1-9，[令和3年6月14日検索], インターネット, <URL: https://arxiv.org/abs/1605.07081v2>.
David Eigen, et al.，"Depth Map Prediction from a Single Image using a Multi-Scale Deep Network"，arXiv:1406.2283v1，version v1，[online], arXiv (Cornell University)，2014年06月09日，Pages 1-9，[令和3年6月14日検索], インターネット, <URL: https://arxiv.org/abs/1406.2283v1>.

Also Published As

Publication number Publication date
EP3731528A1 (en) 2020-10-28
JP2019114842A (ja) 2019-07-11
WO2019124248A1 (ja) 2019-06-27
US20200404238A1 (en) 2020-12-24
US11503267B2 (en) 2022-11-15
EP3731528A4 (en) 2021-08-11

Similar Documents

Publication Publication Date Title
JP7105062B2 (ja) 画像処理装置、コンテンツ処理装置、コンテンツ処理システム、および画像処理方法
US12289470B2 (en) Three-dimensional data encoding method, three-dimensional data decoding method, three-dimensional data encoding device, and three-dimensional data decoding device
JP7277372B2 (ja) 三次元モデル符号化装置、三次元モデル復号装置、三次元モデル符号化方法、および、三次元モデル復号方法
US11159824B1 (en) Methods for full parallax light field compression
CN108886598B (zh) 全景立体视频系统的压缩方法和装置
JP2013509104A (ja) ２ｄビデオデータの３ｄビデオデータへの変換のための深度マップ生成技法
JP7202087B2 (ja) 映像処理装置
WO2020188401A1 (en) Quantization step parameter for point cloud compression
JP2013150071A (ja) 符号化装置、符号化方法、プログラム及び記憶媒体
WO2015056712A1 (ja) 動画像符号化方法、動画像復号方法、動画像符号化装置、動画像復号装置、動画像符号化プログラム、及び動画像復号プログラム
US10257488B2 (en) View synthesis using low resolution depth maps
JP4815004B2 (ja) 多視点画像符号化装置
JP4764516B1 (ja) 多視点画像符号化装置
JP4860763B2 (ja) 画像符号化装置、画像符号化装置の制御方法、制御プログラムおよび記録媒体
JP2018207356A (ja) 画像圧縮プログラム、画像圧縮装置、及び画像圧縮方法
US20250358395A1 (en) Generating 3d images and videos from 2d images and videos
US12382080B2 (en) Method for encoding and decoding a multi-view video
JP7417388B2 (ja) 符号化装置、復号装置、及びプログラム
WO2025240730A1 (en) Generating 3d images and videos from 2d images and videos

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200618

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20200618

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210622

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210819

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20220201

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220328

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20220628

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20220711

R150 Certificate of patent or registration of utility model

Ref document number: 7105062

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150