JP7427467B2 - 画像処理装置、画像処理方法、学習済みモデルの生成方法、およびプログラム - Google Patents

画像処理装置、画像処理方法、学習済みモデルの生成方法、およびプログラム Download PDF

Info

Publication number
JP7427467B2
JP7427467B2 JP2020023374A JP2020023374A JP7427467B2 JP 7427467 B2 JP7427467 B2 JP 7427467B2 JP 2020023374 A JP2020023374 A JP 2020023374A JP 2020023374 A JP2020023374 A JP 2020023374A JP 7427467 B2 JP7427467 B2 JP 7427467B2
Authority
JP
Japan
Prior art keywords
virtual viewpoint
image
viewpoint image
model
corrected
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020023374A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021128592A5 (https=
JP2021128592A (ja
Inventor
秀 藤田
圭吾 米田
俊太郎 荒谷
厚 伊達
俊彰 藤井
桂太 高橋
孝士 杉江
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Priority to JP2020023374A priority Critical patent/JP7427467B2/ja
Priority to PCT/JP2021/003988 priority patent/WO2021161878A1/ja
Priority to EP21752863.7A priority patent/EP4089631A4/en
Publication of JP2021128592A publication Critical patent/JP2021128592A/ja
Priority to US17/819,095 priority patent/US20220383589A1/en
Publication of JP2021128592A5 publication Critical patent/JP2021128592A5/ja
Application granted granted Critical
Publication of JP7427467B2 publication Critical patent/JP7427467B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—Two-dimensional [2D] image generation
    • G06T11/10—Texturing; Colouring; Generation of textures or colours
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—Denoising; Smoothing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/30—Noise filtering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • G06V20/42—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items of sport video content
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional [3D] objects
    • G06V20/647—Three-dimensional [3D] objects by matching two-dimensional images to three-dimensional objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/103—Static body considered as a whole, e.g. static pedestrian or occupant recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Computing Systems (AREA)
  • Geometry (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Evolutionary Computation (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Databases & Information Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Computational Linguistics (AREA)
  • Human Computer Interaction (AREA)
  • Image Analysis (AREA)
  • Processing Or Creating Images (AREA)
  • Image Processing (AREA)
JP2020023374A 2020-02-14 2020-02-14 画像処理装置、画像処理方法、学習済みモデルの生成方法、およびプログラム Active JP7427467B2 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2020023374A JP7427467B2 (ja) 2020-02-14 2020-02-14 画像処理装置、画像処理方法、学習済みモデルの生成方法、およびプログラム
PCT/JP2021/003988 WO2021161878A1 (ja) 2020-02-14 2021-02-03 画像処理装置、画像処理方法、学習済みモデルの生成方法、およびプログラム
EP21752863.7A EP4089631A4 (en) 2020-02-14 2021-02-03 Image processing device, image processing method, method of generating learned model, and program
US17/819,095 US20220383589A1 (en) 2020-02-14 2022-08-11 Image processing apparatus, image processing method, method for generating learned model, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2020023374A JP7427467B2 (ja) 2020-02-14 2020-02-14 画像処理装置、画像処理方法、学習済みモデルの生成方法、およびプログラム

Publications (3)

Publication Number Publication Date
JP2021128592A JP2021128592A (ja) 2021-09-02
JP2021128592A5 JP2021128592A5 (https=) 2023-03-09
JP7427467B2 true JP7427467B2 (ja) 2024-02-05

Family

ID=77291821

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020023374A Active JP7427467B2 (ja) 2020-02-14 2020-02-14 画像処理装置、画像処理方法、学習済みモデルの生成方法、およびプログラム

Country Status (4)

Country Link
US (1) US20220383589A1 (https=)
EP (1) EP4089631A4 (https=)
JP (1) JP7427467B2 (https=)
WO (1) WO2021161878A1 (https=)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113793255A (zh) * 2021-09-09 2021-12-14 百度在线网络技术（北京）有限公司 用于图像处理的方法、装置、设备、存储介质和程序产品
JP7600162B2 (ja) * 2022-01-31 2024-12-16 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
WO2024029371A1 (ja) * 2022-08-04 2024-02-08 ソニーグループ株式会社 情報処理システム、および情報処理システムの作動方法、並びにプログラム
WO2024176317A1 (ja) * 2023-02-20 2024-08-29 日本電信電話株式会社 調整装置、調整方法、および調整プログラム
CN116301476A (zh) * 2023-03-03 2023-06-23 马上消费金融股份有限公司 图像显示方法、装置、设备及存储介质
CN116152122B (zh) * 2023-04-21 2023-08-25 荣耀终端有限公司 图像处理方法和电子设备
JP2025038752A (ja) * 2023-09-07 2025-03-19 キヤノン株式会社 画像処理装置、画像処理方法、及びプログラム
JP2026052396A (ja) 2024-09-11 2026-03-24 富士フイルムビジネスイノベーション株式会社 情報処理システム及びプログラム

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018026064A (ja) 2016-08-12 2018-02-15 キヤノン株式会社 画像処理装置、画像処理方法、システム
JP2018081672A (ja) 2016-11-14 2018-05-24 株式会社リコー 深層畳み込みニューラルネットワークを用いる新ビュー合成
JP2019191915A (ja) 2018-04-25 2019-10-31 キヤノン株式会社 映像生成装置、映像生成装置の制御方法及びプログラム
JP2020005202A (ja) 2018-06-29 2020-01-09 日本放送協会 映像処理装置

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6425780B1 (ja) 2017-09-22 2018-11-21 キヤノン株式会社 画像処理システム、画像処理装置、画像処理方法及びプログラム
JP7172266B2 (ja) 2018-08-06 2022-11-16 株式会社タダノ アウトリガ装置、及びアウトリガ装置を備えた作業車

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018026064A (ja) 2016-08-12 2018-02-15 キヤノン株式会社 画像処理装置、画像処理方法、システム
JP2018081672A (ja) 2016-11-14 2018-05-24 株式会社リコー 深層畳み込みニューラルネットワークを用いる新ビュー合成
JP2019191915A (ja) 2018-04-25 2019-10-31 キヤノン株式会社 映像生成装置、映像生成装置の制御方法及びプログラム
JP2020005202A (ja) 2018-06-29 2020-01-09 日本放送協会 映像処理装置

Also Published As

Publication number Publication date
JP2021128592A (ja) 2021-09-02
WO2021161878A1 (ja) 2021-08-19
EP4089631A1 (en) 2022-11-16
US20220383589A1 (en) 2022-12-01
EP4089631A4 (en) 2024-02-28

Similar Documents

Publication Publication Date Title
JP7427467B2 (ja) 画像処理装置、画像処理方法、学習済みモデルの生成方法、およびプログラム
CN110033475B (zh) 一种高分辨率纹理生成的航拍图运动物体检测与消除方法
JP7116262B2 (ja) 画像深度推定方法および装置、電子機器、ならびに記憶媒体
CN115334233B (zh) 滑动变焦效果的产生方法和系统
US20120069018A1 (en) Ar process apparatus, ar process method and storage medium
US11321960B2 (en) Deep learning-based three-dimensional facial reconstruction system
JP2019128641A (ja) 画像処理装置、画像処理方法及びプログラム
JP2002236909A (ja) 画像データ処理方法およびモデリング装置
CN120431274A (zh) 一种融合深度估计与双视角视频的三维场景合成方法
US20120038785A1 (en) Method for producing high resolution image
JP2005063041A (ja) ３次元モデリング装置、方法、及びプログラム
CN112422848A (zh) 一种基于深度图和彩色图的视频拼接方法
JP2022038176A (ja) 制御装置、制御方法およびプログラム
JP7787752B2 (ja) 形状推定装置、処理方法、およびプログラム
CN113763544B (zh) 图像确定方法、装置、电子设备和计算机可读存储介质
US11715218B2 (en) Information processing apparatus and information processing method
JP2015197374A (ja) ３次元形状推定装置及び３次元形状推定方法
JP2005141655A (ja) ３次元モデリング装置及び３次元モデリング方法
JP7504614B2 (ja) 画像処理装置、画像処理方法及びプログラム
JP7289746B2 (ja) 情報処理装置、情報処理方法、及びプログラム
JP2023026244A (ja) 画像生成装置および画像生成方法、プログラム
CN113763545A (zh) 图像确定方法、装置、电子设备和计算机可读存储介质
JP7649163B2 (ja) 情報処理装置、情報処理装置の制御方法およびプログラム
JP7429667B2 (ja) カメラキャリブレーション装置、方法及びプログラム
CN113192208B (zh) 三维漫游方法及装置

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20230210

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230301

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20231017

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20231218

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20231226

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240124

R151 Written notification of patent or utility model registration

Ref document number: 7427467

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151