JP7033865B2 - 画像生成装置、画像生成方法、及びプログラム - Google Patents

画像生成装置、画像生成方法、及びプログラム Download PDF

Info

Publication number
JP7033865B2
JP7033865B2 JP2017155882A JP2017155882A JP7033865B2 JP 7033865 B2 JP7033865 B2 JP 7033865B2 JP 2017155882 A JP2017155882 A JP 2017155882A JP 2017155882 A JP2017155882 A JP 2017155882A JP 7033865 B2 JP7033865 B2 JP 7033865B2
Authority
JP
Japan
Prior art keywords
image
resolution
subject
virtual viewpoint
shape data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2017155882A
Other languages
English (en)
Japanese (ja)
Other versions
JP2019036790A5 (enExample
JP2019036790A (ja
Inventor
知宏 西山
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Priority to JP2017155882A priority Critical patent/JP7033865B2/ja
Priority to EP18185722.8A priority patent/EP3442225B1/en
Priority to KR1020180088921A priority patent/KR102316061B1/ko
Priority to US16/056,898 priority patent/US10872462B2/en
Priority to CN201810902118.1A priority patent/CN109389545B/zh
Publication of JP2019036790A publication Critical patent/JP2019036790A/ja
Publication of JP2019036790A5 publication Critical patent/JP2019036790A5/ja
Application granted granted Critical
Publication of JP7033865B2 publication Critical patent/JP7033865B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/0007—Image acquisition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/60—Memory management
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/122—Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Geometry (AREA)
  • Computer Graphics (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Image Processing (AREA)
  • Processing Or Creating Images (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Image Analysis (AREA)
JP2017155882A 2017-08-10 2017-08-10 画像生成装置、画像生成方法、及びプログラム Expired - Fee Related JP7033865B2 (ja)

Priority Applications (5)

Application Number Priority Date Filing Date Title
JP2017155882A JP7033865B2 (ja) 2017-08-10 2017-08-10 画像生成装置、画像生成方法、及びプログラム
EP18185722.8A EP3442225B1 (en) 2017-08-10 2018-07-26 Image processing apparatus and method
KR1020180088921A KR102316061B1 (ko) 2017-08-10 2018-07-31 화상 처리장치, 방법 및 컴퓨터 프로그램
US16/056,898 US10872462B2 (en) 2017-08-10 2018-08-07 Image processing apparatus, method, and non-transitory computer-readable medium for rendering a virtual viewpoint image
CN201810902118.1A CN109389545B (zh) 2017-08-10 2018-08-09 图像处理装置、方法和存储介质

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2017155882A JP7033865B2 (ja) 2017-08-10 2017-08-10 画像生成装置、画像生成方法、及びプログラム

Publications (3)

Publication Number Publication Date
JP2019036790A JP2019036790A (ja) 2019-03-07
JP2019036790A5 JP2019036790A5 (enExample) 2020-09-03
JP7033865B2 true JP7033865B2 (ja) 2022-03-11

Family

ID=63207508

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2017155882A Expired - Fee Related JP7033865B2 (ja) 2017-08-10 2017-08-10 画像生成装置、画像生成方法、及びプログラム

Country Status (5)

Country Link
US (1) US10872462B2 (enExample)
EP (1) EP3442225B1 (enExample)
JP (1) JP7033865B2 (enExample)
KR (1) KR102316061B1 (enExample)
CN (1) CN109389545B (enExample)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10902243B2 (en) * 2016-10-25 2021-01-26 Deep North, Inc. Vision based target tracking that distinguishes facial feature targets
JP6482696B2 (ja) * 2017-06-23 2019-03-13 キヤノン株式会社 表示制御装置、表示制御方法、およびプログラム
CN110008802B (zh) * 2018-12-04 2023-08-29 创新先进技术有限公司 从多个脸部中选择目标脸部及脸部识别比对方法、装置
CN113557711B (zh) * 2019-03-18 2024-09-24 索尼集团公司 图像拍摄装置、信息处理方法和程序产品
KR102629225B1 (ko) * 2019-05-16 2024-01-29 캐논 가부시끼가이샤 배치 결정 장치, 시스템, 배치 결정 방법 및 기록 매체
WO2021020200A1 (ja) * 2019-07-26 2021-02-04 富士フイルム株式会社 情報処理装置、情報処理方法、及びプログラム
JP7418101B2 (ja) * 2019-07-26 2024-01-19 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
JP7423251B2 (ja) * 2019-10-25 2024-01-29 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
JP7290546B2 (ja) * 2019-10-29 2023-06-13 Kddi株式会社 ３ｄモデル生成装置および方法
CN114746900B (zh) * 2019-11-20 2025-10-28 松下知识产权经营株式会社 三维模型生成方法及三维模型生成装置
WO2021131365A1 (ja) 2019-12-26 2021-07-01 富士フイルム株式会社 情報処理装置、情報処理装置の作動方法、及びプログラム
WO2022024593A1 (ja) * 2020-07-31 2022-02-03 富士フイルム株式会社 情報処理装置、情報処理方法、プログラム、及び情報処理システム
EP4210040B1 (en) * 2020-12-23 2025-03-19 BOE Technology Group Co., Ltd. Shift register and driving method therefor, gate driver, and display apparatus
WO2023099383A1 (en) * 2021-12-02 2023-06-08 Koninklijke Kpn N.V. Rendering 3d scene comprising objects
JP2024100596A (ja) 2023-01-16 2024-07-26 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
EP4443273A1 (en) * 2023-03-31 2024-10-09 Canon Kabushiki Kaisha Display control apparatus, display control method, and program

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000236535A (ja) 1999-02-15 2000-08-29 P I Ii:Kk 動画像情報処理方法および装置ならびに動画像情報配信方法

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3593466B2 (ja) 1999-01-21 2004-11-24 日本電信電話株式会社 仮想視点画像生成方法およびその装置
JP3718472B2 (ja) * 1999-12-06 2005-11-24 富士通株式会社 画像表示方法および装置
JP2002366935A (ja) 2001-06-12 2002-12-20 Minolta Co Ltd ボリュームデータの生成方法および装置並びにコンピュータプログラム
EP1538536A1 (en) * 2003-12-05 2005-06-08 Sony International (Europe) GmbH Visualization and control techniques for multimedia digital content
CN102197649B (zh) * 2008-08-29 2014-03-26 皇家飞利浦电子股份有限公司 三维图像数据的动态传送
CA2754672C (en) * 2009-03-25 2017-11-21 Sony Computer Entertainment Inc. Information processing device and information processing method
US8655632B2 (en) * 2009-09-03 2014-02-18 Schlumberger Technology Corporation Gridless geological modeling
CN102598652B (zh) * 2009-10-30 2015-08-12 佳能株式会社 信息处理设备和方法
KR101608970B1 (ko) * 2009-11-27 2016-04-05 삼성전자주식회사 광 필드 데이터를 이용한 영상 처리 장치 및 방법
JP5562103B2 (ja) * 2010-04-16 2014-07-30 キヤノン株式会社 画像処理装置および方法
CN102325259A (zh) * 2011-09-09 2012-01-18 青岛海信数字多媒体技术国家重点实验室有限公司 多视点视频中虚拟视点合成方法及装置
JP2014044569A (ja) * 2012-08-27 2014-03-13 Xacti Corp 電子機器
JP6214236B2 (ja) * 2013-03-05 2017-10-18 キヤノン株式会社 画像処理装置、撮像装置、画像処理方法、及びプログラム
CN105205796A (zh) * 2014-06-30 2015-12-30 华为技术有限公司 广域图像获取方法和装置
US20160140733A1 (en) * 2014-11-13 2016-05-19 Futurewei Technologies, Inc. Method and systems for multi-view high-speed motion capture
KR102375411B1 (ko) * 2015-05-11 2022-03-18 삼성전자주식회사 차량 주변 영상 제공 방법 및 장치
KR101835434B1 (ko) * 2015-07-08 2018-03-09 고려대학교 산학협력단 투영 이미지 생성 방법 및 그 장치, 이미지 픽셀과 깊이값간의 매핑 방법
KR102167988B1 (ko) * 2015-09-16 2020-10-20 주식회사바텍 3차원 엑스선 영상 표시 장치
JP6674247B2 (ja) * 2015-12-14 2020-04-01 キヤノン株式会社 情報処理装置、情報処理方法、およびコンピュータプログラム
JP6088094B1 (ja) * 2016-06-20 2017-03-01 株式会社Cygames 複合現実環境を作成するためのシステム等
EP3264372A1 (en) * 2016-06-30 2018-01-03 Alcatel Lucent Image processing device and method
JP6419128B2 (ja) * 2016-10-28 2018-11-07 キヤノン株式会社 画像処理装置、画像処理システム、画像処理方法及びプログラム
US10762653B2 (en) * 2016-12-27 2020-09-01 Canon Kabushiki Kaisha Generation apparatus of virtual viewpoint image, generation method, and storage medium
JP7121470B2 (ja) * 2017-05-12 2022-08-18 キヤノン株式会社 画像処理システム、制御方法、及び、プログラム
JP6425847B1 (ja) 2017-08-14 2018-11-21 キヤノン株式会社 画像処理装置、画像処理方法およびプログラム

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000236535A (ja) 1999-02-15 2000-08-29 P I Ii:Kk 動画像情報処理方法および装置ならびに動画像情報配信方法

Also Published As

Publication number Publication date
KR102316061B1 (ko) 2021-10-22
KR20190017653A (ko) 2019-02-20
US10872462B2 (en) 2020-12-22
CN109389545B (zh) 2023-05-26
EP3442225A1 (en) 2019-02-13
US20190051035A1 (en) 2019-02-14
EP3442225B1 (en) 2022-11-02
CN109389545A (zh) 2019-02-26
JP2019036790A (ja) 2019-03-07

Similar Documents

Publication Publication Date Title
JP7033865B2 (ja) 画像生成装置、画像生成方法、及びプログラム
JP7051457B2 (ja) 画像処理装置、画像処理方法、及びプログラム
JP6561216B2 (ja) 光学フローを使用した中間ビューの生成
JP6434947B2 (ja) 撮像システム、画像処理装置、画像処理方法、及びプログラム
CN110460835B (zh) 图像处理装置及其控制方法和计算机可读存储介质
JP2019144638A (ja) 画像処理装置、画像処理方法およびプログラム
CN114287126B (zh) 一种基于光流计算的实时视频拼接方法
JP7027049B2 (ja) 画像処理装置、画像処理方法及びプログラム
JP7195785B2 (ja) ３次元形状データを生成する装置、方法、及びプログラム
JP7374582B2 (ja) 画像処理装置、画像生成方法およびプログラム
JP2025086735A (ja) 画像処理装置、画像処理方法、及びプログラム
CN107657654B (zh) 一种虚拟现实场景渲染方法、装置和头戴显示设备
US11328494B2 (en) Image processing apparatus, image processing method, and storage medium
JP6362473B2 (ja) 画像処理装置、撮像装置、画像処理方法、プログラム、記憶媒体
JP2019121945A (ja) 撮像装置、その制御方法及びプログラム
JP7164873B2 (ja) 画像処理装置及びプログラム
JP2019145894A (ja) 画像処理装置、画像処理方法及びプログラム
JP6645949B2 (ja) 情報処理装置、情報処理システム、および情報処理方法
JP2022029567A (ja) 制御装置、制御方法およびプログラム
TWI906985B (zh) 雙鏡頭電子裝置與其影像一致性提昇方法
JP2019067419A (ja) 画像処理装置、画像処理方法、及びプログラム
JP7514125B2 (ja) 画像処理装置およびそのプログラム
JP2019032742A (ja) 画像処理装置、画像処理方法及びプログラム
JP2023175503A (ja) 画像処理装置及びその画像処理方法
CN120434372A (zh) 投影控制方法、装置、电子设备以及存储介质

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200721

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20200721

RD01 Notification of change of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7421

Effective date: 20210103

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210113

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20210708

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210726

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210922

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20220131

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20220301

R151 Written notification of patent or utility model registration

Ref document number: 7033865

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151

LAPS Cancellation because of no payment of annual fees