JP6419128B2 - 画像処理装置、画像処理システム、画像処理方法及びプログラム - Google Patents

画像処理装置、画像処理システム、画像処理方法及びプログラム Download PDF

Info

Publication number
JP6419128B2
JP6419128B2 JP2016211905A JP2016211905A JP6419128B2 JP 6419128 B2 JP6419128 B2 JP 6419128B2 JP 2016211905 A JP2016211905 A JP 2016211905A JP 2016211905 A JP2016211905 A JP 2016211905A JP 6419128 B2 JP6419128 B2 JP 6419128B2
Authority
JP
Japan
Prior art keywords
image
virtual viewpoint
viewpoint image
output
generating
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2016211905A
Other languages
English (en)
Japanese (ja)
Other versions
JP2018073105A (ja
JP2018073105A5 (enExample
Inventor
康文 ▲高▼間
康文 ▲高▼間
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to JP2016211905A priority Critical patent/JP6419128B2/ja
Application filed by Canon Inc filed Critical Canon Inc
Priority to KR1020197014181A priority patent/KR102083767B1/ko
Priority to RU2019114982A priority patent/RU2708437C1/ru
Priority to ES17864980T priority patent/ES2908243T3/es
Priority to EP17864980.2A priority patent/EP3534337B1/en
Priority to PCT/JP2017/037978 priority patent/WO2018079430A1/ja
Priority to CN201911223799.XA priority patent/CN110944119B/zh
Priority to BR112019008387-1A priority patent/BR112019008387B1/pt
Priority to KR1020217016990A priority patent/KR102364052B1/ko
Priority to KR1020207005390A priority patent/KR102262731B1/ko
Priority to EP22150472.3A priority patent/EP4012661A1/en
Priority to AU2017351012A priority patent/AU2017351012B2/en
Priority to CA3041976A priority patent/CA3041976C/en
Priority to CN201780067201.5A priority patent/CN109964253B/zh
Publication of JP2018073105A publication Critical patent/JP2018073105A/ja
Publication of JP2018073105A5 publication Critical patent/JP2018073105A5/ja
Application granted granted Critical
Publication of JP6419128B2 publication Critical patent/JP6419128B2/ja
Priority to US16/396,281 priority patent/US11128813B2/en
Priority to AU2020200831A priority patent/AU2020200831A1/en
Priority to US17/373,469 priority patent/US20210344848A1/en
Priority to AU2021269399A priority patent/AU2021269399B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/2224—Studio circuitry; Studio devices; Studio equipment related to virtual studio applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Processing Or Creating Images (AREA)
  • Image Analysis (AREA)
  • Studio Devices (AREA)
  • Image Generation (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Image Processing (AREA)
JP2016211905A 2016-10-28 2016-10-28 画像処理装置、画像処理システム、画像処理方法及びプログラム Active JP6419128B2 (ja)

Priority Applications (18)

Application Number Priority Date Filing Date Title
JP2016211905A JP6419128B2 (ja) 2016-10-28 2016-10-28 画像処理装置、画像処理システム、画像処理方法及びプログラム
AU2017351012A AU2017351012B2 (en) 2016-10-28 2017-10-20 Image processing apparatus, image processing system, image processing method and storage medium
ES17864980T ES2908243T3 (es) 2016-10-28 2017-10-20 Aparato de procesamiento de imágenes, sistema de procesamiento de imágenes, procedimiento de procesamiento de imágenes y programa
EP17864980.2A EP3534337B1 (en) 2016-10-28 2017-10-20 Image processing apparatus, image processing system, image processing method, and program
PCT/JP2017/037978 WO2018079430A1 (ja) 2016-10-28 2017-10-20 画像処理装置、画像処理システム、画像処理方法及びプログラム
CN201911223799.XA CN110944119B (zh) 2016-10-28 2017-10-20 图像处理系统、图像处理方法和存储介质
BR112019008387-1A BR112019008387B1 (pt) 2016-10-28 2017-10-20 sistema e método de processamento de imagem para gerar imagem de ponto de observação virtual, e meio de armazenamento
CN201780067201.5A CN109964253B (zh) 2016-10-28 2017-10-20 图像处理设备、图像处理系统、图像处理方法和存储介质
RU2019114982A RU2708437C1 (ru) 2016-10-28 2017-10-20 Устройство обработки изображений, система обработки изображений, способ обработки изображений и носитель данных
EP22150472.3A EP4012661A1 (en) 2016-10-28 2017-10-20 Generation of virtual viewpoint images
KR1020197014181A KR102083767B1 (ko) 2016-10-28 2017-10-20 화상 처리 장치, 화상 처리 시스템, 화상 처리 방법 및 기억 매체
KR1020207005390A KR102262731B1 (ko) 2016-10-28 2017-10-20 화상 처리 시스템, 화상 처리 방법 및 기억 매체
KR1020217016990A KR102364052B1 (ko) 2016-10-28 2017-10-20 화상 처리 시스템, 화상 처리 방법 및 기억 매체
CA3041976A CA3041976C (en) 2016-10-28 2017-10-20 Image processing apparatus, image processing system, image processing method, and storage medium, for generating virtual viewpoint image
US16/396,281 US11128813B2 (en) 2016-10-28 2019-04-26 Image processing apparatus, image processing system, image processing method, and storage medium
AU2020200831A AU2020200831A1 (en) 2016-10-28 2020-02-05 Image processing apparatus, image processing system, image processing method, and program
US17/373,469 US20210344848A1 (en) 2016-10-28 2021-07-12 Image processing apparatus, image processing system, image processing method, and storage medium
AU2021269399A AU2021269399B2 (en) 2016-10-28 2021-11-18 Image processing apparatus, image processing system, image processing method, and program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2016211905A JP6419128B2 (ja) 2016-10-28 2016-10-28 画像処理装置、画像処理システム、画像処理方法及びプログラム

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2018192134A Division JP6672417B2 (ja) 2018-10-10 2018-10-10 画像処理装置、画像処理システム、画像処理方法及びプログラム

Publications (3)

Publication Number Publication Date
JP2018073105A JP2018073105A (ja) 2018-05-10
JP2018073105A5 JP2018073105A5 (enExample) 2018-07-12
JP6419128B2 true JP6419128B2 (ja) 2018-11-07

Family

ID=62023396

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2016211905A Active JP6419128B2 (ja) 2016-10-28 2016-10-28 画像処理装置、画像処理システム、画像処理方法及びプログラム

Country Status (11)

Country Link
US (2) US11128813B2 (enExample)
EP (2) EP3534337B1 (enExample)
JP (1) JP6419128B2 (enExample)
KR (3) KR102364052B1 (enExample)
CN (2) CN109964253B (enExample)
AU (3) AU2017351012B2 (enExample)
BR (1) BR112019008387B1 (enExample)
CA (1) CA3041976C (enExample)
ES (1) ES2908243T3 (enExample)
RU (1) RU2708437C1 (enExample)
WO (1) WO2018079430A1 (enExample)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7212611B2 (ja) * 2017-02-27 2023-01-25 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ 画像配信方法、画像表示方法、画像配信装置及び画像表示装置
JP7027049B2 (ja) * 2017-06-15 2022-03-01 キヤノン株式会社 画像処理装置、画像処理方法及びプログラム
JP7033865B2 (ja) * 2017-08-10 2022-03-11 キヤノン株式会社 画像生成装置、画像生成方法、及びプログラム
JP7030452B2 (ja) * 2017-08-30 2022-03-07 キヤノン株式会社 情報処理装置、情報処理装置の制御方法、情報処理システム及びプログラム
JP6868288B2 (ja) * 2018-09-11 2021-05-12 株式会社アクセル 画像処理装置、画像処理方法、及び画像処理プログラム
JP7353782B2 (ja) * 2019-04-09 2023-10-02 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
JP7418101B2 (ja) * 2019-07-26 2024-01-19 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
US12160556B2 (en) * 2019-12-09 2024-12-03 Sony Group Corporation Information processing device, information processing method, program, and information processing system
WO2021131375A1 (ja) * 2019-12-26 2021-07-01 富士フイルム株式会社 情報処理装置、情報処理方法、及びプログラム
WO2021131365A1 (ja) 2019-12-26 2021-07-01 富士フイルム株式会社 情報処理装置、情報処理装置の作動方法、及びプログラム
JP6708917B1 (ja) * 2020-02-05 2020-06-10 リンクウィズ株式会社 形状検出方法、形状検出システム、プログラム
JP7476160B2 (ja) * 2021-11-29 2024-04-30 キヤノン株式会社 情報処理装置、情報処理システム、及びプログラム
CN115883792B (zh) * 2023-02-15 2023-05-05 深圳市完美显示科技有限公司 一种利用5g和8k技术的跨空间实景用户体验系统

Family Cites Families (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3486579B2 (ja) * 1999-09-02 2004-01-13 キヤノン株式会社 空間描画方法、仮想空間描画装置および記憶媒体
US20020049979A1 (en) * 2000-05-18 2002-04-25 Patrick White Multiple camera video system which displays selected images
US7085409B2 (en) * 2000-10-18 2006-08-01 Sarnoff Corporation Method and apparatus for synthesizing new video and/or still imagery from a collection of real video and/or still imagery
US7307654B2 (en) * 2002-10-31 2007-12-11 Hewlett-Packard Development Company, L.P. Image capture and viewing system and method for generating a synthesized image
US8711923B2 (en) * 2002-12-10 2014-04-29 Ol2, Inc. System and method for selecting a video encoding format based on feedback data
JP2004280250A (ja) * 2003-03-13 2004-10-07 Canon Inc 情報処理装置および方法
KR100779634B1 (ko) * 2003-06-20 2007-11-26 니폰 덴신 덴와 가부시끼가이샤 가상시점 화상 생성방법 및 3차원 화상 표시방법 및 장치
CN100355272C (zh) * 2005-06-24 2007-12-12 清华大学 一种交互式多视点视频系统中虚拟视点的合成方法
JP4727329B2 (ja) * 2005-07-15 2011-07-20 パナソニック株式会社 画像合成装置及び画像合成方法
JP2007150747A (ja) * 2005-11-28 2007-06-14 Matsushita Electric Ind Co Ltd 受信装置及び本線映像配信装置
US8277316B2 (en) * 2006-09-14 2012-10-02 Nintendo Co., Ltd. Method and apparatus for using a common pointing input to control 3D viewpoint and object targeting
JP4895042B2 (ja) 2007-07-20 2012-03-14 富士フイルム株式会社 画像圧縮装置、画像圧縮方法、及びプログラム
US9041722B2 (en) * 2007-11-16 2015-05-26 Sportvision, Inc. Updating background texture for virtual viewpoint animations
US8270767B2 (en) * 2008-04-16 2012-09-18 Johnson Controls Technology Company Systems and methods for providing immersive displays of video camera information from a plurality of cameras
US8819172B2 (en) * 2010-11-04 2014-08-26 Digimarc Corporation Smartphone-based methods and systems
JP5517598B2 (ja) * 2009-12-22 2014-06-11 キヤノン株式会社 映像再生装置及びその制御方法
US8611674B1 (en) * 2010-01-18 2013-12-17 Disney Enterprises, Inc. System and method for invariant-based normal estimation
US8823797B2 (en) * 2010-06-03 2014-09-02 Microsoft Corporation Simulated video with extra viewpoints and enhanced resolution for traffic cameras
JP2012114816A (ja) * 2010-11-26 2012-06-14 Sony Corp 画像処理装置、画像処理方法及び画像処理プログラム
MX352224B (es) * 2011-03-18 2017-11-15 Sony Corp Aparato de procesamiento de imagenes y metodo de procesamiento de imagenes.
EP2600316A1 (en) * 2011-11-29 2013-06-05 Inria Institut National de Recherche en Informatique et en Automatique Method, system and software program for shooting and editing a film comprising at least one image of a 3D computer-generated animation
KR101265711B1 (ko) * 2011-11-30 2013-05-20 주식회사 이미지넥스트 3ｄ 차량 주변 영상 생성 방법 및 장치
JP5887994B2 (ja) * 2012-02-27 2016-03-16 日本電気株式会社 映像送信装置、端末装置、映像送信方法及びプログラム
JP6128748B2 (ja) 2012-04-13 2017-05-17 キヤノン株式会社 画像処理装置及び方法
KR101224221B1 (ko) * 2012-05-10 2013-01-22 쉐어쉐어주식회사 응용프로그램을 이용한 콘텐츠 운영 시스템
US9773333B2 (en) * 2012-06-12 2017-09-26 Sony Corporation Information processing device, information processing method, and program
CN102801997B (zh) * 2012-07-11 2014-06-11 天津大学 基于感兴趣深度的立体图像压缩方法
US9497380B1 (en) * 2013-02-15 2016-11-15 Red.Com, Inc. Dense field imaging
US9462301B2 (en) * 2013-03-15 2016-10-04 Google Inc. Generating videos with multiple viewpoints
CN105264876B (zh) * 2013-05-26 2019-04-23 皮克索洛特公司 低成本电视制作的方法及系统
KR102098277B1 (ko) * 2013-06-11 2020-04-07 삼성전자주식회사 시선 추적을 이용한 시인성 개선 방법, 저장 매체 및 전자 장치
US9996974B2 (en) * 2013-08-30 2018-06-12 Qualcomm Incorporated Method and apparatus for representing a physical scene
US20160255322A1 (en) * 2013-10-07 2016-09-01 Vid Scale, Inc. User adaptive 3d video rendering and delivery
JP6607433B2 (ja) 2014-06-23 2019-11-20 パナソニックＩｐマネジメント株式会社 映像配信方法及びサーバ
JP6299492B2 (ja) * 2014-07-03 2018-03-28 ソニー株式会社 情報処理装置、情報処理方法、およびプログラム
JP6477214B2 (ja) 2015-05-01 2019-03-06 セイコーエプソン株式会社 傾斜度測定方法及び装置並びに電子機器及びプログラム

Also Published As

Publication number Publication date
BR112019008387A2 (pt) 2019-07-09
ES2908243T3 (es) 2022-04-28
KR20190064649A (ko) 2019-06-10
WO2018079430A1 (ja) 2018-05-03
US20210344848A1 (en) 2021-11-04
KR102262731B1 (ko) 2021-06-10
JP2018073105A (ja) 2018-05-10
KR102083767B1 (ko) 2020-03-02
CN109964253B (zh) 2020-01-31
KR20210068629A (ko) 2021-06-09
US11128813B2 (en) 2021-09-21
AU2021269399B2 (en) 2023-09-28
RU2708437C1 (ru) 2019-12-06
KR102364052B1 (ko) 2022-02-18
EP3534337B1 (en) 2022-02-16
CN110944119B (zh) 2022-04-26
EP3534337A4 (en) 2020-08-26
AU2017351012A1 (en) 2019-05-23
CN110944119A (zh) 2020-03-31
EP3534337A1 (en) 2019-09-04
US20190253639A1 (en) 2019-08-15
CA3041976A1 (en) 2018-05-03
EP4012661A1 (en) 2022-06-15
KR20200023513A (ko) 2020-03-04
BR112019008387B1 (pt) 2021-02-23
AU2017351012B2 (en) 2019-11-14
AU2021269399A1 (en) 2021-12-16
CN109964253A (zh) 2019-07-02
AU2020200831A1 (en) 2020-02-20
CA3041976C (en) 2020-07-28

Similar Documents

Publication Publication Date Title
JP6419128B2 (ja) 画像処理装置、画像処理システム、画像処理方法及びプログラム
US10916048B2 (en) Image processing apparatus, image processing method, and storage medium
JP7086522B2 (ja) 画像処理装置、情報処理方法及びプログラム
JP7140487B2 (ja) 情報処理装置、表示制御方法、及び、プログラム
JP7023696B2 (ja) 情報処理装置、情報処理方法及びプログラム
JP5762600B1 (ja) 情報処理装置及び情報処理方法
JP2019197279A (ja) 画像処理装置、画像処理装置の制御方法及びプログラム
JP7439146B2 (ja) 画像処理システム、画像処理方法及びプログラム
JP6672417B2 (ja) 画像処理装置、画像処理システム、画像処理方法及びプログラム
JP6717486B1 (ja) 拡張仮想空間提供システム
EP4296961A1 (en) Image processing device, image processing method, and program
JP2022073648A (ja) 情報処理装置、情報処理方法、及びプログラム
JP2023175503A (ja) 画像処理装置及びその画像処理方法

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20180411

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20180411

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20180601

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20180703

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20180829

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20180911

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20181009

R151 Written notification of patent or utility model registration

Ref document number: 6419128

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151