CN109964253B - 图像处理设备、图像处理系统、图像处理方法和存储介质 - Google Patents

图像处理设备、图像处理系统、图像处理方法和存储介质 Download PDF

Info

Publication number
CN109964253B
CN109964253B CN201780067201.5A CN201780067201A CN109964253B CN 109964253 B CN109964253 B CN 109964253B CN 201780067201 A CN201780067201 A CN 201780067201A CN 109964253 B CN109964253 B CN 109964253B
Authority
CN
China
Prior art keywords
image
virtual viewpoint
viewpoint image
output
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201780067201.5A
Other languages
English (en)
Chinese (zh)
Other versions
CN109964253A (zh
Inventor
高间康文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Priority to CN201911223799.XA priority Critical patent/CN110944119B/zh
Publication of CN109964253A publication Critical patent/CN109964253A/zh
Application granted granted Critical
Publication of CN109964253B publication Critical patent/CN109964253B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/2224—Studio circuitry; Studio devices; Studio equipment related to virtual studio applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Computer Graphics (AREA)
  • General Physics & Mathematics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Processing Or Creating Images (AREA)
  • Studio Devices (AREA)
  • Image Analysis (AREA)
  • Image Generation (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Image Processing (AREA)
CN201780067201.5A 2016-10-28 2017-10-20 图像处理设备、图像处理系统、图像处理方法和存储介质 Active CN109964253B (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911223799.XA CN110944119B (zh) 2016-10-28 2017-10-20 图像处理系统、图像处理方法和存储介质

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2016211905A JP6419128B2 (ja) 2016-10-28 2016-10-28 画像処理装置、画像処理システム、画像処理方法及びプログラム
JP2016-211905 2016-10-28
PCT/JP2017/037978 WO2018079430A1 (ja) 2016-10-28 2017-10-20 画像処理装置、画像処理システム、画像処理方法及びプログラム

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN201911223799.XA Division CN110944119B (zh) 2016-10-28 2017-10-20 图像处理系统、图像处理方法和存储介质

Publications (2)

Publication Number Publication Date
CN109964253A CN109964253A (zh) 2019-07-02
CN109964253B true CN109964253B (zh) 2020-01-31

Family

ID=62023396

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201780067201.5A Active CN109964253B (zh) 2016-10-28 2017-10-20 图像处理设备、图像处理系统、图像处理方法和存储介质
CN201911223799.XA Active CN110944119B (zh) 2016-10-28 2017-10-20 图像处理系统、图像处理方法和存储介质

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201911223799.XA Active CN110944119B (zh) 2016-10-28 2017-10-20 图像处理系统、图像处理方法和存储介质

Country Status (11)

Country Link
US (2) US11128813B2 (enExample)
EP (2) EP3534337B1 (enExample)
JP (1) JP6419128B2 (enExample)
KR (3) KR102364052B1 (enExample)
CN (2) CN109964253B (enExample)
AU (3) AU2017351012B2 (enExample)
BR (1) BR112019008387B1 (enExample)
CA (1) CA3041976C (enExample)
ES (1) ES2908243T3 (enExample)
RU (1) RU2708437C1 (enExample)
WO (1) WO2018079430A1 (enExample)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7212611B2 (ja) * 2017-02-27 2023-01-25 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ 画像配信方法、画像表示方法、画像配信装置及び画像表示装置
JP7027049B2 (ja) * 2017-06-15 2022-03-01 キヤノン株式会社 画像処理装置、画像処理方法及びプログラム
JP7033865B2 (ja) * 2017-08-10 2022-03-11 キヤノン株式会社 画像生成装置、画像生成方法、及びプログラム
JP7030452B2 (ja) * 2017-08-30 2022-03-07 キヤノン株式会社 情報処理装置、情報処理装置の制御方法、情報処理システム及びプログラム
JP6868288B2 (ja) * 2018-09-11 2021-05-12 株式会社アクセル 画像処理装置、画像処理方法、及び画像処理プログラム
JP7353782B2 (ja) * 2019-04-09 2023-10-02 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
JP7418101B2 (ja) * 2019-07-26 2024-01-19 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
JP7552616B2 (ja) * 2019-12-09 2024-09-18 ソニーグループ株式会社 情報処理装置および方法、プログラム、並びに、情報処理システム
WO2021131365A1 (ja) * 2019-12-26 2021-07-01 富士フイルム株式会社 情報処理装置、情報処理装置の作動方法、及びプログラム
JP7389140B2 (ja) * 2019-12-26 2023-11-29 富士フイルム株式会社 情報処理装置、情報処理方法、及びプログラム
JP6708917B1 (ja) * 2020-02-05 2020-06-10 リンクウィズ株式会社 形状検出方法、形状検出システム、プログラム
JP7476160B2 (ja) * 2021-11-29 2024-04-30 キヤノン株式会社 情報処理装置、情報処理システム、及びプログラム
CN115883792B (zh) * 2023-02-15 2023-05-05 深圳市完美显示科技有限公司 一种利用5g和8k技术的跨空间实景用户体验系统

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1694512A (zh) * 2005-06-24 2005-11-09 清华大学 一种交互式多视点视频系统中虚拟视点的合成方法
CN101080741A (zh) * 2005-07-15 2007-11-28 松下电器产业株式会社 用于图像合成的设备及方法
JP2013175988A (ja) * 2012-02-27 2013-09-05 Nec Casio Mobile Communications Ltd 映像送信装置、端末装置、映像送信方法及びプログラム

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3486579B2 (ja) * 1999-09-02 2004-01-13 キヤノン株式会社 空間描画方法、仮想空間描画装置および記憶媒体
US20020049979A1 (en) * 2000-05-18 2002-04-25 Patrick White Multiple camera video system which displays selected images
US7085409B2 (en) * 2000-10-18 2006-08-01 Sarnoff Corporation Method and apparatus for synthesizing new video and/or still imagery from a collection of real video and/or still imagery
US7307654B2 (en) * 2002-10-31 2007-12-11 Hewlett-Packard Development Company, L.P. Image capture and viewing system and method for generating a synthesized image
US8711923B2 (en) * 2002-12-10 2014-04-29 Ol2, Inc. System and method for selecting a video encoding format based on feedback data
JP2004280250A (ja) * 2003-03-13 2004-10-07 Canon Inc 情報処理装置および方法
JP4052331B2 (ja) * 2003-06-20 2008-02-27 日本電信電話株式会社 仮想視点画像生成方法及び３次元画像表示方法並びに装置
JP2007150747A (ja) * 2005-11-28 2007-06-14 Matsushita Electric Ind Co Ltd 受信装置及び本線映像配信装置
US8277316B2 (en) * 2006-09-14 2012-10-02 Nintendo Co., Ltd. Method and apparatus for using a common pointing input to control 3D viewpoint and object targeting
JP4895042B2 (ja) 2007-07-20 2012-03-14 富士フイルム株式会社 画像圧縮装置、画像圧縮方法、及びプログラム
US9041722B2 (en) * 2007-11-16 2015-05-26 Sportvision, Inc. Updating background texture for virtual viewpoint animations
US8270767B2 (en) * 2008-04-16 2012-09-18 Johnson Controls Technology Company Systems and methods for providing immersive displays of video camera information from a plurality of cameras
US8819172B2 (en) * 2010-11-04 2014-08-26 Digimarc Corporation Smartphone-based methods and systems
JP5517598B2 (ja) * 2009-12-22 2014-06-11 キヤノン株式会社 映像再生装置及びその制御方法
US8611674B1 (en) * 2010-01-18 2013-12-17 Disney Enterprises, Inc. System and method for invariant-based normal estimation
US8823797B2 (en) * 2010-06-03 2014-09-02 Microsoft Corporation Simulated video with extra viewpoints and enhanced resolution for traffic cameras
JP2012114816A (ja) * 2010-11-26 2012-06-14 Sony Corp 画像処理装置、画像処理方法及び画像処理プログラム
US9615079B2 (en) * 2011-03-18 2017-04-04 Sony Corporation Image processing apparatus and image processing method
EP2600316A1 (en) * 2011-11-29 2013-06-05 Inria Institut National de Recherche en Informatique et en Automatique Method, system and software program for shooting and editing a film comprising at least one image of a 3D computer-generated animation
KR101265711B1 (ko) * 2011-11-30 2013-05-20 주식회사 이미지넥스트 3ｄ 차량 주변 영상 생성 방법 및 장치
JP6128748B2 (ja) 2012-04-13 2017-05-17 キヤノン株式会社 画像処理装置及び方法
KR101224221B1 (ko) * 2012-05-10 2013-01-22 쉐어쉐어주식회사 응용프로그램을 이용한 콘텐츠 운영 시스템
EP2860606B1 (en) 2012-06-12 2018-01-10 Sony Corporation Information processing device, information processing method, and program for an augmented reality display
CN102801997B (zh) * 2012-07-11 2014-06-11 天津大学 基于感兴趣深度的立体图像压缩方法
US9497380B1 (en) * 2013-02-15 2016-11-15 Red.Com, Inc. Dense field imaging
US9462301B2 (en) * 2013-03-15 2016-10-04 Google Inc. Generating videos with multiple viewpoints
JP6432029B2 (ja) * 2013-05-26 2018-12-05 ピクセルロット エルティーディー．Ｐｉｘｅｌｌｏｔ Ｌｔｄ． 低コストでテレビ番組を制作する方法及びシステム
KR102098277B1 (ko) * 2013-06-11 2020-04-07 삼성전자주식회사 시선 추적을 이용한 시인성 개선 방법, 저장 매체 및 전자 장치
US9996974B2 (en) * 2013-08-30 2018-06-12 Qualcomm Incorporated Method and apparatus for representing a physical scene
EP3055763A1 (en) * 2013-10-07 2016-08-17 VID SCALE, Inc. User adaptive 3d video rendering and delivery
JP6607433B2 (ja) 2014-06-23 2019-11-20 パナソニックＩｐマネジメント株式会社 映像配信方法及びサーバ
JP6299492B2 (ja) 2014-07-03 2018-03-28 ソニー株式会社 情報処理装置、情報処理方法、およびプログラム
JP6477214B2 (ja) 2015-05-01 2019-03-06 セイコーエプソン株式会社 傾斜度測定方法及び装置並びに電子機器及びプログラム

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1694512A (zh) * 2005-06-24 2005-11-09 清华大学 一种交互式多视点视频系统中虚拟视点的合成方法
CN101080741A (zh) * 2005-07-15 2007-11-28 松下电器产业株式会社 用于图像合成的设备及方法
JP2013175988A (ja) * 2012-02-27 2013-09-05 Nec Casio Mobile Communications Ltd 映像送信装置、端末装置、映像送信方法及びプログラム

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Interactive Free-Viewpoint Video;Gregor Miller 等;《https://www.researchgate.net/publication/228741517》;20050131;第1-10页 *

Also Published As

Publication number Publication date
EP3534337A4 (en) 2020-08-26
ES2908243T3 (es) 2022-04-28
CA3041976C (en) 2020-07-28
CN110944119A (zh) 2020-03-31
RU2708437C1 (ru) 2019-12-06
US11128813B2 (en) 2021-09-21
WO2018079430A1 (ja) 2018-05-03
KR20200023513A (ko) 2020-03-04
KR20210068629A (ko) 2021-06-09
KR102364052B1 (ko) 2022-02-18
KR102083767B1 (ko) 2020-03-02
AU2017351012A1 (en) 2019-05-23
CN110944119B (zh) 2022-04-26
EP3534337A1 (en) 2019-09-04
JP6419128B2 (ja) 2018-11-07
AU2020200831A1 (en) 2020-02-20
KR20190064649A (ko) 2019-06-10
BR112019008387B1 (pt) 2021-02-23
CN109964253A (zh) 2019-07-02
AU2021269399B2 (en) 2023-09-28
US20190253639A1 (en) 2019-08-15
US20210344848A1 (en) 2021-11-04
AU2017351012B2 (en) 2019-11-14
EP4012661A1 (en) 2022-06-15
BR112019008387A2 (pt) 2019-07-09
CA3041976A1 (en) 2018-05-03
EP3534337B1 (en) 2022-02-16
JP2018073105A (ja) 2018-05-10
KR102262731B1 (ko) 2021-06-10
AU2021269399A1 (en) 2021-12-16

Similar Documents

Publication Publication Date Title
CN110944119B (zh) 图像处理系统、图像处理方法和存储介质
US10916048B2 (en) Image processing apparatus, image processing method, and storage medium
CN112489182B (zh) 用于生成图像的系统、方法和存储介质
KR101655078B1 (ko) 움직이는 사진 생성 방법 및 장치
JP7023696B2 (ja) 情報処理装置、情報処理方法及びプログラム
JP7439146B2 (ja) 画像処理システム、画像処理方法及びプログラム
KR20230130709A (ko) 정보처리 장치, 정보처리 방법, 및 기억 매체
JP6672417B2 (ja) 画像処理装置、画像処理システム、画像処理方法及びプログラム
EP4296961A1 (en) Image processing device, image processing method, and program
JP2022028091A (ja) 画像処理装置、画像処理方法、及び、プログラム
KR20170082116A (ko) 움직이는 사진 생성 방법 및 장치

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant