JP7237538B2 - 情報処理装置、それを含むシステム、情報処理方法、およびプログラム - Google Patents

情報処理装置、それを含むシステム、情報処理方法、およびプログラム Download PDF

Info

Publication number
JP7237538B2
JP7237538B2 JP2018213769A JP2018213769A JP7237538B2 JP 7237538 B2 JP7237538 B2 JP 7237538B2 JP 2018213769 A JP2018213769 A JP 2018213769A JP 2018213769 A JP2018213769 A JP 2018213769A JP 7237538 B2 JP7237538 B2 JP 7237538B2
Authority
JP
Japan
Prior art keywords
virtual
virtual viewpoint
information
viewpoint
projection method
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2018213769A
Other languages
English (en)
Japanese (ja)
Other versions
JP2020080101A (ja
JP2020080101A5 (enExample
Inventor
拓 小笠原
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to JP2018213769A priority Critical patent/JP7237538B2/ja
Application filed by Canon Inc filed Critical Canon Inc
Priority to KR1020217014249A priority patent/KR102551691B1/ko
Priority to CN201980075013.6A priority patent/CN113016010B/zh
Priority to PCT/JP2019/043996 priority patent/WO2020100770A1/ja
Priority to EP19884420.1A priority patent/EP3882866B1/en
Publication of JP2020080101A publication Critical patent/JP2020080101A/ja
Priority to US17/315,646 priority patent/US20210266511A1/en
Publication of JP2020080101A5 publication Critical patent/JP2020080101A5/ja
Priority to US17/848,426 priority patent/US11956408B2/en
Application granted granted Critical
Publication of JP7237538B2 publication Critical patent/JP7237538B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/20—Processor architectures; Processor configuration, e.g. pipelining
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/12—Panospheric to cylindrical image transformations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/122—Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/139—Format conversion, e.g. of frame-rate or size
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/356—Image reproducers having separate monoscopic and stereoscopic modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Computing Systems (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Processing Or Creating Images (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • User Interface Of Digital Computer (AREA)
  • Image Generation (AREA)
JP2018213769A 2018-11-14 2018-11-14 情報処理装置、それを含むシステム、情報処理方法、およびプログラム Active JP7237538B2 (ja)

Priority Applications (7)

Application Number Priority Date Filing Date Title
JP2018213769A JP7237538B2 (ja) 2018-11-14 2018-11-14 情報処理装置、それを含むシステム、情報処理方法、およびプログラム
CN201980075013.6A CN113016010B (zh) 2018-11-14 2019-11-08 信息处理系统、信息处理方法和存储介质
PCT/JP2019/043996 WO2020100770A1 (ja) 2018-11-14 2019-11-08 情報処理システム、情報処理方法、およびプログラム
EP19884420.1A EP3882866B1 (en) 2018-11-14 2019-11-08 Information processing system, information processing method, and program
KR1020217014249A KR102551691B1 (ko) 2018-11-14 2019-11-08 정보 처리 시스템, 정보 처리 방법, 및 저장 매체
US17/315,646 US20210266511A1 (en) 2018-11-14 2021-05-10 Information processing system, information processing method, and storage medium
US17/848,426 US11956408B2 (en) 2018-11-14 2022-06-24 Information processing system, information processing method, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2018213769A JP7237538B2 (ja) 2018-11-14 2018-11-14 情報処理装置、それを含むシステム、情報処理方法、およびプログラム

Publications (3)

Publication Number Publication Date
JP2020080101A JP2020080101A (ja) 2020-05-28
JP2020080101A5 JP2020080101A5 (enExample) 2021-12-23
JP7237538B2 true JP7237538B2 (ja) 2023-03-13

Family

ID=70730893

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018213769A Active JP7237538B2 (ja) 2018-11-14 2018-11-14 情報処理装置、それを含むシステム、情報処理方法、およびプログラム

Country Status (6)

Country Link
US (2) US20210266511A1 (enExample)
EP (1) EP3882866B1 (enExample)
JP (1) JP7237538B2 (enExample)
KR (1) KR102551691B1 (enExample)
CN (1) CN113016010B (enExample)
WO (1) WO2020100770A1 (enExample)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7574565B2 (ja) * 2020-07-31 2024-10-29 株式会社リコー 通信端末、通信システム、通信方法、及びプログラム
US20230394745A1 (en) * 2020-11-20 2023-12-07 Sony Group Corporation Information processing apparatus, information processing method, and information processing system
JP7672842B2 (ja) 2021-02-26 2025-05-08 キヤノン株式会社 情報処理装置、情報処理方法、およびプログラム
JP7690301B2 (ja) 2021-02-26 2025-06-10 キヤノン株式会社 情報処理装置、それを含むシステム、情報処理方法およびプログラム
US12206838B2 (en) * 2021-09-24 2025-01-21 Sony Group Corporation View-independent multi-camera volumetric capture system
JP7746197B2 (ja) * 2022-03-10 2025-09-30 キヤノン株式会社 画像処理システム、画像処理方法及びコンピュータプログラム
EP4443273A1 (en) * 2023-03-31 2024-10-09 Canon Kabushiki Kaisha Display control apparatus, display control method, and program

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006352539A (ja) 2005-06-16 2006-12-28 Sharp Corp 広視野映像システム
JP2011248723A (ja) 2010-05-28 2011-12-08 Sony Corp 画像処理装置および方法、並びにプログラム
JP2014215828A (ja) 2013-04-25 2014-11-17 シャープ株式会社 画像データ再生装置、および視点情報生成装置
JP2017069787A (ja) 2015-09-30 2017-04-06 徹平 江里口 動画像処理装置、動画像処理方法、動画像処理プログラム及び動画像処理表示システム。
WO2018030206A1 (ja) 2016-08-10 2018-02-15 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ カメラワーク生成方法及び映像処理装置
JP2018166279A (ja) 2017-03-28 2018-10-25 Kddi株式会社 クライアント状態に応じた映像を配信する映像配信装置、システム、プログラム及び方法

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5850352A (en) * 1995-03-31 1998-12-15 The Regents Of The University Of California Immersive video, including video hypermosaicing to generate from multiple video views of a scene a three-dimensional video mosaic from which diverse virtual video scene images are synthesized, including panoramic, scene interactive and stereoscopic images
US5729471A (en) * 1995-03-31 1998-03-17 The Regents Of The University Of California Machine dynamic selection of one video camera/image of a scene from multiple video cameras/images of the scene in accordance with a particular perspective on the scene, an object in the scene, or an event in the scene
EP1563882A4 (en) * 2002-11-20 2006-01-18 Sega Corp GAME IMAGE DISPLAY CONTROL PROGRAM, GAME DEVICE, AND RECORDING MEDIUM
US20070216782A1 (en) * 2006-03-20 2007-09-20 Donald Lee Chernoff Method of processing and storing files in a digital camera
WO2011052064A1 (ja) * 2009-10-30 2011-05-05 キヤノン株式会社 情報処理装置および方法
US20110126160A1 (en) 2009-11-23 2011-05-26 Samsung Electronics Co., Ltd. Method of providing 3d image and 3d display apparatus using the same
US9485497B2 (en) * 2010-09-10 2016-11-01 Reald Inc. Systems and methods for converting two-dimensional images into three-dimensional images
WO2012091526A2 (ko) 2010-12-31 2012-07-05 한국전자통신연구원 카메라를 구비한 휴대용 영상 통화 장치 및 그 방법
KR101752691B1 (ko) * 2011-12-14 2017-07-03 한국전자통신연구원 시점 선택이 가능한 3차원 가상 콘텐츠 동영상을 제공하는 장치 및 그 방법
US9009092B2 (en) * 2012-07-19 2015-04-14 Microsoft Technology Licensing, Llc Creating variations when transforming data into consumable content
KR101415147B1 (ko) * 2012-08-10 2014-07-08 광운대학교 산학협력단 가상시점 영상 생성을 위한 경계 잡음 제거 및 홀 채움 방법
KR102089976B1 (ko) 2012-12-28 2020-03-18 삼성전자주식회사 엑스선 영상 장치, 엑스선 영상 생성 방법 및 3차원 영상 장치
JP6443654B2 (ja) * 2013-09-26 2018-12-26 Ｔｉａｎｍａ Ｊａｐａｎ株式会社 立体画像表示装置、端末装置、立体画像表示方法、及びそのプログラム
KR101678861B1 (ko) 2015-07-28 2016-11-23 엘지전자 주식회사 이동단말기 및 그 제어방법
EP3151554A1 (en) * 2015-09-30 2017-04-05 Calay Venture S.a.r.l. Presence camera
WO2017154606A1 (ja) * 2016-03-10 2017-09-14 ソニー株式会社 情報処理装置および情報処理方法
JP6539253B2 (ja) * 2016-12-06 2019-07-03 キヤノン株式会社 情報処理装置、その制御方法、およびプログラム
JP6482580B2 (ja) * 2017-02-10 2019-03-13 キヤノン株式会社 情報処理装置、情報処理方法、およびプログラム
JP7086522B2 (ja) * 2017-02-28 2022-06-20 キヤノン株式会社 画像処理装置、情報処理方法及びプログラム
EP3603056A4 (en) 2017-03-22 2020-12-23 Nokia Technologies Oy PROCESS, APPARATUS AND COMPUTER PRODUCT-PROGRAM FOR ADAPTIVE CONTINUOUS DIFFUSION
JP7249755B2 (ja) 2018-10-26 2023-03-31 キヤノン株式会社 画像処理システムおよびその制御方法、プログラム
JP7378243B2 (ja) 2019-08-23 2023-11-13 キヤノン株式会社 画像生成装置、画像表示装置および画像処理方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006352539A (ja) 2005-06-16 2006-12-28 Sharp Corp 広視野映像システム
JP2011248723A (ja) 2010-05-28 2011-12-08 Sony Corp 画像処理装置および方法、並びにプログラム
JP2014215828A (ja) 2013-04-25 2014-11-17 シャープ株式会社 画像データ再生装置、および視点情報生成装置
JP2017069787A (ja) 2015-09-30 2017-04-06 徹平 江里口 動画像処理装置、動画像処理方法、動画像処理プログラム及び動画像処理表示システム。
WO2018030206A1 (ja) 2016-08-10 2018-02-15 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ カメラワーク生成方法及び映像処理装置
JP2018166279A (ja) 2017-03-28 2018-10-25 Kddi株式会社 クライアント状態に応じた映像を配信する映像配信装置、システム、プログラム及び方法

Also Published As

Publication number Publication date
US11956408B2 (en) 2024-04-09
WO2020100770A1 (ja) 2020-05-22
EP3882866A1 (en) 2021-09-22
KR102551691B1 (ko) 2023-07-06
JP2020080101A (ja) 2020-05-28
US20210266511A1 (en) 2021-08-26
EP3882866B1 (en) 2024-05-15
CN113016010B (zh) 2024-07-16
KR20210072086A (ko) 2021-06-16
US20220321856A1 (en) 2022-10-06
EP3882866A4 (en) 2022-08-10
CN113016010A (zh) 2021-06-22

Similar Documents

Publication Publication Date Title
JP7237538B2 (ja) 情報処理装置、それを含むシステム、情報処理方法、およびプログラム
CN107615338B (zh) 用于生成和使用降低分辨率图像并且/或者将这样的图像传送到重放或内容分发设备的方法和装置
JP6849430B2 (ja) 画像処理装置、画像処理方法、及びプログラム
US11627251B2 (en) Image processing apparatus and control method thereof, computer-readable storage medium
EP2490179B1 (en) Method and apparatus for transmitting and receiving a panoramic video stream
CN112738495B (zh) 虚拟视点图像生成方法、系统、电子设备及存储介质
JP7672842B2 (ja) 情報処理装置、情報処理方法、およびプログラム
JP7378243B2 (ja) 画像生成装置、画像表示装置および画像処理方法
JP2018507650A (ja) コンテンツの生成、送信、および／または、再生をサポートするための方法および装置
JP2010154052A (ja) 複数カメラ制御システム
US12211140B2 (en) Information processing apparatus, information processing method, and storage medium
JP7682251B2 (ja) 情報処理装置、情報処理方法、及びプログラム
CN113963094A (zh) 深度图及视频处理、重建方法、装置、设备及存储介质
JP2023122130A (ja) 映像処理装置およびその制御方法、プログラム
JP2020205549A (ja) 映像処理装置、映像処理方法、及びプログラム
JP2010166218A (ja) カメラシステム及びその制御方法
KR101752691B1 (ko) 시점 선택이 가능한 3차원 가상 콘텐츠 동영상을 제공하는 장치 및 그 방법
JP5962692B2 (ja) 端末装置、及びプログラム
JP5192442B2 (ja) 映像生成装置、映像生成方法、映像生成プログラムおよびそのプログラムを記録したコンピュータ読み取り可能な記録媒体
JP2023178007A (ja) 情報処理装置、情報処理装置の制御方法、及びプログラム
CN116137954A (zh) 信息处理设备、信息处理方法和信息处理系统
JP2023003765A (ja) 画像生成装置およびその制御方法、画像生成システム、ならびにプログラム
JP2019118042A (ja) 画像処理装置、画像処理方法及びプログラム
KR20160072817A (ko) 다시점 카메라를 이용한 영상제공 시스템 및 방법

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20211110

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20211110

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20220927

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20221128

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20221213

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230118

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20230131

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20230301

R151 Written notification of patent or utility model registration

Ref document number: 7237538

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151