CN113016010B - 信息处理系统、信息处理方法和存储介质 - Google Patents

信息处理系统、信息处理方法和存储介质 Download PDF

Info

Publication number
CN113016010B
CN113016010B CN201980075013.6A CN201980075013A CN113016010B CN 113016010 B CN113016010 B CN 113016010B CN 201980075013 A CN201980075013 A CN 201980075013A CN 113016010 B CN113016010 B CN 113016010B
Authority
CN
China
Prior art keywords
image
virtual viewpoint
viewpoint
virtual
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201980075013.6A
Other languages
English (en)
Chinese (zh)
Other versions
CN113016010A (zh
Inventor
小笠原拓
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Publication of CN113016010A publication Critical patent/CN113016010A/zh
Application granted granted Critical
Publication of CN113016010B publication Critical patent/CN113016010B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/20—Processor architectures; Processor configuration, e.g. pipelining
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/12—Panospheric to cylindrical image transformations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/122—Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/139—Format conversion, e.g. of frame-rate or size
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/356—Image reproducers having separate monoscopic and stereoscopic modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Computing Systems (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Processing Or Creating Images (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • User Interface Of Digital Computer (AREA)
  • Image Generation (AREA)
CN201980075013.6A 2018-11-14 2019-11-08 信息处理系统、信息处理方法和存储介质 Active CN113016010B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2018-213769 2018-11-14
JP2018213769A JP7237538B2 (ja) 2018-11-14 2018-11-14 情報処理装置、それを含むシステム、情報処理方法、およびプログラム
PCT/JP2019/043996 WO2020100770A1 (ja) 2018-11-14 2019-11-08 情報処理システム、情報処理方法、およびプログラム

Publications (2)

Publication Number Publication Date
CN113016010A CN113016010A (zh) 2021-06-22
CN113016010B true CN113016010B (zh) 2024-07-16

Family

ID=70730893

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201980075013.6A Active CN113016010B (zh) 2018-11-14 2019-11-08 信息处理系统、信息处理方法和存储介质

Country Status (6)

Country Link
US (2) US20210266511A1 (enExample)
EP (1) EP3882866B1 (enExample)
JP (1) JP7237538B2 (enExample)
KR (1) KR102551691B1 (enExample)
CN (1) CN113016010B (enExample)
WO (1) WO2020100770A1 (enExample)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7574565B2 (ja) * 2020-07-31 2024-10-29 株式会社リコー 通信端末、通信システム、通信方法、及びプログラム
US20230394745A1 (en) * 2020-11-20 2023-12-07 Sony Group Corporation Information processing apparatus, information processing method, and information processing system
JP7672842B2 (ja) 2021-02-26 2025-05-08 キヤノン株式会社 情報処理装置、情報処理方法、およびプログラム
JP7690301B2 (ja) 2021-02-26 2025-06-10 キヤノン株式会社 情報処理装置、それを含むシステム、情報処理方法およびプログラム
US12206838B2 (en) * 2021-09-24 2025-01-21 Sony Group Corporation View-independent multi-camera volumetric capture system
JP7746197B2 (ja) * 2022-03-10 2025-09-30 キヤノン株式会社 画像処理システム、画像処理方法及びコンピュータプログラム
EP4443273A1 (en) * 2023-03-31 2024-10-09 Canon Kabushiki Kaisha Display control apparatus, display control method, and program

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5729471A (en) * 1995-03-31 1998-03-17 The Regents Of The University Of California Machine dynamic selection of one video camera/image of a scene from multiple video cameras/images of the scene in accordance with a particular perspective on the scene, an object in the scene, or an event in the scene
CN102598652A (zh) * 2009-10-30 2012-07-18 佳能株式会社 信息处理设备和方法
CN108141578A (zh) * 2015-09-30 2018-06-08 卡雷风险投资有限责任公司 呈现相机

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5850352A (en) * 1995-03-31 1998-12-15 The Regents Of The University Of California Immersive video, including video hypermosaicing to generate from multiple video views of a scene a three-dimensional video mosaic from which diverse virtual video scene images are synthesized, including panoramic, scene interactive and stereoscopic images
EP1563882A4 (en) * 2002-11-20 2006-01-18 Sega Corp GAME IMAGE DISPLAY CONTROL PROGRAM, GAME DEVICE, AND RECORDING MEDIUM
JP2006352539A (ja) 2005-06-16 2006-12-28 Sharp Corp 広視野映像システム
US20070216782A1 (en) * 2006-03-20 2007-09-20 Donald Lee Chernoff Method of processing and storing files in a digital camera
US20110126160A1 (en) 2009-11-23 2011-05-26 Samsung Electronics Co., Ltd. Method of providing 3d image and 3d display apparatus using the same
JP2011248723A (ja) 2010-05-28 2011-12-08 Sony Corp 画像処理装置および方法、並びにプログラム
US9485497B2 (en) * 2010-09-10 2016-11-01 Reald Inc. Systems and methods for converting two-dimensional images into three-dimensional images
WO2012091526A2 (ko) 2010-12-31 2012-07-05 한국전자통신연구원 카메라를 구비한 휴대용 영상 통화 장치 및 그 방법
KR101752691B1 (ko) * 2011-12-14 2017-07-03 한국전자통신연구원 시점 선택이 가능한 3차원 가상 콘텐츠 동영상을 제공하는 장치 및 그 방법
US9009092B2 (en) * 2012-07-19 2015-04-14 Microsoft Technology Licensing, Llc Creating variations when transforming data into consumable content
KR101415147B1 (ko) * 2012-08-10 2014-07-08 광운대학교 산학협력단 가상시점 영상 생성을 위한 경계 잡음 제거 및 홀 채움 방법
KR102089976B1 (ko) 2012-12-28 2020-03-18 삼성전자주식회사 엑스선 영상 장치, 엑스선 영상 생성 방법 및 3차원 영상 장치
JP2014215828A (ja) 2013-04-25 2014-11-17 シャープ株式会社 画像データ再生装置、および視点情報生成装置
JP6443654B2 (ja) * 2013-09-26 2018-12-26 Ｔｉａｎｍａ Ｊａｐａｎ株式会社 立体画像表示装置、端末装置、立体画像表示方法、及びそのプログラム
KR101678861B1 (ko) 2015-07-28 2016-11-23 엘지전자 주식회사 이동단말기 및 그 제어방법
JP6164780B2 (ja) 2015-09-30 2017-07-19 徹平 江里口 動画像処理装置、動画像処理方法、動画像処理プログラム及び動画像処理表示システム。
WO2017154606A1 (ja) * 2016-03-10 2017-09-14 ソニー株式会社 情報処理装置および情報処理方法
EP3499897B1 (en) 2016-08-10 2021-05-19 Panasonic Intellectual Property Corporation of America Camerawork generating method and video processing device
JP6539253B2 (ja) * 2016-12-06 2019-07-03 キヤノン株式会社 情報処理装置、その制御方法、およびプログラム
JP6482580B2 (ja) * 2017-02-10 2019-03-13 キヤノン株式会社 情報処理装置、情報処理方法、およびプログラム
JP7086522B2 (ja) * 2017-02-28 2022-06-20 キヤノン株式会社 画像処理装置、情報処理方法及びプログラム
EP3603056A4 (en) 2017-03-22 2020-12-23 Nokia Technologies Oy PROCESS, APPARATUS AND COMPUTER PRODUCT-PROGRAM FOR ADAPTIVE CONTINUOUS DIFFUSION
JP6648061B2 (ja) 2017-03-28 2020-02-14 Kddi株式会社 クライアント状態に応じた映像を配信する映像配信装置、システム、プログラム及び方法
JP7249755B2 (ja) 2018-10-26 2023-03-31 キヤノン株式会社 画像処理システムおよびその制御方法、プログラム
JP7378243B2 (ja) 2019-08-23 2023-11-13 キヤノン株式会社 画像生成装置、画像表示装置および画像処理方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5729471A (en) * 1995-03-31 1998-03-17 The Regents Of The University Of California Machine dynamic selection of one video camera/image of a scene from multiple video cameras/images of the scene in accordance with a particular perspective on the scene, an object in the scene, or an event in the scene
CN102598652A (zh) * 2009-10-30 2012-07-18 佳能株式会社 信息处理设备和方法
CN108141578A (zh) * 2015-09-30 2018-06-08 卡雷风险投资有限责任公司 呈现相机

Also Published As

Publication number Publication date
US11956408B2 (en) 2024-04-09
JP7237538B2 (ja) 2023-03-13
WO2020100770A1 (ja) 2020-05-22
EP3882866A1 (en) 2021-09-22
KR102551691B1 (ko) 2023-07-06
JP2020080101A (ja) 2020-05-28
US20210266511A1 (en) 2021-08-26
EP3882866B1 (en) 2024-05-15
KR20210072086A (ko) 2021-06-16
US20220321856A1 (en) 2022-10-06
EP3882866A4 (en) 2022-08-10
CN113016010A (zh) 2021-06-22

Similar Documents

Publication Publication Date Title
CN113016010B (zh) 信息处理系统、信息处理方法和存储介质
US11196984B2 (en) System and method for generating videos
US10650590B1 (en) Method and system for fully immersive virtual reality
US9832450B2 (en) Methods and apparatus for generating and using reduced resolution images and/or communicating such images to a playback or content distribution device
JP6385139B2 (ja) 情報処理装置、情報処理方法及びプログラム
US8885023B2 (en) System and method for virtual camera control using motion control systems for augmented three dimensional reality
US12041218B2 (en) Three-dimensional content distribution system, three-dimensional content distribution method and computer program
JP7249755B2 (ja) 画像処理システムおよびその制御方法、プログラム
US20040041822A1 (en) Image processing apparatus, image processing method, studio apparatus, storage medium, and program
JP7672842B2 (ja) 情報処理装置、情報処理方法、およびプログラム
US20160330408A1 (en) Method for progressive generation, storage and delivery of synthesized view transitions in multiple viewpoints interactive fruition environments
WO2020194821A1 (ja) Ｖｒ生放送配信システム、配信サーバ、配信サーバの制御方法、配信サーバのプログラム、およびｖｒ生写真データのデータ構造
CN116962745A (zh) 视频图像的混画方法、装置及直播系统
CN107623812A (zh) 一种实现实景展示的方法、相关装置及系统
CN113963094A (zh) 深度图及视频处理、重建方法、装置、设备及存储介质
JP2020205549A (ja) 映像処理装置、映像処理方法、及びプログラム
KR101752691B1 (ko) 시점 선택이 가능한 3차원 가상 콘텐츠 동영상을 제공하는 장치 및 그 방법
KR20180092411A (ko) 다원 방송 송출 방법 및 장치
JP5962692B2 (ja) 端末装置、及びプログラム
JP2019012533A (ja) 情報処理装置、情報処理方法及びプログラム
JP2022050305A (ja) 処理システム及びその制御方法及びプログラム
JP2010273057A (ja) 映像生成装置、映像生成方法、映像生成プログラムおよびそのプログラムを記録したコンピュータ読み取り可能な記録媒体
CN121126063A (zh) 显示控制方法、装置、设备、介质及产品
CN114339034A (zh) 一种基于自由视角视频数据的传输方法及接收处理方法
JP2019118042A (ja) 画像処理装置、画像処理方法及びプログラム

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant