JP7207913B2 - 情報処理装置、情報処理方法及びプログラム - Google Patents

情報処理装置、情報処理方法及びプログラム Download PDF

Info

Publication number
JP7207913B2
JP7207913B2 JP2018167879A JP2018167879A JP7207913B2 JP 7207913 B2 JP7207913 B2 JP 7207913B2 JP 2018167879 A JP2018167879 A JP 2018167879A JP 2018167879 A JP2018167879 A JP 2018167879A JP 7207913 B2 JP7207913 B2 JP 7207913B2
Authority
JP
Japan
Prior art keywords
virtual viewpoint
information processing
image
information
point
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2018167879A
Other languages
English (en)
Japanese (ja)
Other versions
JP2020042407A5 (OSRAM
JP2020042407A (ja
Inventor
智昭 新井
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Priority to JP2018167879A priority Critical patent/JP7207913B2/ja
Priority to KR1020190102199A priority patent/KR102475994B1/ko
Priority to US16/554,684 priority patent/US11354849B2/en
Priority to CN201910841881.2A priority patent/CN110891168A/zh
Publication of JP2020042407A publication Critical patent/JP2020042407A/ja
Publication of JP2020042407A5 publication Critical patent/JP2020042407A5/ja
Application granted granted Critical
Publication of JP7207913B2 publication Critical patent/JP7207913B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/275—Image signal generators from three-dimensional [3D] object models, e.g. computer-generated stereoscopic image signals
    • H04N13/279—Image signal generators from three-dimensional [3D] object models, e.g. computer-generated stereoscopic image signals the virtual viewpoint locations being selected by the viewers or determined by tracking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/20—Linear translation of whole images or parts thereof, e.g. panning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/243—Image signal generators using stereoscopic image cameras using three or more two-dimensional [2D] image sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H04N13/383—Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/62—Control of parameters via user interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20092—Interactive image processing based on input by user
    • G06T2207/20101—Interactive definition of point of interest, landmark or seed

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Geometry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computing Systems (AREA)
  • Processing Or Creating Images (AREA)
  • Studio Devices (AREA)
JP2018167879A 2018-09-07 2018-09-07 情報処理装置、情報処理方法及びプログラム Active JP7207913B2 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2018167879A JP7207913B2 (ja) 2018-09-07 2018-09-07 情報処理装置、情報処理方法及びプログラム
KR1020190102199A KR102475994B1 (ko) 2018-09-07 2019-08-21 정보 처리장치, 정보 처리방법 및 기억매체
US16/554,684 US11354849B2 (en) 2018-09-07 2019-08-29 Information processing apparatus, information processing method and storage medium
CN201910841881.2A CN110891168A (zh) 2018-09-07 2019-09-06 信息处理装置、信息处理方法和存储介质

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2018167879A JP7207913B2 (ja) 2018-09-07 2018-09-07 情報処理装置、情報処理方法及びプログラム

Publications (3)

Publication Number Publication Date
JP2020042407A JP2020042407A (ja) 2020-03-19
JP2020042407A5 JP2020042407A5 (OSRAM) 2021-10-14
JP7207913B2 true JP7207913B2 (ja) 2023-01-18

Family

ID=69719922

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018167879A Active JP7207913B2 (ja) 2018-09-07 2018-09-07 情報処理装置、情報処理方法及びプログラム

Country Status (4)

Country Link
US (1) US11354849B2 (OSRAM)
JP (1) JP7207913B2 (OSRAM)
KR (1) KR102475994B1 (OSRAM)
CN (1) CN110891168A (OSRAM)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10600245B1 (en) * 2014-05-28 2020-03-24 Lucasfilm Entertainment Company Ltd. Navigating a virtual environment of a media content item
JP7418101B2 (ja) * 2019-07-26 2024-01-19 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
DE112020006061T5 (de) * 2019-12-09 2022-10-27 Sony Group Corporation Informationsverarbeitungsvorrichtung und -verfahren, programm und informationsverarbeitungssystem
EP4113453A4 (en) * 2020-03-30 2023-08-30 Sony Group Corporation INFORMATION PROCESSING DEVICE, IMAGE PROCESSING SYSTEM AND INFORMATION PROCESSING METHOD
EP4187900A1 (en) * 2020-07-21 2023-05-31 Sony Group Corporation Information processing device, information processing method, and program
JP7642394B2 (ja) * 2021-02-18 2025-03-10 キヤノン株式会社 情報処理装置、情報処理方法、およびプログラム
EP4300429A4 (en) * 2021-02-26 2024-07-17 FUJIFILM Corporation IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD AND PROGRAM
JP7672283B2 (ja) * 2021-05-28 2025-05-07 キヤノン株式会社 映像処理装置及びその制御方法及びプログラム
EP4443273A1 (en) * 2023-03-31 2024-10-09 Canon Kabushiki Kaisha Display control apparatus, display control method, and program

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015225529A (ja) 2014-05-28 2015-12-14 キヤノン株式会社 情報処理装置、情報処理方法及びプログラム
JP2017191492A (ja) 2016-04-14 2017-10-19 キヤノン株式会社 情報処理装置、情報処理方法および映像生成システム

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5839220B2 (ja) 2011-07-28 2016-01-06 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム
US9361665B2 (en) * 2013-11-27 2016-06-07 Google Inc. Methods and systems for viewing a three-dimensional (3D) virtual object
CN106464847B (zh) 2014-06-20 2019-06-25 歌乐株式会社 影像合成系统和用于其的影像合成装置与影像合成方法
WO2016014233A1 (en) * 2014-07-25 2016-01-28 mindHIVE Inc. Real-time immersive mediated reality experiences
JP6674247B2 (ja) * 2015-12-14 2020-04-01 キヤノン株式会社 情報処理装置、情報処理方法、およびコンピュータプログラム
JP6849430B2 (ja) * 2016-12-27 2021-03-24 キヤノン株式会社 画像処理装置、画像処理方法、及びプログラム

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015225529A (ja) 2014-05-28 2015-12-14 キヤノン株式会社 情報処理装置、情報処理方法及びプログラム
JP2017191492A (ja) 2016-04-14 2017-10-19 キヤノン株式会社 情報処理装置、情報処理方法および映像生成システム

Also Published As

Publication number Publication date
CN110891168A (zh) 2020-03-17
KR20200028837A (ko) 2020-03-17
US20200082603A1 (en) 2020-03-12
US11354849B2 (en) 2022-06-07
KR102475994B1 (ko) 2022-12-09
JP2020042407A (ja) 2020-03-19

Similar Documents

Publication Publication Date Title
JP7132730B2 (ja) 情報処理装置および情報処理方法
KR102475994B1 (ko) 정보 처리장치, 정보 처리방법 및 기억매체
CN109889914B (zh) 视频画面推送方法、装置、计算机设备及存储介质
US10771760B2 (en) Information processing device, control method of information processing device, and storage medium
US20200288098A1 (en) Method, apparatus, medium, terminal, and device for multi-angle free-perspective interaction
JP2020086983A (ja) 画像処理装置、画像処理方法、及びプログラム
US11272153B2 (en) Information processing apparatus, method for controlling the same, and recording medium
JP7612384B2 (ja) 情報処理装置、情報処理方法およびプログラム
US9392248B2 (en) Dynamic POV composite 3D video system
US20160012644A1 (en) Augmented Reality System and Method
JP7725686B2 (ja) 画像処理装置、画像処理方法、およびプログラム
US20230353717A1 (en) Image processing system, image processing method, and storage medium
US20240078687A1 (en) Information processing apparatus, information processing method, and storage medium
JP2020067716A (ja) 情報処理装置、制御方法、及びプログラム
WO2018155703A1 (ja) 映像配信システム、端末装置及び映像データ配信装置
JP2025005681A (ja) 画像処理装置、画像処理方法およびプログラム
JP2020204973A (ja) 情報処理装置、プログラム及び情報処理システム
US12388965B2 (en) Image processing system, image processing method, and storage medium
JP2022171436A (ja) 情報処理装置、情報処理方法およびプログラム
JP2023163133A (ja) 画像処理システム、画像処理方法及びコンピュータプログラム
KR102343267B1 (ko) 다중 위치에서 촬영된 비디오를 이용한 360도 비디오 서비스 제공 장치 및 방법
CN113570730B (zh) 视频数据采集方法、视频创作方法及相关产品
JP2022094789A (ja) 情報処理装置、情報処理方法、及び、プログラム
JP2019022014A (ja) 画像提供方法、画像提供装置及びコンピュータプログラム
JP2018174376A (ja) 映像配信システム、端末装置及び映像データ配信装置

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210906

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20210906

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20220606

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20220712

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220906

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20221206

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20230105

R151 Written notification of patent or utility model registration

Ref document number: 7207913

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151