KR102475994B1 - 정보 처리장치, 정보 처리방법 및 기억매체 - Google Patents

정보 처리장치, 정보 처리방법 및 기억매체 Download PDF

Info

Publication number
KR102475994B1
KR102475994B1 KR1020190102199A KR20190102199A KR102475994B1 KR 102475994 B1 KR102475994 B1 KR 102475994B1 KR 1020190102199 A KR1020190102199 A KR 1020190102199A KR 20190102199 A KR20190102199 A KR 20190102199A KR 102475994 B1 KR102475994 B1 KR 102475994B1
Authority
KR
South Korea
Prior art keywords
virtual viewpoint
positional information
image
viewpoint image
interest
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020190102199A
Other languages
English (en)
Korean (ko)
Other versions
KR20200028837A (ko
Inventor
토모아키 아라이
Original Assignee
캐논 가부시끼가이샤
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 캐논 가부시끼가이샤 filed Critical 캐논 가부시끼가이샤
Publication of KR20200028837A publication Critical patent/KR20200028837A/ko
Application granted granted Critical
Publication of KR102475994B1 publication Critical patent/KR102475994B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/275—Image signal generators from three-dimensional [3D] object models, e.g. computer-generated stereoscopic image signals
    • H04N13/279—Image signal generators from three-dimensional [3D] object models, e.g. computer-generated stereoscopic image signals the virtual viewpoint locations being selected by the viewers or determined by tracking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/20—Linear translation of whole images or parts thereof, e.g. panning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/243—Image signal generators using stereoscopic image cameras using three or more two-dimensional [2D] image sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H04N13/383—Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/62—Control of parameters via user interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20092—Interactive image processing based on input by user
    • G06T2207/20101—Interactive definition of point of interest, landmark or seed

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computing Systems (AREA)
  • Geometry (AREA)
  • Processing Or Creating Images (AREA)
  • Studio Devices (AREA)
KR1020190102199A 2018-09-07 2019-08-21 정보 처리장치, 정보 처리방법 및 기억매체 Active KR102475994B1 (ko)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018167879A JP7207913B2 (ja) 2018-09-07 2018-09-07 情報処理装置、情報処理方法及びプログラム
JPJP-P-2018-167879 2018-09-07

Publications (2)

Publication Number Publication Date
KR20200028837A KR20200028837A (ko) 2020-03-17
KR102475994B1 true KR102475994B1 (ko) 2022-12-09

Family

ID=69719922

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020190102199A Active KR102475994B1 (ko) 2018-09-07 2019-08-21 정보 처리장치, 정보 처리방법 및 기억매체

Country Status (4)

Country Link
US (1) US11354849B2 (enExample)
JP (1) JP7207913B2 (enExample)
KR (1) KR102475994B1 (enExample)
CN (1) CN110891168A (enExample)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10600245B1 (en) * 2014-05-28 2020-03-24 Lucasfilm Entertainment Company Ltd. Navigating a virtual environment of a media content item
JP7418101B2 (ja) * 2019-07-26 2024-01-19 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
JP7552616B2 (ja) * 2019-12-09 2024-09-18 ソニーグループ株式会社 情報処理装置および方法、プログラム、並びに、情報処理システム
US12219122B2 (en) * 2020-03-30 2025-02-04 Sony Group Corporation Information processing apparatus, image processing system, and information processing method
US12106439B2 (en) * 2020-07-21 2024-10-01 Sony Group Corporation Device and associated methodology for suppressing interaction delay of interacting with a field of view of a mobile terminal on a different display
WO2022070598A1 (ja) * 2020-09-29 2022-04-07 富士フイルム株式会社 データ処理装置、データ処理方法、及びプログラム
JP7642394B2 (ja) * 2021-02-18 2025-03-10 キヤノン株式会社 情報処理装置、情報処理方法、およびプログラム
WO2022181379A1 (ja) * 2021-02-26 2022-09-01 富士フイルム株式会社 画像処理装置、画像処理方法、及びプログラム
WO2022209362A1 (ja) * 2021-03-31 2022-10-06 富士フイルム株式会社 画像処理装置、画像処理方法、及びプログラム
JP7672283B2 (ja) * 2021-05-28 2025-05-07 キヤノン株式会社 映像処理装置及びその制御方法及びプログラム
EP4443273A1 (en) * 2023-03-31 2024-10-09 Canon Kabushiki Kaisha Display control apparatus, display control method, and program

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015194501A1 (ja) * 2014-06-20 2015-12-23 クラリオン株式会社 映像合成システムとそのための映像合成装置及び映像合成方法
JP2018106496A (ja) * 2016-12-27 2018-07-05 キヤノン株式会社 画像処理装置、画像処理方法、及びプログラム

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5839220B2 (ja) * 2011-07-28 2016-01-06 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム
US9361665B2 (en) * 2013-11-27 2016-06-07 Google Inc. Methods and systems for viewing a three-dimensional (3D) virtual object
JP6385139B2 (ja) 2014-05-28 2018-09-05 キヤノン株式会社 情報処理装置、情報処理方法及びプログラム
US10089785B2 (en) * 2014-07-25 2018-10-02 mindHIVE Inc. Real-time immersive mediated reality experiences
JP6674247B2 (ja) * 2015-12-14 2020-04-01 キヤノン株式会社 情報処理装置、情報処理方法、およびコンピュータプログラム
JP6812128B2 (ja) 2016-04-14 2021-01-13 キヤノン株式会社 情報処理装置および情報処理方法

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015194501A1 (ja) * 2014-06-20 2015-12-23 クラリオン株式会社 映像合成システムとそのための映像合成装置及び映像合成方法
JP2018106496A (ja) * 2016-12-27 2018-07-05 キヤノン株式会社 画像処理装置、画像処理方法、及びプログラム

Also Published As

Publication number Publication date
US20200082603A1 (en) 2020-03-12
JP2020042407A (ja) 2020-03-19
CN110891168A (zh) 2020-03-17
KR20200028837A (ko) 2020-03-17
US11354849B2 (en) 2022-06-07
JP7207913B2 (ja) 2023-01-18

Similar Documents

Publication Publication Date Title
US11006089B2 (en) Information processing apparatus and information processing method
JP7207913B2 (ja) 情報処理装置、情報処理方法及びプログラム
US10771760B2 (en) Information processing device, control method of information processing device, and storage medium
JP6621063B2 (ja) カメラ選択方法及び映像配信システム
US11831853B2 (en) Information processing apparatus, information processing method, and storage medium
JP2020086983A (ja) 画像処理装置、画像処理方法、及びプログラム
US11272153B2 (en) Information processing apparatus, method for controlling the same, and recording medium
JP7725686B2 (ja) 画像処理装置、画像処理方法、およびプログラム
US20160012644A1 (en) Augmented Reality System and Method
WO2024084943A1 (ja) 情報処理装置、情報処理方法、プログラム
US20230353717A1 (en) Image processing system, image processing method, and storage medium
US20240078687A1 (en) Information processing apparatus, information processing method, and storage medium
US11468258B2 (en) Information processing apparatus, information processing method, and storage medium
US20240428455A1 (en) Image processing apparatus, image processing method, and storage medium
US20250004547A1 (en) Image processing apparatus, image processing method, and storage medium
WO2018155703A1 (ja) 映像配信システム、端末装置及び映像データ配信装置
JP2024124469A (ja) 画像処理装置、画像処理方法、コンピュータプログラム
JP2020067716A (ja) 情報処理装置、制御方法、及びプログラム
WO2021217385A1 (zh) 一种视频处理方法和装置
CN107093435A (zh) 一种多媒体设备
JP2022094789A (ja) 情報処理装置、情報処理方法、及び、プログラム
KR102343267B1 (ko) 다중 위치에서 촬영된 비디오를 이용한 360도 비디오 서비스 제공 장치 및 방법
JP2022171436A (ja) 情報処理装置、情報処理方法およびプログラム
US20260030835A1 (en) Information processing system, information processing method, and medium
JP7530206B2 (ja) 情報処理装置、情報処理方法およびプログラム

Legal Events

Date Code Title Description
PA0109 Patent application

Patent event code: PA01091R01D

Comment text: Patent Application

Patent event date: 20190821

PG1501 Laying open of application
A201 Request for examination
PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20210222

Comment text: Request for Examination of Application

Patent event code: PA02011R01I

Patent event date: 20190821

Comment text: Patent Application

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20220210

Patent event code: PE09021S01D

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20220906

GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20221206

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20221207

End annual number: 3

Start annual number: 1

PG1601 Publication of registration