KR102129792B1 - 정보 처리 장치, 화상 생성 방법, 제어 방법 및 프로그램 - Google Patents

정보 처리 장치, 화상 생성 방법, 제어 방법 및 프로그램 Download PDF

Info

Publication number
KR102129792B1
KR102129792B1 KR1020187037466A KR20187037466A KR102129792B1 KR 102129792 B1 KR102129792 B1 KR 102129792B1 KR 1020187037466 A KR1020187037466 A KR 1020187037466A KR 20187037466 A KR20187037466 A KR 20187037466A KR 102129792 B1 KR102129792 B1 KR 102129792B1
Authority
KR
South Korea
Prior art keywords
image
camera
data
virtual viewpoint
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020187037466A
Other languages
English (en)
Korean (ko)
Other versions
KR20190010650A (ko
Inventor
게이스케 모리사와
마사히로 한다
미치오 아이자와
쇼고 미즈노
가츠마사 다나카
아키히로 마츠시타
도모히로 야노
마이 고미야마
겐이치 후지이
아츠시 다테
Original Assignee
캐논 가부시끼가이샤
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 캐논 가부시끼가이샤 filed Critical 캐논 가부시끼가이샤
Publication of KR20190010650A publication Critical patent/KR20190010650A/ko
Application granted granted Critical
Publication of KR102129792B1 publication Critical patent/KR102129792B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • G01B11/245—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures using a plurality of fixed, simultaneously operating transducers
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4347—Demultiplexing of several video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/633—Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
    • H04N23/634—Warning indications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682—Vibration or motion blur correction
    • H04N23/683—Vibration or motion blur correction performed by a processor, e.g. controlling the readout of an image memory
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • H04N5/23267—
    • H04N5/247—
    • H04N9/045—

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Studio Devices (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Processing Or Creating Images (AREA)
  • Image Generation (AREA)
  • Image Analysis (AREA)
KR1020187037466A 2016-05-25 2017-05-22 정보 처리 장치, 화상 생성 방법, 제어 방법 및 프로그램 Active KR102129792B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2016104431A JP6808357B2 (ja) 2016-05-25 2016-05-25 情報処理装置、制御方法、及び、プログラム
JPJP-P-2016-104431 2016-05-25
PCT/JP2017/019076 WO2017204171A2 (en) 2016-05-25 2017-05-22 Information processing apparatus, image generation method, control method, and program

Publications (2)

Publication Number Publication Date
KR20190010650A KR20190010650A (ko) 2019-01-30
KR102129792B1 true KR102129792B1 (ko) 2020-08-05

Family

ID=59009715

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020187037466A Active KR102129792B1 (ko) 2016-05-25 2017-05-22 정보 처리 장치, 화상 생성 방법, 제어 방법 및 프로그램

Country Status (6)

Country Link
US (1) US11012674B2 (enExample)
EP (1) EP3466065A2 (enExample)
JP (1) JP6808357B2 (enExample)
KR (1) KR102129792B1 (enExample)
CN (1) CN109565580B (enExample)
WO (1) WO2017204171A2 (enExample)

Families Citing this family (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6482696B2 (ja) * 2017-06-23 2019-03-13 キヤノン株式会社 表示制御装置、表示制御方法、およびプログラム
EP3695593A4 (en) * 2017-10-13 2021-06-23 C360 Technologies, Inc. GENERATION OF PANORAMIC PROJECTIONS WITH MULTIPLE CAMERAS
JP6513169B1 (ja) * 2017-12-14 2019-05-15 キヤノン株式会社 仮想視点画像を生成するシステム、方法及びプログラム
WO2019116942A1 (ja) * 2017-12-14 2019-06-20 キヤノン株式会社 ３次元モデルの生成装置、生成方法、及びプログラム
JP7322235B2 (ja) * 2018-05-02 2023-08-07 キヤノン株式会社 画像処理装置、画像処理方法、およびプログラム
JP7062506B2 (ja) * 2018-05-02 2022-05-06 キヤノン株式会社 画像処理装置、画像処理方法、およびプログラム
JP7091133B2 (ja) * 2018-05-09 2022-06-27 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
JP6813933B2 (ja) * 2018-07-19 2021-01-13 日本電信電話株式会社 映像音声伝送システム、伝送方法、送信装置及び受信装置
JP7233867B2 (ja) * 2018-07-20 2023-03-07 キヤノン株式会社 情報処理装置、情報処理方法及びプログラム
JP7227717B2 (ja) * 2018-08-31 2023-02-22 キヤノン株式会社 情報処理装置、方法、及びプログラム
JP7245013B2 (ja) * 2018-09-06 2023-03-23 キヤノン株式会社 制御装置及び制御方法
JP7224872B2 (ja) * 2018-11-27 2023-02-20 キヤノン株式会社 システム及び情報処理方法
JP7250493B2 (ja) * 2018-12-03 2023-04-03 キヤノン株式会社 画像処理装置、三次元形状データの生成方法およびプログラム
JP2022051978A (ja) * 2019-02-15 2022-04-04 ソニーグループ株式会社 画像処理装置、画像処理方法、及び、プログラム
JP7258605B2 (ja) * 2019-03-05 2023-04-17 キヤノン株式会社 情報処理装置、情報処理方法及びプログラム
JP7095628B2 (ja) * 2019-03-07 2022-07-05 日本電信電話株式会社 座標系変換パラメータ推定装置、方法及びプログラム
EP3712843A1 (en) 2019-03-19 2020-09-23 Koninklijke Philips N.V. Image signal representing a scene
KR102658474B1 (ko) 2019-03-19 2024-04-17 한국전자통신연구원 가상 시점 합성을 위한 영상 부호화/복호화 방법 및 장치
JP7250588B2 (ja) * 2019-03-28 2023-04-03 キヤノン株式会社 画像処理装置、送信方法、及びプログラム
JP7423251B2 (ja) * 2019-10-25 2024-01-29 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
CN110798673B (zh) * 2019-11-13 2021-03-19 南京大学 基于深度卷积神经网络的自由视点视频生成及交互方法
JP7492331B2 (ja) * 2019-12-11 2024-05-29 キヤノン株式会社 画像処理装置、画像処理装置の制御方法及びプログラム
JP7508277B2 (ja) * 2020-06-03 2024-07-01 キヤノン株式会社 伝送処理装置、伝送処理方法、及びプログラム
CN114079706B (zh) * 2020-08-18 2024-06-14 京东方科技集团股份有限公司 一种信号处理装置、音视频显示装置和处理方法
CN116547582A (zh) 2020-09-25 2023-08-04 苹果公司 视频透传电子设备的结构化显示关机
JP7532314B2 (ja) 2021-06-01 2024-08-13 キヤノン株式会社 画像処理装置、画像処理方法及びプログラム
US12230164B2 (en) * 2021-07-12 2025-02-18 Milestone Systems A/S Computer implemented method and apparatus for training an operator of a video management system
US11943565B2 (en) * 2021-07-12 2024-03-26 Milestone Systems A/S Computer implemented method and apparatus for operating a video management system
JP7731632B2 (ja) * 2021-09-28 2025-09-01 キヤノン株式会社 情報処理装置、情報処理方法、プログラム、及び音響自動合成システム
JP2023168074A (ja) * 2022-05-13 2023-11-24 キヤノン株式会社 撮像装置、制御方法、及びプログラム
US12432330B2 (en) * 2022-09-19 2025-09-30 Apple Inc. Head-mounted electronic device with reliable passthrough video fallback capability
US20240193851A1 (en) * 2022-12-12 2024-06-13 Adobe Inc. Generation of a 360-degree object view by leveraging available images on an online platform
JP2025093728A (ja) 2023-12-12 2025-06-24 キヤノン株式会社 端末装置、制御方法、及びプログラム

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010020487A (ja) 2008-07-09 2010-01-28 Nippon Hoso Kyokai <Nhk> 任意視点映像生成装置及び任意視点映像生成プログラム
WO2010127418A1 (en) 2009-05-07 2010-11-11 Universite Catholique De Louvain Systems and methods for the autonomous production of videos from multi-sensored data
JP2011198349A (ja) * 2010-02-25 2011-10-06 Canon Inc 情報処理方法及びその装置
JP2012253626A (ja) * 2011-06-03 2012-12-20 Canon Inc 撮影装置およびその制御方法
US20140340427A1 (en) 2012-01-18 2014-11-20 Logos Technologies Llc Method, device, and system for computing a spherical projection image based on two-dimensional images

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3478606B2 (ja) * 1994-10-12 2003-12-15 キヤノン株式会社 立体画像表示方法および装置
JP2001229402A (ja) * 2000-02-16 2001-08-24 Mitsubishi Electric Corp ３次元画像表示装置、３次元画像表示方法およびその方法をコンピュータに実行させるプログラムを記録したコンピュータ読み取り可能な記録媒体
JP2002095018A (ja) * 2000-09-12 2002-03-29 Canon Inc 画像表示制御装置及び画像表示システム、並びに画像データの表示方法
JP2004086508A (ja) 2002-08-26 2004-03-18 Alpine Electronics Inc ３次元形状データに基づく動画の表示制御方法及びナビゲーション装置
JP2005354289A (ja) * 2004-06-09 2005-12-22 Ntt Docomo Inc 端末装置、環境管理サーバ、カメラサーバ及び映像生成方法
JP5011168B2 (ja) * 2008-03-04 2012-08-29 日本電信電話株式会社 仮想視点画像生成方法、仮想視点画像生成装置、仮想視点画像生成プログラムおよびそのプログラムを記録したコンピュータ読み取り可能な記録媒体
CA2841192C (en) * 2011-07-15 2017-07-11 Lg Electronics Inc. Method and apparatus for processing a 3d service
JP6349637B2 (ja) * 2013-07-11 2018-07-04 株式会社デンソー 車両用画像合成装置
EP3035282A4 (en) * 2013-09-11 2017-07-05 Sony Corporation Image processing device and method
WO2015054235A1 (en) * 2013-10-07 2015-04-16 Vid Scale, Inc. User adaptive 3d video rendering and delivery
JP6735592B2 (ja) * 2016-04-08 2020-08-05 キヤノン株式会社 画像処理装置及びその制御方法、画像処理システム

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010020487A (ja) 2008-07-09 2010-01-28 Nippon Hoso Kyokai <Nhk> 任意視点映像生成装置及び任意視点映像生成プログラム
WO2010127418A1 (en) 2009-05-07 2010-11-11 Universite Catholique De Louvain Systems and methods for the autonomous production of videos from multi-sensored data
JP2011198349A (ja) * 2010-02-25 2011-10-06 Canon Inc 情報処理方法及びその装置
JP2012253626A (ja) * 2011-06-03 2012-12-20 Canon Inc 撮影装置およびその制御方法
US20140340427A1 (en) 2012-01-18 2014-11-20 Logos Technologies Llc Method, device, and system for computing a spherical projection image based on two-dimensional images

Also Published As

Publication number Publication date
US11012674B2 (en) 2021-05-18
CN109565580B (zh) 2021-08-10
US20200336719A1 (en) 2020-10-22
JP2017211827A (ja) 2017-11-30
WO2017204171A2 (en) 2017-11-30
EP3466065A2 (en) 2019-04-10
CN109565580A (zh) 2019-04-02
JP6808357B2 (ja) 2021-01-06
KR20190010650A (ko) 2019-01-30
WO2017204171A3 (en) 2018-01-18

Similar Documents

Publication Publication Date Title
KR102129792B1 (ko) 정보 처리 장치, 화상 생성 방법, 제어 방법 및 프로그램
KR102121931B1 (ko) 제어 디바이스, 제어 방법 및 저장 매체
KR102208473B1 (ko) 상이한 프레임 레이트들로 전경 화상 및 배경 화상을 송신하는 카메라 어레이로부터, 유저에 의해 선택된 시점으로부터의 가상 화상을 생성하는 방법 및 장치
KR102032082B1 (ko) 데이지 체인 접속이 있는 카메라 어레이로부터, 유저에 의해 선택된 시점으로부터의 가상 화상을 생성하는 방법 및 장치
KR102270429B1 (ko) 디폴트 파라미터들이 스포츠 이벤트의 선택된 타입에 연관되는 카메라 어레이로부터, 유저에 의해 선택된 시점으로부터의 가상 화상을 생성하는 방법 및 장치
JP2019134428A (ja) 制御装置、制御方法、及び、プログラム

Legal Events

Date Code Title Description
A201 Request for examination
PA0105 International application

Patent event date: 20181224

Patent event code: PA01051R01D

Comment text: International Patent Application

PA0201 Request for examination
PG1501 Laying open of application
E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20191024

Patent event code: PE09021S01D

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20200429

GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20200629

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20200630

End annual number: 3

Start annual number: 1

PG1601 Publication of registration
PR1001 Payment of annual fee

Payment date: 20240527

Start annual number: 5

End annual number: 5