CN109565580B - 信息处理设备、图像生成方法、控制方法和程序 - Google Patents

信息处理设备、图像生成方法、控制方法和程序 Download PDF

Info

Publication number
CN109565580B
CN109565580B CN201780032285.9A CN201780032285A CN109565580B CN 109565580 B CN109565580 B CN 109565580B CN 201780032285 A CN201780032285 A CN 201780032285A CN 109565580 B CN109565580 B CN 109565580B
Authority
CN
China
Prior art keywords
image
camera
data
virtual
cameras
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201780032285.9A
Other languages
English (en)
Chinese (zh)
Other versions
CN109565580A (zh
Inventor
森泽圭辅
半田雅大
相泽道雄
水野祥吾
田中克昌
松下明弘
矢埜智裕
小宫山麻衣
藤井贤一
伊达厚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Publication of CN109565580A publication Critical patent/CN109565580A/zh
Application granted granted Critical
Publication of CN109565580B publication Critical patent/CN109565580B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • G01B11/245—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures using a plurality of fixed, simultaneously operating transducers
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4347—Demultiplexing of several video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/633—Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
    • H04N23/634—Warning indications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682—Vibration or motion blur correction
    • H04N23/683—Vibration or motion blur correction performed by a processor, e.g. controlling the readout of an image memory
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Studio Devices (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Processing Or Creating Images (AREA)
  • Image Generation (AREA)
  • Image Analysis (AREA)
CN201780032285.9A 2016-05-25 2017-05-22 信息处理设备、图像生成方法、控制方法和程序 Active CN109565580B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2016104431A JP6808357B2 (ja) 2016-05-25 2016-05-25 情報処理装置、制御方法、及び、プログラム
JP2016-104431 2016-05-25
PCT/JP2017/019076 WO2017204171A2 (en) 2016-05-25 2017-05-22 Information processing apparatus, image generation method, control method, and program

Publications (2)

Publication Number Publication Date
CN109565580A CN109565580A (zh) 2019-04-02
CN109565580B true CN109565580B (zh) 2021-08-10

Family

ID=59009715

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201780032285.9A Active CN109565580B (zh) 2016-05-25 2017-05-22 信息处理设备、图像生成方法、控制方法和程序

Country Status (6)

Country Link
US (1) US11012674B2 (enExample)
EP (1) EP3466065A2 (enExample)
JP (1) JP6808357B2 (enExample)
KR (1) KR102129792B1 (enExample)
CN (1) CN109565580B (enExample)
WO (1) WO2017204171A2 (enExample)

Families Citing this family (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6482696B2 (ja) * 2017-06-23 2019-03-13 キヤノン株式会社 表示制御装置、表示制御方法、およびプログラム
EP3695593A4 (en) * 2017-10-13 2021-06-23 C360 Technologies, Inc. GENERATION OF PANORAMIC PROJECTIONS WITH MULTIPLE CAMERAS
JP6513169B1 (ja) * 2017-12-14 2019-05-15 キヤノン株式会社 仮想視点画像を生成するシステム、方法及びプログラム
WO2019116942A1 (ja) * 2017-12-14 2019-06-20 キヤノン株式会社 ３次元モデルの生成装置、生成方法、及びプログラム
JP7322235B2 (ja) * 2018-05-02 2023-08-07 キヤノン株式会社 画像処理装置、画像処理方法、およびプログラム
JP7062506B2 (ja) * 2018-05-02 2022-05-06 キヤノン株式会社 画像処理装置、画像処理方法、およびプログラム
JP7091133B2 (ja) * 2018-05-09 2022-06-27 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
JP6813933B2 (ja) * 2018-07-19 2021-01-13 日本電信電話株式会社 映像音声伝送システム、伝送方法、送信装置及び受信装置
JP7233867B2 (ja) * 2018-07-20 2023-03-07 キヤノン株式会社 情報処理装置、情報処理方法及びプログラム
JP7227717B2 (ja) * 2018-08-31 2023-02-22 キヤノン株式会社 情報処理装置、方法、及びプログラム
JP7245013B2 (ja) * 2018-09-06 2023-03-23 キヤノン株式会社 制御装置及び制御方法
JP7224872B2 (ja) * 2018-11-27 2023-02-20 キヤノン株式会社 システム及び情報処理方法
JP7250493B2 (ja) * 2018-12-03 2023-04-03 キヤノン株式会社 画像処理装置、三次元形状データの生成方法およびプログラム
JP2022051978A (ja) * 2019-02-15 2022-04-04 ソニーグループ株式会社 画像処理装置、画像処理方法、及び、プログラム
JP7258605B2 (ja) * 2019-03-05 2023-04-17 キヤノン株式会社 情報処理装置、情報処理方法及びプログラム
JP7095628B2 (ja) * 2019-03-07 2022-07-05 日本電信電話株式会社 座標系変換パラメータ推定装置、方法及びプログラム
EP3712843A1 (en) 2019-03-19 2020-09-23 Koninklijke Philips N.V. Image signal representing a scene
KR102658474B1 (ko) 2019-03-19 2024-04-17 한국전자통신연구원 가상 시점 합성을 위한 영상 부호화/복호화 방법 및 장치
JP7250588B2 (ja) * 2019-03-28 2023-04-03 キヤノン株式会社 画像処理装置、送信方法、及びプログラム
JP7423251B2 (ja) * 2019-10-25 2024-01-29 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
CN110798673B (zh) * 2019-11-13 2021-03-19 南京大学 基于深度卷积神经网络的自由视点视频生成及交互方法
JP7492331B2 (ja) * 2019-12-11 2024-05-29 キヤノン株式会社 画像処理装置、画像処理装置の制御方法及びプログラム
JP7508277B2 (ja) * 2020-06-03 2024-07-01 キヤノン株式会社 伝送処理装置、伝送処理方法、及びプログラム
CN114079706B (zh) * 2020-08-18 2024-06-14 京东方科技集团股份有限公司 一种信号处理装置、音视频显示装置和处理方法
CN116547582A (zh) 2020-09-25 2023-08-04 苹果公司 视频透传电子设备的结构化显示关机
JP7532314B2 (ja) 2021-06-01 2024-08-13 キヤノン株式会社 画像処理装置、画像処理方法及びプログラム
US12230164B2 (en) * 2021-07-12 2025-02-18 Milestone Systems A/S Computer implemented method and apparatus for training an operator of a video management system
US11943565B2 (en) * 2021-07-12 2024-03-26 Milestone Systems A/S Computer implemented method and apparatus for operating a video management system
JP7731632B2 (ja) * 2021-09-28 2025-09-01 キヤノン株式会社 情報処理装置、情報処理方法、プログラム、及び音響自動合成システム
JP2023168074A (ja) * 2022-05-13 2023-11-24 キヤノン株式会社 撮像装置、制御方法、及びプログラム
US12432330B2 (en) * 2022-09-19 2025-09-30 Apple Inc. Head-mounted electronic device with reliable passthrough video fallback capability
US20240193851A1 (en) * 2022-12-12 2024-06-13 Adobe Inc. Generation of a 360-degree object view by leveraging available images on an online platform
JP2025093728A (ja) 2023-12-12 2025-06-24 キヤノン株式会社 端末装置、制御方法、及びプログラム

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3478606B2 (ja) * 1994-10-12 2003-12-15 キヤノン株式会社 立体画像表示方法および装置
JP2001229402A (ja) * 2000-02-16 2001-08-24 Mitsubishi Electric Corp ３次元画像表示装置、３次元画像表示方法およびその方法をコンピュータに実行させるプログラムを記録したコンピュータ読み取り可能な記録媒体
JP2002095018A (ja) * 2000-09-12 2002-03-29 Canon Inc 画像表示制御装置及び画像表示システム、並びに画像データの表示方法
JP2004086508A (ja) 2002-08-26 2004-03-18 Alpine Electronics Inc ３次元形状データに基づく動画の表示制御方法及びナビゲーション装置
JP2005354289A (ja) * 2004-06-09 2005-12-22 Ntt Docomo Inc 端末装置、環境管理サーバ、カメラサーバ及び映像生成方法
JP5011168B2 (ja) * 2008-03-04 2012-08-29 日本電信電話株式会社 仮想視点画像生成方法、仮想視点画像生成装置、仮想視点画像生成プログラムおよびそのプログラムを記録したコンピュータ読み取り可能な記録媒体
JP5011224B2 (ja) 2008-07-09 2012-08-29 日本放送協会 任意視点映像生成装置及び任意視点映像生成プログラム
GB0907870D0 (en) 2009-05-07 2009-06-24 Univ Catholique Louvain Systems and methods for the autonomous production of videos from multi-sensored data
JP5812599B2 (ja) * 2010-02-25 2015-11-17 キヤノン株式会社 情報処理方法及びその装置
JP5725979B2 (ja) * 2011-06-03 2015-05-27 キヤノン株式会社 撮影装置およびその制御方法
CA2841192C (en) * 2011-07-15 2017-07-11 Lg Electronics Inc. Method and apparatus for processing a 3d service
US20140340427A1 (en) 2012-01-18 2014-11-20 Logos Technologies Llc Method, device, and system for computing a spherical projection image based on two-dimensional images
JP6349637B2 (ja) * 2013-07-11 2018-07-04 株式会社デンソー 車両用画像合成装置
EP3035282A4 (en) * 2013-09-11 2017-07-05 Sony Corporation Image processing device and method
WO2015054235A1 (en) * 2013-10-07 2015-04-16 Vid Scale, Inc. User adaptive 3d video rendering and delivery
JP6735592B2 (ja) * 2016-04-08 2020-08-05 キヤノン株式会社 画像処理装置及びその制御方法、画像処理システム

Also Published As

Publication number Publication date
US11012674B2 (en) 2021-05-18
US20200336719A1 (en) 2020-10-22
KR102129792B1 (ko) 2020-08-05
JP2017211827A (ja) 2017-11-30
WO2017204171A2 (en) 2017-11-30
EP3466065A2 (en) 2019-04-10
CN109565580A (zh) 2019-04-02
JP6808357B2 (ja) 2021-01-06
KR20190010650A (ko) 2019-01-30
WO2017204171A3 (en) 2018-01-18

Similar Documents

Publication Publication Date Title
CN109565580B (zh) 信息处理设备、图像生成方法、控制方法和程序
CN109565582B (zh) 控制装置及其控制方法和计算机可读存储介质
CN109275358B (zh) 根据用户所选择的视点从具有菊花链连接的照相机阵列生成虚拟图像的方法和设备
CN113938579B (zh) 信息处理设备及其控制方法和计算机可读存储介质
KR102121931B1 (ko) 제어 디바이스, 제어 방법 및 저장 매체
JP2019134428A (ja) 制御装置、制御方法、及び、プログラム
JP7297969B2 (ja) 情報処理装置、プログラム、生成方法、及び、システム

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant