JP6808357B2 - 情報処理装置、制御方法、及び、プログラム - Google Patents

情報処理装置、制御方法、及び、プログラム Download PDF

Info

Publication number
JP6808357B2
JP6808357B2 JP2016104431A JP2016104431A JP6808357B2 JP 6808357 B2 JP6808357 B2 JP 6808357B2 JP 2016104431 A JP2016104431 A JP 2016104431A JP 2016104431 A JP2016104431 A JP 2016104431A JP 6808357 B2 JP6808357 B2 JP 6808357B2
Authority
JP
Japan
Prior art keywords
image
camera
data
virtual viewpoint
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2016104431A
Other languages
English (en)
Japanese (ja)
Other versions
JP2017211827A (ja
JP2017211827A5 (enExample
Inventor
圭輔 森澤
圭輔 森澤
半田　雅大
雅大 半田
相澤　道雄
道雄 相澤
祥吾 水野
祥吾 水野
田中　克昌
克昌 田中
松下　明弘
明弘 松下
智裕 矢埜
智裕 矢埜
麻衣 小宮山
麻衣 小宮山
藤井　賢一
賢一 藤井
伊達　厚
厚 伊達
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to JP2016104431A priority Critical patent/JP6808357B2/ja
Application filed by Canon Inc filed Critical Canon Inc
Priority to PCT/JP2017/019076 priority patent/WO2017204171A2/en
Priority to KR1020187037466A priority patent/KR102129792B1/ko
Priority to US16/303,461 priority patent/US11012674B2/en
Priority to EP17727964.3A priority patent/EP3466065A2/en
Priority to CN201780032285.9A priority patent/CN109565580B/zh
Publication of JP2017211827A publication Critical patent/JP2017211827A/ja
Publication of JP2017211827A5 publication Critical patent/JP2017211827A5/ja
Application granted granted Critical
Publication of JP6808357B2 publication Critical patent/JP6808357B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • G01B11/245—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures using a plurality of fixed, simultaneously operating transducers
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/243—Image signal generators using stereoscopic image cameras using three or more two-dimensional [2D] image sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4347—Demultiplexing of several video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/633—Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
    • H04N23/634—Warning indications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682—Vibration or motion blur correction
    • H04N23/683—Vibration or motion blur correction performed by a processor, e.g. controlling the readout of an image memory
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Geometry (AREA)
  • Computing Systems (AREA)
  • Computer Graphics (AREA)
  • Databases & Information Systems (AREA)
  • Studio Devices (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Processing Or Creating Images (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Image Generation (AREA)
  • Image Analysis (AREA)
JP2016104431A 2016-05-25 2016-05-25 情報処理装置、制御方法、及び、プログラム Active JP6808357B2 (ja)

Priority Applications (6)

Application Number Priority Date Filing Date Title
JP2016104431A JP6808357B2 (ja) 2016-05-25 2016-05-25 情報処理装置、制御方法、及び、プログラム
KR1020187037466A KR102129792B1 (ko) 2016-05-25 2017-05-22 정보 처리 장치, 화상 생성 방법, 제어 방법 및 프로그램
US16/303,461 US11012674B2 (en) 2016-05-25 2017-05-22 Information processing apparatus, image generation method, control method, and program
EP17727964.3A EP3466065A2 (en) 2016-05-25 2017-05-22 Information processing apparatus, image generation method, control method, and program
PCT/JP2017/019076 WO2017204171A2 (en) 2016-05-25 2017-05-22 Information processing apparatus, image generation method, control method, and program
CN201780032285.9A CN109565580B (zh) 2016-05-25 2017-05-22 信息处理设备、图像生成方法、控制方法和程序

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2016104431A JP6808357B2 (ja) 2016-05-25 2016-05-25 情報処理装置、制御方法、及び、プログラム

Publications (3)

Publication Number Publication Date
JP2017211827A JP2017211827A (ja) 2017-11-30
JP2017211827A5 JP2017211827A5 (enExample) 2019-06-27
JP6808357B2 true JP6808357B2 (ja) 2021-01-06

Family

ID=59009715

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2016104431A Active JP6808357B2 (ja) 2016-05-25 2016-05-25 情報処理装置、制御方法、及び、プログラム

Country Status (6)

Country Link
US (1) US11012674B2 (enExample)
EP (1) EP3466065A2 (enExample)
JP (1) JP6808357B2 (enExample)
KR (1) KR102129792B1 (enExample)
CN (1) CN109565580B (enExample)
WO (1) WO2017204171A2 (enExample)

Families Citing this family (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6482696B2 (ja) * 2017-06-23 2019-03-13 キヤノン株式会社 表示制御装置、表示制御方法、およびプログラム
EP3695593A4 (en) * 2017-10-13 2021-06-23 C360 Technologies, Inc. GENERATION OF PANORAMIC PROJECTIONS WITH MULTIPLE CAMERAS
AU2018384159B2 (en) * 2017-12-14 2021-02-11 Canon Kabushiki Kaisha Generation device, generation method and program for three-dimensional model
JP6513169B1 (ja) * 2017-12-14 2019-05-15 キヤノン株式会社 仮想視点画像を生成するシステム、方法及びプログラム
JP7062506B2 (ja) * 2018-05-02 2022-05-06 キヤノン株式会社 画像処理装置、画像処理方法、およびプログラム
JP7322235B2 (ja) * 2018-05-02 2023-08-07 キヤノン株式会社 画像処理装置、画像処理方法、およびプログラム
JP7091133B2 (ja) * 2018-05-09 2022-06-27 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
JP6813933B2 (ja) * 2018-07-19 2021-01-13 日本電信電話株式会社 映像音声伝送システム、伝送方法、送信装置及び受信装置
JP7233867B2 (ja) * 2018-07-20 2023-03-07 キヤノン株式会社 情報処理装置、情報処理方法及びプログラム
JP7227717B2 (ja) * 2018-08-31 2023-02-22 キヤノン株式会社 情報処理装置、方法、及びプログラム
JP7245013B2 (ja) * 2018-09-06 2023-03-23 キヤノン株式会社 制御装置及び制御方法
JP7224872B2 (ja) * 2018-11-27 2023-02-20 キヤノン株式会社 システム及び情報処理方法
JP7250493B2 (ja) * 2018-12-03 2023-04-03 キヤノン株式会社 画像処理装置、三次元形状データの生成方法およびプログラム
JP2022051978A (ja) * 2019-02-15 2022-04-04 ソニーグループ株式会社 画像処理装置、画像処理方法、及び、プログラム
JP7258605B2 (ja) * 2019-03-05 2023-04-17 キヤノン株式会社 情報処理装置、情報処理方法及びプログラム
JP7095628B2 (ja) * 2019-03-07 2022-07-05 日本電信電話株式会社 座標系変換パラメータ推定装置、方法及びプログラム
EP3712843A1 (en) 2019-03-19 2020-09-23 Koninklijke Philips N.V. Image signal representing a scene
US11064218B2 (en) 2019-03-19 2021-07-13 Electronics And Telecommunications Research Institute Method and apparatus for encoding/decoding image for virtual view synthesis
JP7250588B2 (ja) * 2019-03-28 2023-04-03 キヤノン株式会社 画像処理装置、送信方法、及びプログラム
JP7423251B2 (ja) * 2019-10-25 2024-01-29 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
CN110798673B (zh) * 2019-11-13 2021-03-19 南京大学 基于深度卷积神经网络的自由视点视频生成及交互方法
JP7492331B2 (ja) * 2019-12-11 2024-05-29 キヤノン株式会社 画像処理装置、画像処理装置の制御方法及びプログラム
JP7508277B2 (ja) * 2020-06-03 2024-07-01 キヤノン株式会社 伝送処理装置、伝送処理方法、及びプログラム
CN114079706B (zh) * 2020-08-18 2024-06-14 京东方科技集团股份有限公司 一种信号处理装置、音视频显示装置和处理方法
WO2022067001A1 (en) 2020-09-25 2022-03-31 Sterling Labs Llc Structured display shutdown for video pass-through electronic devices
WO2022070688A1 (ja) * 2020-09-29 2022-04-07 富士フイルム株式会社 撮像装置、撮像装置の駆動方法、及びプログラム
JP2022126208A (ja) * 2021-02-18 2022-08-30 キヤノン株式会社 情報処理装置、情報処理方法、及び、プログラム
WO2022209362A1 (ja) * 2021-03-31 2022-10-06 富士フイルム株式会社 画像処理装置、画像処理方法、及びプログラム
JP7532314B2 (ja) 2021-06-01 2024-08-13 キヤノン株式会社 画像処理装置、画像処理方法及びプログラム
US11943565B2 (en) * 2021-07-12 2024-03-26 Milestone Systems A/S Computer implemented method and apparatus for operating a video management system
US12230164B2 (en) * 2021-07-12 2025-02-18 Milestone Systems A/S Computer implemented method and apparatus for training an operator of a video management system
JP7731632B2 (ja) * 2021-09-28 2025-09-01 キヤノン株式会社 情報処理装置、情報処理方法、プログラム、及び音響自動合成システム
JP2023168074A (ja) * 2022-05-13 2023-11-24 キヤノン株式会社 撮像装置、制御方法、及びプログラム
US12432330B2 (en) * 2022-09-19 2025-09-30 Apple Inc. Head-mounted electronic device with reliable passthrough video fallback capability
US12608879B2 (en) * 2022-12-12 2026-04-21 Adobe Inc. Generation of a 360-degree object view by leveraging available images on an online platform
US12593023B2 (en) 2023-03-21 2026-03-31 Apple Inc. Electronic device with reliable passthrough video fallback capability and hierarchical failure detection scheme
JP2025093728A (ja) 2023-12-12 2025-06-24 キヤノン株式会社 端末装置、制御方法、及びプログラム
KR102983609B1 (ko) * 2024-10-18 2026-06-30 대한민국(방위사업청장) 객체 점유 맵을 활용한 영상 스티칭 장치 및 방법

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3478606B2 (ja) * 1994-10-12 2003-12-15 キヤノン株式会社 立体画像表示方法および装置
JP2001229402A (ja) * 2000-02-16 2001-08-24 Mitsubishi Electric Corp ３次元画像表示装置、３次元画像表示方法およびその方法をコンピュータに実行させるプログラムを記録したコンピュータ読み取り可能な記録媒体
JP2002095018A (ja) * 2000-09-12 2002-03-29 Canon Inc 画像表示制御装置及び画像表示システム、並びに画像データの表示方法
JP2004086508A (ja) 2002-08-26 2004-03-18 Alpine Electronics Inc ３次元形状データに基づく動画の表示制御方法及びナビゲーション装置
JP2005354289A (ja) * 2004-06-09 2005-12-22 Ntt Docomo Inc 端末装置、環境管理サーバ、カメラサーバ及び映像生成方法
JP5011168B2 (ja) * 2008-03-04 2012-08-29 日本電信電話株式会社 仮想視点画像生成方法、仮想視点画像生成装置、仮想視点画像生成プログラムおよびそのプログラムを記録したコンピュータ読み取り可能な記録媒体
JP5011224B2 (ja) * 2008-07-09 2012-08-29 日本放送協会 任意視点映像生成装置及び任意視点映像生成プログラム
GB0907870D0 (en) * 2009-05-07 2009-06-24 Univ Catholique Louvain Systems and methods for the autonomous production of videos from multi-sensored data
JP5812599B2 (ja) * 2010-02-25 2015-11-17 キヤノン株式会社 情報処理方法及びその装置
JP5725979B2 (ja) 2011-06-03 2015-05-27 キヤノン株式会社 撮影装置およびその制御方法
EP2733945A4 (en) 2011-07-15 2014-12-17 Lg Electronics Inc METHOD AND APPARATUS FOR PROCESSING A 3D SERVICE
GB2512242A (en) * 2012-01-18 2014-09-24 Logos Technologies Llc Method, device, and system for computing a spherical projection image based on two-dimensional images
JP6349637B2 (ja) 2013-07-11 2018-07-04 株式会社デンソー 車両用画像合成装置
US10440352B2 (en) * 2013-09-11 2019-10-08 Sony Corporation Image processing apparatus and method
EP3055763A1 (en) * 2013-10-07 2016-08-17 VID SCALE, Inc. User adaptive 3d video rendering and delivery
JP6735592B2 (ja) * 2016-04-08 2020-08-05 キヤノン株式会社 画像処理装置及びその制御方法、画像処理システム

Also Published As

Publication number Publication date
EP3466065A2 (en) 2019-04-10
US11012674B2 (en) 2021-05-18
WO2017204171A3 (en) 2018-01-18
KR102129792B1 (ko) 2020-08-05
CN109565580A (zh) 2019-04-02
WO2017204171A2 (en) 2017-11-30
CN109565580B (zh) 2021-08-10
JP2017211827A (ja) 2017-11-30
US20200336719A1 (en) 2020-10-22
KR20190010650A (ko) 2019-01-30

Similar Documents

Publication Publication Date Title
JP6833348B2 (ja) 情報処理装置、画像処理システム、情報処理装置の制御方法、仮想視点画像の生成方法、及び、プログラム
JP6429829B2 (ja) 画像処理システム、画像処理装置、制御方法、及び、プログラム
JP6482498B2 (ja) 制御装置、制御方法、及び、プログラム
JP6672075B2 (ja) 制御装置、制御方法、及び、プログラム
KR102129792B1 (ko) 정보 처리 장치, 화상 생성 방법, 제어 방법 및 프로그램
JP6878014B2 (ja) 画像処理装置及びその方法、プログラム、画像処理システム
JP6827996B2 (ja) 画像処理装置、制御方法、及び、プログラム
JP6790145B2 (ja) 制御装置、制御方法、及び、プログラム
JP6632703B2 (ja) 制御装置、制御方法、及び、プログラム
JP7297969B2 (ja) 情報処理装置、プログラム、生成方法、及び、システム
JP7204789B2 (ja) 制御装置、制御方法、及び、プログラム

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20160630

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20190520

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20190520

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20200825

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20201014

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20201110

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20201209

R151 Written notification of patent or utility model registration

Ref document number: 6808357

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151