CA3025478C - Control device, control method, and storage medium - Google Patents

Control device, control method, and storage medium Download PDF

Info

Publication number
CA3025478C
CA3025478C CA3025478A CA3025478A CA3025478C CA 3025478 C CA3025478 C CA 3025478C CA 3025478 A CA3025478 A CA 3025478A CA 3025478 A CA3025478 A CA 3025478A CA 3025478 C CA3025478 C CA 3025478C
Authority
CA
Canada
Prior art keywords
image
camera
data
virtual viewpoint
virtual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CA3025478A
Other languages
English (en)
French (fr)
Other versions
CA3025478A1 (en
Inventor
Michio Aizawa
Masahiro Handa
Shogo Mizuno
Katsumasa Tanaka
Akihiro Matsushita
Keisuke Morisawa
Tomohiro Yano
Mai Komiyama
Kenichi Fujii
Atsushi Date
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Publication of CA3025478A1 publication Critical patent/CA3025478A1/en
Application granted granted Critical
Publication of CA3025478C publication Critical patent/CA3025478C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/4401—Bootstrapping
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H04N19/463—Embedding additional information in the video signal during the compression process by compressing encoding parameters before transmission
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4347—Demultiplexing of several video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Software Systems (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • Studio Devices (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Image Generation (AREA)
  • Processing Or Creating Images (AREA)
  • Image Analysis (AREA)
CA3025478A 2016-05-25 2017-05-22 Control device, control method, and storage medium Active CA3025478C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2016-104433 2016-05-25
JP2016104433A JP6482498B2 (ja) 2016-05-25 2016-05-25 制御装置、制御方法、及び、プログラム
PCT/JP2017/019081 WO2017204173A1 (en) 2016-05-25 2017-05-22 Control device, control method, and storage medium

Publications (2)

Publication Number Publication Date
CA3025478A1 CA3025478A1 (en) 2017-11-30
CA3025478C true CA3025478C (en) 2020-04-21

Family

ID=59009716

Family Applications (1)

Application Number Title Priority Date Filing Date
CA3025478A Active CA3025478C (en) 2016-05-25 2017-05-22 Control device, control method, and storage medium

Country Status (9)

Country Link
US (1) US20200322584A1 (enExample)
EP (1) EP3466066A1 (enExample)
JP (1) JP6482498B2 (enExample)
KR (1) KR102121931B1 (enExample)
CN (1) CN109644265A (enExample)
AU (1) AU2017270401B2 (enExample)
CA (1) CA3025478C (enExample)
RU (1) RU2704608C1 (enExample)
WO (1) WO2017204173A1 (enExample)

Families Citing this family (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7051457B2 (ja) * 2018-01-17 2022-04-11 キヤノン株式会社 画像処理装置、画像処理方法、及びプログラム
JP2019125303A (ja) 2018-01-19 2019-07-25 キヤノン株式会社 情報処理装置、情報処理方法、およびプログラム
US10902676B2 (en) 2018-03-13 2021-01-26 Canon Kabushiki Kaisha System and method of controlling a virtual camera
JP7075252B2 (ja) 2018-03-23 2022-05-25 キヤノン株式会社 情報処理装置およびその制御方法、プログラム
FR3080968A1 (fr) 2018-05-03 2019-11-08 Orange Procede et dispositif de decodage d'une video multi-vue, et procede et dispositif de traitement d'images.
JP7170441B2 (ja) * 2018-07-12 2022-11-14 キヤノン株式会社 情報処理装置、情報処理方法及びプログラム
JP7254464B2 (ja) * 2018-08-28 2023-04-10 キヤノン株式会社 情報処理装置、情報処理装置の制御方法、及びプログラム
JP7245013B2 (ja) * 2018-09-06 2023-03-23 キヤノン株式会社 制御装置及び制御方法
JP7313811B2 (ja) 2018-10-26 2023-07-25 キヤノン株式会社 画像処理装置、画像処理方法、及びプログラム
JP6790145B2 (ja) * 2019-02-13 2020-11-25 キヤノン株式会社 制御装置、制御方法、及び、プログラム
JP7341674B2 (ja) 2019-02-27 2023-09-11 キヤノン株式会社 情報処理装置、情報処理方法及びプログラム
US12148211B2 (en) * 2019-04-12 2024-11-19 Sony Group Corporation Image processing apparatus and 3D model generation method
JP7408298B2 (ja) 2019-06-03 2024-01-05 キヤノン株式会社 画像処理装置、画像処理方法、及びプログラム
JP7401199B2 (ja) 2019-06-13 2023-12-19 キヤノン株式会社 情報処理装置、情報処理方法、およびプログラム
JP7418101B2 (ja) 2019-07-26 2024-01-19 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
JP7423251B2 (ja) 2019-10-25 2024-01-29 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
CN114097248B (zh) * 2019-12-30 2023-03-28 华为技术有限公司 一种视频流处理方法、装置、设备及介质
JP7367198B2 (ja) 2020-04-30 2023-10-23 富士フイルム株式会社 情報処理装置、情報処理方法、及びプログラム
JP7571151B2 (ja) * 2020-09-30 2024-10-22 富士フイルム株式会社 情報処理装置、情報処理方法、及びプログラム
JP7634958B2 (ja) * 2020-10-20 2025-02-25 キヤノン株式会社 生成装置、生成方法、及び、プログラム
CN114870395B (zh) 2021-02-05 2023-09-15 腾讯科技（深圳）有限公司 游戏场景的终端振动检测方法、装置、介质及设备
WO2022209362A1 (ja) 2021-03-31 2022-10-06 富士フイルム株式会社 画像処理装置、画像処理方法、及びプログラム
JP7676209B2 (ja) 2021-04-27 2025-05-14 キヤノン株式会社 情報処理装置、情報処理方法、及び、プログラム
CN113259698B (zh) * 2021-05-12 2022-11-15 北京字节跳动网络技术有限公司 更换画面中的背景的方法、设备、存储介质及程序产品
US11943565B2 (en) * 2021-07-12 2024-03-26 Milestone Systems A/S Computer implemented method and apparatus for operating a video management system
JP7795931B2 (ja) 2022-01-31 2026-01-08 キヤノン株式会社 情報処理装置、情報処理方法、データ構造及びプログラム
US11855831B1 (en) 2022-06-10 2023-12-26 T-Mobile Usa, Inc. Enabling an operator to resolve an issue associated with a 5G wireless telecommunication network using AR glasses
US11886767B2 (en) 2022-06-17 2024-01-30 T-Mobile Usa, Inc. Enable interaction between a user and an agent of a 5G wireless telecommunication network using augmented reality glasses
JPWO2024029497A1 (enExample) * 2022-08-04 2024-02-08

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6768563B1 (en) * 1995-02-24 2004-07-27 Canon Kabushiki Kaisha Image input system
US6985178B1 (en) * 1998-09-30 2006-01-10 Canon Kabushiki Kaisha Camera control system, image pick-up server, client, control method and storage medium therefor
US7085409B2 (en) * 2000-10-18 2006-08-01 Sarnoff Corporation Method and apparatus for synthesizing new video and/or still imagery from a collection of real video and/or still imagery
WO2006068049A1 (ja) * 2004-12-21 2006-06-29 Matsushita Electric Industrial Co., Ltd. カメラ端末および撮影領域調整装置
JP4671873B2 (ja) * 2006-01-23 2011-04-20 シャープ株式会社 合成映像生成システム
FR2901049B1 (fr) * 2006-05-12 2008-11-21 Techviz Soc Par Actions Simpli Procede de codage et systeme d'affichage sur un ecran d'une maquette numerique d'un objet sous forme d'une image de synthese
JP2010250452A (ja) * 2009-04-14 2010-11-04 Tokyo Univ Of Science 任意視点画像合成装置
JP2011151773A (ja) * 2009-12-21 2011-08-04 Canon Inc 映像処理装置及び制御方法
JP5558862B2 (ja) * 2010-02-22 2014-07-23 キヤノン株式会社 映像処理装置及びその制御方法
JP2012120031A (ja) * 2010-12-02 2012-06-21 Canon Inc 映像処理装置及びその制御方法
WO2013025149A1 (en) * 2011-08-15 2013-02-21 Telefonaktiebolaget L M Ericsson (Publ) Encoder, method in an encoder, decoder and method in a decoder for providing information concerning a spatial validity range
US10158838B2 (en) * 2012-07-10 2018-12-18 Telefonaktiebolaget Lm Ericsson (Publ) Methods and arrangements for supporting view synthesis
JP6548203B2 (ja) * 2013-03-18 2019-07-24 任天堂株式会社 情報処理プログラム、情報処理装置、情報処理システム、および、パノラマ動画表示方法
JP2015204512A (ja) * 2014-04-14 2015-11-16 パナソニックＩｐマネジメント株式会社 情報処理装置、情報処理方法、カメラ、受信装置、受信方法
WO2015159487A1 (ja) * 2014-04-14 2015-10-22 パナソニックＩｐマネジメント株式会社 映像配信方法、映像受信方法、サーバ、端末装置及び映像配信システム
JP2015212876A (ja) * 2014-05-02 2015-11-26 キヤノン株式会社 映像再生システム

Also Published As

Publication number Publication date
RU2704608C1 (ru) 2019-10-30
KR20190010646A (ko) 2019-01-30
US20200322584A1 (en) 2020-10-08
CN109644265A (zh) 2019-04-16
AU2017270401B2 (en) 2019-07-18
JP6482498B2 (ja) 2019-03-13
AU2017270401A1 (en) 2019-01-17
EP3466066A1 (en) 2019-04-10
KR102121931B1 (ko) 2020-06-11
CA3025478A1 (en) 2017-11-30
JP2017212592A (ja) 2017-11-30
WO2017204173A1 (en) 2017-11-30

Similar Documents

Publication Publication Date Title
AU2020201759B2 (en) Method and apparatus for generating a virtual image from a viewpoint selected by the user, from a camera array with transmission of foreground and background images at different frame rates
US20250184465A1 (en) Method for generating virtual viewpoint image and image processing apparatus
CA3025471C (en) Method and apparatus for generating a virtual image from a viewpoint selected by the user, from a camera array with default parameters associated to the selected type of sport event
AU2017270401B2 (en) Control device, control method, and storage medium
US11012674B2 (en) Information processing apparatus, image generation method, control method, and program

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20181123

MPN Maintenance fee for patent paid

Free format text: FEE DESCRIPTION TEXT: MF (PATENT, 8TH ANNIV.) - STANDARD

Year of fee payment: 8

U00 Fee paid

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U00-U101 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE REQUEST RECEIVED

Effective date: 20250425

U11 Full renewal or maintenance fee paid

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT PAID IN FULL

Effective date: 20250425

MPN Maintenance fee for patent paid

Free format text: FEE DESCRIPTION TEXT: MF (PATENT, 9TH ANNIV.) - STANDARD

Year of fee payment: 9

U00 Fee paid

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U00-U101 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE REQUEST RECEIVED

Effective date: 20260423

U11 Full renewal or maintenance fee paid

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT PAID IN FULL

Effective date: 20260423