JP2020087428A5 - Video compositing device, video compositing method, video compositing program, and recording medium - Google Patents

Video compositing device, video compositing method, video compositing program, and recording medium Download PDF

Info

Publication number
JP2020087428A5
JP2020087428A5 JP2019131762A JP2019131762A JP2020087428A5 JP 2020087428 A5 JP2020087428 A5 JP 2020087428A5 JP 2019131762 A JP2019131762 A JP 2019131762A JP 2019131762 A JP2019131762 A JP 2019131762A JP 2020087428 A5 JP2020087428 A5 JP 2020087428A5
Authority
JP
Japan
Prior art keywords
avatar
video
live
operator
action
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2019131762A
Other languages
Japanese (ja)
Other versions
JP7241628B2 (en
JP2020087428A (en
Filing date
Publication date
Application filed filed Critical
Priority to JP2019131762A priority Critical patent/JP7241628B2/en
Priority claimed from JP2019131762A external-priority patent/JP7241628B2/en
Publication of JP2020087428A publication Critical patent/JP2020087428A/en
Publication of JP2020087428A5 publication Critical patent/JP2020087428A5/en
Application granted granted Critical
Publication of JP7241628B2 publication Critical patent/JP7241628B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Description

本発明に係る動画合成装置は、実写動画にアバターを合成した拡張現実動画を生成する動画合成装置であって、拡張現実動画の背景となる実写動画およびアバターを操作する操作者の画像を取得する動画取得部と、前記操作者の画像に基づいてアバターを制御する制御部と、前記操作者の操作に基づいて、前記実写動画の実空間に対応した座標系における任意の初期位置に当該アバターを配置する配置部と、前記実写動画に前記アバターを合成した拡張現実動画を生成する合成部と、を有することを特徴とする。 The moving image synthesizer according to the present invention is a moving image synthesizer that generates an augmented reality moving image in which an avatar is synthesized with a live-action moving image, and acquires a live-action moving image as a background of the extended reality moving image and an image of an operator who operates the avatar. The video acquisition unit, the control unit that controls the avatar based on the image of the operator, and the avatar at an arbitrary initial position in the coordinate system corresponding to the real space of the live-action video based on the operation of the operator. It is characterized by having an arrangement unit for arranging and a composition unit for generating an augmented reality moving image in which the avatar is synthesized with the live-action moving image.

本発明に係る動画合成方法は、実写動画にアバターを合成した拡張現実動画を生成する動画合成方法であって、コンピュータによる、拡張現実動画の背景となる実写動画およびアバターを操作する操作者の画像を取得するステップと、前記操作者の画像に基づいてアバターを制御するステップと、前記操作者の操作に基づいて、前記実写動画の実空間に対応した座標系における任意の初期位置に当該アバターを配置するステップと、前記実写動画に前記アバターを合成した拡張現実動画を生成するステップと、を有することを特徴とする。 The moving image composition method according to the present invention is a moving image composition method for generating an augmented reality moving image in which an avatar is synthesized with a live-action moving image, and is an image of an operator who operates a live-action moving image and an avatar which is a background of the extended reality moving image by a computer. The avatar is placed at an arbitrary initial position in the coordinate system corresponding to the real space of the live-action video based on the step of acquiring the avatar, the step of controlling the avatar based on the image of the operator, and the operation of the operator. It is characterized by having a step of arranging and a step of generating an augmented reality moving image in which the avatar is synthesized with the live-action moving image.

本発明に係る動画合成プログラムは、実写動画にアバターを合成した拡張現実動画を生成する動画合成プログラムであって、拡張現実動画の背景となる実写動画およびアバターを操作する操作者の画像を取得する処理と、前記操作者の画像に基づいてアバターを制御する処理と、前記操作者の操作に基づいて、前記実写動画の実空間に対応した座標系における任意の初期位置に当該アバターを配置する処理と、前記実写動画に前記アバターを合成した拡張現実動画を生成する処理と、をコンピュータに実行させることを特徴とする。 The moving image synthesis program according to the present invention is a moving image synthesis program that generates an augmented reality movie in which an avatar is synthesized with a live-action movie, and acquires a live-action movie that is the background of the augmented reality movie and an image of an operator who operates the avatar. Processing, processing to control the avatar based on the image of the operator, and processing to place the avatar at an arbitrary initial position in the coordinate system corresponding to the real space of the live-action moving image based on the operation of the operator. It is characterized in that a computer is made to execute a process of generating an augmented reality moving image in which the avatar is synthesized with the live-action moving image.

Claims (8)

実写動画にアバターを合成した拡張現実動画を生成する動画合成装置であって、
拡張現実動画の背景となる実写動画およびアバターを操作する操作者の画像を取得する動画取得部と、
前記操作者の画像に基づいてアバターを制御する制御部と、
前記操作者の操作に基づいて、前記実写動画の実空間に対応した座標系における任意の初期位置に当該アバターを配置する配置部と、
前記実写動画に前記アバターを合成した拡張現実動画を生成する合成部と、
を有することを特徴とする動画合成装置。
It is a video synthesizer that generates an augmented reality video that synthesizes an avatar with a live-action video.
A video acquisition unit that acquires images of the operator who operates the live-action video and avatar that is the background of the augmented reality video,
A control unit that controls the avatar based on the image of the operator,
An arrangement unit that arranges the avatar at an arbitrary initial position in the coordinate system corresponding to the real space of the live-action moving image based on the operation of the operator.
A compositing unit that generates an augmented reality video that synthesizes the avatar with the live-action video,
A moving image synthesizer characterized by having.
前記実写動画の撮影場所の3次元空間情報を取得し、平坦部分を前記アバターを配置可能な領域として検出する空間測定部を有し
前記配置部は、前記アバターを配置可能な領域を前記操作者に提示し、前記操作者の操作を受け付ける
ことを特徴とする請求項1に記載の動画合成装置。
It has a space measurement unit that acquires three-dimensional spatial information of the shooting location of the live-action moving image and detects the flat portion as an area where the avatar can be placed.
The moving image synthesizer according to claim 1, wherein the arranging unit presents an area in which the avatar can be arranged to the operator and accepts the operation of the operator.
前記空間測定部は、前記実写動画から検出された特徴点の動きから撮影場所の3次元空間情報を取得するThe spatial measurement unit acquires three-dimensional spatial information of the shooting location from the movement of feature points detected from the live-action moving image.
ことを特徴とする請求項2に記載の動画合成装置。The moving image synthesizer according to claim 2.
前記制御部は、前記操作者の動きに応じて前記アバターを移動させるThe control unit moves the avatar according to the movement of the operator.
ことを特徴とする請求項1ないし3のいずれかに記載の動画合成装置。The moving image synthesizer according to any one of claims 1 to 3.
前記制御部は、前記アバターの向きを前記操作者の進んだ方向にするとともに、前記操作者の移動に合わせて前記アバターの位置を移動させるThe control unit makes the direction of the avatar the direction in which the operator has advanced, and moves the position of the avatar in accordance with the movement of the operator.
ことを特徴とする請求項4に記載の動画合成装置。The moving image synthesizer according to claim 4.
実写動画にアバターを合成した拡張現実動画を生成する動画合成方法であって、
コンピュータによる、
拡張現実動画の背景となる実写動画およびアバターを操作する操作者の画像を取得するステップと、
前記操作者の画像に基づいてアバターを制御するステップと、
前記操作者の操作に基づいて、前記実写動画の実空間に対応した座標系における任意の初期位置に当該アバターを配置するステップと、
前記実写動画に前記アバターを合成した拡張現実動画を生成するステップと、
を有することを特徴とする動画合成方法。
It is a video composition method that generates an augmented reality video by synthesizing an avatar with a live-action video.
By computer
Steps to acquire the live-action video that is the background of the augmented reality video and the image of the operator who operates the avatar,
The step of controlling the avatar based on the image of the operator,
A step of arranging the avatar at an arbitrary initial position in the coordinate system corresponding to the real space of the live-action moving image based on the operation of the operator, and
A step of generating an augmented reality video by synthesizing the avatar with the live-action video,
A video compositing method characterized by having.
実写動画にアバターを合成した拡張現実動画を生成する動画合成プログラムであって、
拡張現実動画の背景となる実写動画およびアバターを操作する操作者の画像を取得する処理と、
前記操作者の画像に基づいてアバターを制御する処理と、
前記操作者の操作に基づいて、前記実写動画の実空間に対応した座標系における任意の初期位置に当該アバターを配置する処理と、
前記実写動画に前記アバターを合成した拡張現実動画を生成する処理と、
をコンピュータに実行させることを特徴とする動画合成プログラム。
It is a video synthesis program that generates an augmented reality video that synthesizes an avatar with a live-action video.
The process of acquiring the live-action video that is the background of the augmented reality video and the image of the operator who operates the avatar,
The process of controlling the avatar based on the image of the operator,
A process of arranging the avatar at an arbitrary initial position in the coordinate system corresponding to the real space of the live-action moving image based on the operation of the operator.
The process of generating an augmented reality video by synthesizing the avatar with the live-action video,
A video synthesis program characterized by having a computer execute.
実写動画にアバターを合成した拡張現実動画を生成する動画合成プログラムを格納した記録媒体であって、It is a recording medium that stores a video synthesis program that generates an augmented reality video that synthesizes an avatar with a live-action video.
拡張現実動画の背景となる実写動画およびアバターを操作する操作者の画像を取得する処理と、The process of acquiring the live-action video that is the background of the augmented reality video and the image of the operator who operates the avatar,
前記操作者の画像に基づいてアバターを制御する処理と、The process of controlling the avatar based on the image of the operator,
前記操作者の操作に基づいて、前記実写動画の実空間に対応した座標系における任意の初期位置に当該アバターを配置する処理と、A process of arranging the avatar at an arbitrary initial position in the coordinate system corresponding to the real space of the live-action moving image based on the operation of the operator.
前記実写動画に前記アバターを合成した拡張現実動画を生成する処理と、The process of generating an augmented reality video by synthesizing the avatar with the live-action video,
をコンピュータに実行させる動画合成プログラムを格納した記録媒体。A recording medium containing a video synthesis program that causes a computer to execute.
JP2019131762A 2019-07-17 2019-07-17 MOVIE SYNTHESIS DEVICE, MOVIE SYNTHESIS METHOD, AND MOVIE SYNTHESIS PROGRAM Active JP7241628B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2019131762A JP7241628B2 (en) 2019-07-17 2019-07-17 MOVIE SYNTHESIS DEVICE, MOVIE SYNTHESIS METHOD, AND MOVIE SYNTHESIS PROGRAM

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2019131762A JP7241628B2 (en) 2019-07-17 2019-07-17 MOVIE SYNTHESIS DEVICE, MOVIE SYNTHESIS METHOD, AND MOVIE SYNTHESIS PROGRAM

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
JP2018225022A Division JP6559870B1 (en) 2018-11-30 2018-11-30 Movie synthesis apparatus, movie synthesis method, and movie synthesis program

Publications (3)

Publication Number Publication Date
JP2020087428A JP2020087428A (en) 2020-06-04
JP2020087428A5 true JP2020087428A5 (en) 2022-01-06
JP7241628B2 JP7241628B2 (en) 2023-03-17

Family

ID=70908466

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2019131762A Active JP7241628B2 (en) 2019-07-17 2019-07-17 MOVIE SYNTHESIS DEVICE, MOVIE SYNTHESIS METHOD, AND MOVIE SYNTHESIS PROGRAM

Country Status (1)

Country Link
JP (1) JP7241628B2 (en)

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4709598B2 (en) * 2005-07-11 2011-06-22 公立大学法人岡山県立大学 Call terminal with avatar display function
FR2958487A1 (en) * 2010-04-06 2011-10-07 Alcatel Lucent A METHOD OF REAL TIME DISTORTION OF A REAL ENTITY RECORDED IN A VIDEO SEQUENCE
CN101958976A (en) * 2010-09-29 2011-01-26 华为终端有限公司 Image processing method and wireless terminal equipment
CN103116451B (en) * 2013-01-25 2018-10-26 腾讯科技(深圳)有限公司 A kind of virtual character interactive of intelligent terminal, device and system
DE102013203667B4 (en) * 2013-03-04 2024-02-22 Adidas Ag Cabin for trying out one or more items of clothing
JP6367450B1 (en) * 2017-10-31 2018-08-01 株式会社テクテック Position game interface system, program, and control method

Similar Documents

Publication Publication Date Title
US20230045393A1 (en) Volumetric depth video recording and playback
JP2018180655A5 (en)
KR101248736B1 (en) Augmented reality book station based augmented reality system and method, augmented reality processing apparatus for realizing the same
US20140016913A1 (en) Moving image generation device
JP2013207637A5 (en)
JP2020086983A5 (en)
JP2012022647A5 (en)
JP2020119095A (en) Control device, control method and program
WO2017187196A1 (en) Augmented media
JP2013149219A5 (en)
JP5044582B2 (en) Photography camera learning device and program thereof
JP2019049824A5 (en)
JP2014225772A5 (en)
JP2020087428A5 (en) Video compositing device, video compositing method, video compositing program, and recording medium
TW201928761A (en) Apparatus and method of image capture
JP2015126389A5 (en)
JP2006294066A5 (en)
JP2008021210A (en) Method, device and program for generating free-viewpoint image using multi-viewpoint image
JP2020035176A5 (en)
JP2017143340A5 (en)
JP2020096267A (en) Video synthesizer and program
JP2020071718A5 (en)
JP2020202503A5 (en)
JP2019028652A5 (en)
WO2018173183A1 (en) Optical device control apparatus, optical device control method, and optical device control program