JP7080212B2 - コンピュータプログラム、サーバ装置及び方法 - Google Patents

コンピュータプログラム、サーバ装置及び方法 Download PDF

Info

Publication number
JP7080212B2
JP7080212B2 JP2019239318A JP2019239318A JP7080212B2 JP 7080212 B2 JP7080212 B2 JP 7080212B2 JP 2019239318 A JP2019239318 A JP 2019239318A JP 2019239318 A JP2019239318 A JP 2019239318A JP 7080212 B2 JP7080212 B2 JP 7080212B2
Authority
JP
Japan
Prior art keywords
specific
facial expression
action
expression
performer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2019239318A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021108030A (ja
Inventor
匡志 渡邊
寿 川村
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GREE Holdings Inc
Original Assignee
GREE Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by GREE Inc filed Critical GREE Inc
Priority to JP2019239318A priority Critical patent/JP7080212B2/ja
Priority to US17/077,135 priority patent/US20210201002A1/en
Publication of JP2021108030A publication Critical patent/JP2021108030A/ja
Priority to JP2022084302A priority patent/JP7408068B2/ja
Application granted granted Critical
Publication of JP7080212B2 publication Critical patent/JP7080212B2/ja
Priority to JP2023214338A priority patent/JP7726544B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—3D [Three Dimensional] animation
    • G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/254—Analysis of motion involving subtraction of images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • G06V40/176—Dynamic expression
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/193—Preprocessing; Feature extraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/23—Recognition of whole body movements, e.g. for sport training
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Ophthalmology & Optometry (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
JP2019239318A 2019-12-27 2019-12-27 コンピュータプログラム、サーバ装置及び方法 Active JP7080212B2 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2019239318A JP7080212B2 (ja) 2019-12-27 2019-12-27 コンピュータプログラム、サーバ装置及び方法
US17/077,135 US20210201002A1 (en) 2019-12-27 2020-10-22 Moving image distribution computer program, server device, and method
JP2022084302A JP7408068B2 (ja) 2019-12-27 2022-05-24 コンピュータプログラム、サーバ装置及び方法
JP2023214338A JP7726544B2 (ja) 2019-12-27 2023-12-20 コンピュータプログラム、サーバ装置及び方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2019239318A JP7080212B2 (ja) 2019-12-27 2019-12-27 コンピュータプログラム、サーバ装置及び方法

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2022084302A Division JP7408068B2 (ja) 2019-12-27 2022-05-24 コンピュータプログラム、サーバ装置及び方法

Publications (2)

Publication Number Publication Date
JP2021108030A JP2021108030A (ja) 2021-07-29
JP7080212B2 true JP7080212B2 (ja) 2022-06-03

Family

ID=76546270

Family Applications (3)

Application Number Title Priority Date Filing Date
JP2019239318A Active JP7080212B2 (ja) 2019-12-27 2019-12-27 コンピュータプログラム、サーバ装置及び方法
JP2022084302A Active JP7408068B2 (ja) 2019-12-27 2022-05-24 コンピュータプログラム、サーバ装置及び方法
JP2023214338A Active JP7726544B2 (ja) 2019-12-27 2023-12-20 コンピュータプログラム、サーバ装置及び方法

Family Applications After (2)

Application Number Title Priority Date Filing Date
JP2022084302A Active JP7408068B2 (ja) 2019-12-27 2022-05-24 コンピュータプログラム、サーバ装置及び方法
JP2023214338A Active JP7726544B2 (ja) 2019-12-27 2023-12-20 コンピュータプログラム、サーバ装置及び方法

Country Status (2)

Country Link
US (1) US20210201002A1 (enExample)
JP (3) JP7080212B2 (enExample)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018203555A1 (ja) * 2017-05-02 2018-11-08 日本電信電話株式会社 信号検索装置、方法、及びプログラム
US10984575B2 (en) 2019-02-06 2021-04-20 Snap Inc. Body pose estimation
US11660022B2 (en) 2020-10-27 2023-05-30 Snap Inc. Adaptive skeletal joint smoothing
US11615592B2 (en) 2020-10-27 2023-03-28 Snap Inc. Side-by-side character animation from realtime 3D body motion capture
US11748931B2 (en) 2020-11-18 2023-09-05 Snap Inc. Body animation sharing and remixing
US11734894B2 (en) 2020-11-18 2023-08-22 Snap Inc. Real-time motion transfer for prosthetic limbs
US11450051B2 (en) 2020-11-18 2022-09-20 Snap Inc. Personalized avatar real-time motion capture
JPWO2024085084A1 (enExample) * 2022-10-21 2024-04-25

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002315966A (ja) 2001-04-20 2002-10-29 Square Co Ltd ビデオゲーム装置およびその制御方法、ならびにビデオゲームのプログラムおよびそのプログラムを記録したコンピュータ読取り可能な記録媒体。
JP2005323340A (ja) 2004-04-07 2005-11-17 Matsushita Electric Ind Co Ltd 通信端末及び通信方法
JP2006202188A (ja) 2005-01-24 2006-08-03 Oki Electric Ind Co Ltd 画像合成装置およびそのパターン確認方法
JP2010081562A (ja) 2008-09-29 2010-04-08 Fujifilm Corp 撮像装置、方法およびプログラム
JP2012100063A (ja) 2010-11-02 2012-05-24 Canon Inc 撮像装置
JP2013020365A (ja) 2011-07-08 2013-01-31 Namco Bandai Games Inc ゲームシステム、プログラム、及び情報記憶媒体

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3771989B2 (ja) * 1997-03-24 2006-05-10 オリンパス株式会社 画像音声通信システムおよびテレビ電話送受信方法
JP4799104B2 (ja) 2005-09-26 2011-10-26 キヤノン株式会社 情報処理装置及びその制御方法、コンピュータプログラム、記憶媒体
JP4799105B2 (ja) 2005-09-26 2011-10-26 キヤノン株式会社 情報処理装置及びその制御方法、コンピュータプログラム、記憶媒体
JP4757173B2 (ja) 2006-11-17 2011-08-24 キヤノン株式会社 撮像装置及びその制御方法及びプログラム
JP2008299430A (ja) 2007-05-29 2008-12-11 Canon Inc 画像処理装置、画像処理方法、及び画像処理プログラム
JP4986175B2 (ja) 2007-12-28 2012-07-25 カシオ計算機株式会社 撮像装置及びプログラム
JP5109779B2 (ja) 2008-04-22 2012-12-26 株式会社ニコン 撮影装置
JP5106355B2 (ja) 2008-11-13 2012-12-26 キヤノン株式会社 表情判定装置、その制御方法、撮像装置及びプログラム
JP2012181704A (ja) 2011-03-01 2012-09-20 Sony Computer Entertainment Inc 情報処理装置および情報処理方法
JP2013009073A (ja) 2011-06-23 2013-01-10 Sony Corp 情報処理装置、情報処理方法、プログラム、及びサーバ
US9350951B1 (en) * 2011-11-22 2016-05-24 Scott Dallas Rowe Method for interactive training and analysis
US10860838B1 (en) * 2018-01-16 2020-12-08 Electronic Arts Inc. Universal facial expression translation and character rendering system
WO2019209431A1 (en) * 2018-04-23 2019-10-31 Magic Leap, Inc. Avatar facial expression representation in multidimensional space

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002315966A (ja) 2001-04-20 2002-10-29 Square Co Ltd ビデオゲーム装置およびその制御方法、ならびにビデオゲームのプログラムおよびそのプログラムを記録したコンピュータ読取り可能な記録媒体。
JP2005323340A (ja) 2004-04-07 2005-11-17 Matsushita Electric Ind Co Ltd 通信端末及び通信方法
JP2006202188A (ja) 2005-01-24 2006-08-03 Oki Electric Ind Co Ltd 画像合成装置およびそのパターン確認方法
JP2010081562A (ja) 2008-09-29 2010-04-08 Fujifilm Corp 撮像装置、方法およびプログラム
JP2012100063A (ja) 2010-11-02 2012-05-24 Canon Inc 撮像装置
JP2013020365A (ja) 2011-07-08 2013-01-31 Namco Bandai Games Inc ゲームシステム、プログラム、及び情報記憶媒体

Also Published As

Publication number Publication date
US20210201002A1 (en) 2021-07-01
JP7726544B2 (ja) 2025-08-20
JP2022111142A (ja) 2022-07-29
JP2021108030A (ja) 2021-07-29
JP2024029036A (ja) 2024-03-05
JP7408068B2 (ja) 2024-01-05

Similar Documents

Publication Publication Date Title
JP7080212B2 (ja) コンピュータプログラム、サーバ装置及び方法
JP7389855B2 (ja) 配信ユーザの動きに基づいて生成されるキャラクタオブジェクトのアニメーションを含む動画をライブ配信する動画配信システム、動画配信方法及び動画配信プログラム
US12444316B2 (en) Individual viewing in a shared space
JP5859456B2 (ja) プレゼンテーション用カメラ・ナビゲーション
US11288854B2 (en) Information processing apparatus and information processing method
CN119923616A (zh) 用于操纵虚拟对象的方法
JP2020519986A (ja) ウェアラブルシステムのためのマルチモード実行およびテキスト編集
JP2024040211A (ja) 動画処理方法、サーバ装置及びコンピュータプログラム
JP2023067892A (ja) 情報処理プログラム、情報処理方法、情報処理装置
JP6751193B1 (ja) 動画処理方法、サーバ装置及びコンピュータプログラム
JP6691631B1 (ja) 動画処理方法、サーバ装置及びコンピュータプログラム
JP7398655B2 (ja) コンピュータプログラム、サーバ装置、端末装置、及び方法
JP7611610B2 (ja) 動画処理方法、サーバ装置及びコンピュータプログラム
JP2021174283A (ja) コンピュータプログラム、サーバ装置、端末装置、及び方法
JP7418709B2 (ja) コンピュータプログラム、方法及びサーバ装置
JP6942834B2 (ja) 動画処理方法、サーバ装置及びコンピュータプログラム
WO2020235346A1 (ja) コンピュータプログラム、サーバ装置、端末装置、システム及び方法
CN118787926A (zh) 用于三维环境中的跟踪缓解的设备、方法和图形用户界面

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20191227

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20210114

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210216

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210415

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20211005

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20211202

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20220426

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20220524

R150 Certificate of patent or registration of utility model

Ref document number: 7080212

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

S533 Written request for registration of change of name

Free format text: JAPANESE INTERMEDIATE CODE: R313533

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250