JP5829371B2 - モーションキャプチャデータを使用する顔面アニメーション - Google Patents

モーションキャプチャデータを使用する顔面アニメーション Download PDF

Info

Publication number
JP5829371B2
JP5829371B2 JP2008232751A JP2008232751A JP5829371B2 JP 5829371 B2 JP5829371 B2 JP 5829371B2 JP 2008232751 A JP2008232751 A JP 2008232751A JP 2008232751 A JP2008232751 A JP 2008232751A JP 5829371 B2 JP5829371 B2 JP 5829371B2
Authority
JP
Japan
Prior art keywords
facial
motion capture
virtual
animation
states
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2008232751A
Other languages
English (en)
Japanese (ja)
Other versions
JP2009070380A5 (https=
JP2009070380A (ja
Inventor
エス． ハーディング リチャード
エス． ハーディング リチャード
エイ． メイベリー クリストファー
エイ． メイベリー クリストファー
Original Assignee
ソニー コンピュータ エンタテインメント アメリカ リミテッド ライアビリテイ カンパニー
ソニー コンピュータ エンタテインメント アメリカ リミテッド ライアビリテイ カンパニー
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ソニー コンピュータ エンタテインメント アメリカ リミテッド ライアビリテイ カンパニー, ソニー コンピュータ エンタテインメント アメリカ リミテッド ライアビリテイ カンパニー filed Critical ソニー コンピュータ エンタテインメント アメリカ リミテッド ライアビリテイ カンパニー
Publication of JP2009070380A publication Critical patent/JP2009070380A/ja
Publication of JP2009070380A5 publication Critical patent/JP2009070380A5/ja
Application granted granted Critical
Publication of JP5829371B2 publication Critical patent/JP5829371B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—Three-dimensional [3D] animation
    • G06T13/40—Three-dimensional [3D] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G06T7/251—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Processing Or Creating Images (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
JP2008232751A 2007-09-11 2008-09-11 モーションキャプチャデータを使用する顔面アニメーション Active JP5829371B2 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11/853,645 2007-09-11
US11/853,645 US8390628B2 (en) 2007-09-11 2007-09-11 Facial animation using motion capture data

Publications (3)

Publication Number Publication Date
JP2009070380A JP2009070380A (ja) 2009-04-02
JP2009070380A5 JP2009070380A5 (https=) 2011-10-27
JP5829371B2 true JP5829371B2 (ja) 2015-12-09

Family

ID=40303766

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2008232751A Active JP5829371B2 (ja) 2007-09-11 2008-09-11 モーションキャプチャデータを使用する顔面アニメーション

Country Status (3)

Country Link
US (1) US8390628B2 (https=)
EP (1) EP2043049B1 (https=)
JP (1) JP5829371B2 (https=)

Families Citing this family (110)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7830384B1 (en) * 2005-04-27 2010-11-09 Image Metrics Limited Animating graphical objects using input video
US8217922B2 (en) * 2008-01-07 2012-07-10 Harry Lee Wainwright Synchronized visual and audio apparatus and method
US8648863B1 (en) * 2008-05-20 2014-02-11 Pixar Methods and apparatus for performance style extraction for quality control of animation
US9129434B2 (en) * 2008-05-29 2015-09-08 Robert R. Taylor Method and system for 3D surface deformation fitting
US8988437B2 (en) 2009-03-20 2015-03-24 Microsoft Technology Licensing, Llc Chaining animations
US8442330B2 (en) 2009-03-31 2013-05-14 Nbcuniversal Media, Llc System and method for automatic landmark labeling with minimal supervision
US20100315424A1 (en) * 2009-06-15 2010-12-16 Tao Cai Computer graphic generation and display method and system
US8527217B2 (en) * 2009-09-08 2013-09-03 Dynamic Athletic Research Institute, Llc Apparatus and method for physical evaluation
US8698747B1 (en) 2009-10-12 2014-04-15 Mattel, Inc. Hand-activated controller
TWI439960B (zh) 2010-04-07 2014-06-01 蘋果公司 虛擬使用者編輯環境
US9196074B1 (en) * 2010-10-29 2015-11-24 Lucasfilm Entertainment Company Ltd. Refining facial animation models
US9165404B2 (en) * 2011-07-14 2015-10-20 Samsung Electronics Co., Ltd. Method, apparatus, and system for processing virtual world
KR101815986B1 (ko) * 2011-07-14 2018-01-09 삼성전자주식회사 가상 세계 처리 장치 및 방법
US10049482B2 (en) 2011-07-22 2018-08-14 Adobe Systems Incorporated Systems and methods for animation recommendations
US9123144B2 (en) * 2011-11-11 2015-09-01 Microsoft Technology Licensing, Llc Computing 3D shape parameters for face animation
US10748325B2 (en) 2011-11-17 2020-08-18 Adobe Inc. System and method for automatic rigging of three dimensional characters for facial animation
US10013787B2 (en) * 2011-12-12 2018-07-03 Faceshift Ag Method for facial animation
US10269165B1 (en) 2012-01-30 2019-04-23 Lucasfilm Entertainment Company Ltd. Facial animation models
US9747495B2 (en) 2012-03-06 2017-08-29 Adobe Systems Incorporated Systems and methods for creating and distributing modifiable animated video messages
WO2013152453A1 (en) 2012-04-09 2013-10-17 Intel Corporation Communication using interactive avatars
WO2014139118A1 (en) * 2013-03-14 2014-09-18 Intel Corporation Adaptive facial expression calibration
US9355487B2 (en) * 2013-03-15 2016-05-31 Crayola, Llc Coloring kit for capturing and animating two-dimensional colored creation
US9747716B1 (en) * 2013-03-15 2017-08-29 Lucasfilm Entertainment Company Ltd. Facial animation models
US9946448B2 (en) 2013-03-15 2018-04-17 Crayola Llc Coloring kit for capturing and animating two-dimensional colored creation
US10475226B2 (en) 2013-03-15 2019-11-12 Crayola Llc Coloring kit for capturing and animating two-dimensional colored creation
US9424811B2 (en) 2013-03-15 2016-08-23 Crayola Llc Digital collage creation kit
US9990754B1 (en) 2014-02-04 2018-06-05 Electronic Arts Inc. System for rendering using position based finite element simulation
WO2016030305A1 (en) * 2014-08-29 2016-03-03 Thomson Licensing Method and device for registering an image to a model
WO2016101131A1 (en) 2014-12-23 2016-06-30 Intel Corporation Augmented facial animation
US10388053B1 (en) 2015-03-27 2019-08-20 Electronic Arts Inc. System for seamless animation transition
US10022628B1 (en) 2015-03-31 2018-07-17 Electronic Arts Inc. System for feature-based motion adaptation
US10146877B1 (en) * 2015-08-17 2018-12-04 Amazon Technologies, Inc. Area of interest subscription
EP3341919A4 (en) * 2015-09-07 2019-04-03 Sony Interactive Entertainment America LLC PICTURE REGULATORY AND RETARGETING SYSTEM
US11893671B2 (en) * 2015-09-07 2024-02-06 Sony Interactive Entertainment LLC Image regularization and retargeting system
US10792566B1 (en) 2015-09-30 2020-10-06 Electronic Arts Inc. System for streaming content within a game application environment
WO2017101094A1 (en) * 2015-12-18 2017-06-22 Intel Corporation Avatar animation system
EP3232403B1 (en) * 2016-04-11 2024-05-29 Goodrich Corporation Fast multi-spectral image registration by modeling platform motion
US9912860B2 (en) 2016-06-12 2018-03-06 Apple Inc. User interface for camera effects
US10559111B2 (en) 2016-06-23 2020-02-11 LoomAi, Inc. Systems and methods for generating computer ready animation models of a human head from captured data images
EP3475920A4 (en) 2016-06-23 2020-01-15 Loomai, Inc. SYSTEMS AND METHODS FOR GENERATING COMPUTER-READY ANIMATION MODELS OF A HUMAN HEAD FROM IMAGES OF DETECTED DATA
US10403018B1 (en) 2016-07-12 2019-09-03 Electronic Arts Inc. Swarm crowd rendering system
US10726611B1 (en) 2016-08-24 2020-07-28 Electronic Arts Inc. Dynamic texture mapping using megatextures
CN110109592B (zh) 2016-09-23 2022-09-23 苹果公司 头像创建和编辑
US10395412B2 (en) * 2016-12-30 2019-08-27 Microsoft Technology Licensing, Llc Morphing chart animations in a browser
US10304225B2 (en) 2016-12-30 2019-05-28 Microsoft Technology Licensing, Llc Chart-type agnostic scene graph for defining a chart
US11086498B2 (en) 2016-12-30 2021-08-10 Microsoft Technology Licensing, Llc. Server-side chart layout for interactive web application charts
US10096133B1 (en) 2017-03-31 2018-10-09 Electronic Arts Inc. Blendshape compression system
DK180859B1 (en) 2017-06-04 2022-05-23 Apple Inc USER INTERFACE CAMERA EFFECTS
US10878540B1 (en) 2017-08-15 2020-12-29 Electronic Arts Inc. Contrast ratio detection and rendering system
US10535174B1 (en) 2017-09-14 2020-01-14 Electronic Arts Inc. Particle-based inverse kinematic rendering system
CN107945255A (zh) * 2017-11-24 2018-04-20 北京德火新媒体技术有限公司 一种虚拟人物表情驱动方法及系统
US10430642B2 (en) * 2017-12-07 2019-10-01 Apple Inc. Generating animated three-dimensional models from captured images
US10860838B1 (en) 2018-01-16 2020-12-08 Electronic Arts Inc. Universal facial expression translation and character rendering system
DK179874B1 (en) 2018-05-07 2019-08-13 Apple Inc. USER INTERFACE FOR AVATAR CREATION
US12033296B2 (en) 2018-05-07 2024-07-09 Apple Inc. Avatar creation user interface
US11722764B2 (en) * 2018-05-07 2023-08-08 Apple Inc. Creative camera
CN108805966A (zh) * 2018-05-28 2018-11-13 上海大学 基于多模态捕捉的快速动画成片方法和系统
US10198845B1 (en) 2018-05-29 2019-02-05 LoomAi, Inc. Methods and systems for animating facial expressions
CN110634174B (zh) * 2018-06-05 2023-10-10 深圳市优必选科技有限公司 一种表情动画过渡方法、系统及智能终端
DK201870623A1 (en) 2018-09-11 2020-04-15 Apple Inc. User interfaces for simulated depth effects
US11087520B2 (en) * 2018-09-19 2021-08-10 XRSpace CO., LTD. Avatar facial expression generating system and method of avatar facial expression generation for facial model
US11128792B2 (en) 2018-09-28 2021-09-21 Apple Inc. Capturing and displaying images with multiple focal planes
US11321857B2 (en) 2018-09-28 2022-05-03 Apple Inc. Displaying and editing images with depth information
US11107261B2 (en) 2019-01-18 2021-08-31 Apple Inc. Virtual avatar animation based on facial feature movement
US11706521B2 (en) 2019-05-06 2023-07-18 Apple Inc. User interfaces for capturing and managing visual media
US11770601B2 (en) 2019-05-06 2023-09-26 Apple Inc. User interfaces for capturing and managing visual media
US10902618B2 (en) 2019-06-14 2021-01-26 Electronic Arts Inc. Universal body movement translation and character rendering system
US11551393B2 (en) 2019-07-23 2023-01-10 LoomAi, Inc. Systems and methods for animation generation
US12138543B1 (en) 2020-01-21 2024-11-12 Electronic Arts Inc. Enhanced animation generation based on generative control
US11972353B2 (en) 2020-01-22 2024-04-30 Electronic Arts Inc. Character controllers using motion variational autoencoders (MVAEs)
US11504625B2 (en) 2020-02-14 2022-11-22 Electronic Arts Inc. Color blindness diagnostic system
US11232621B2 (en) 2020-04-06 2022-01-25 Electronic Arts Inc. Enhanced animation generation based on conditional modeling
US11648480B2 (en) 2020-04-06 2023-05-16 Electronic Arts Inc. Enhanced pose generation based on generative modeling
DK202070625A1 (en) 2020-05-11 2022-01-04 Apple Inc User interfaces related to time
US11921998B2 (en) 2020-05-11 2024-03-05 Apple Inc. Editing features of an avatar
US11054973B1 (en) 2020-06-01 2021-07-06 Apple Inc. User interfaces for managing media
US11670013B2 (en) 2020-06-26 2023-06-06 Jigar Patel Methods, systems, and computing platforms for photograph overlaying utilizing anatomic body mapping
JP7509492B2 (ja) * 2020-08-12 2024-07-02 ポーラ化成工業株式会社 出力方法、出力システム及び出力プログラム
US11212449B1 (en) 2020-09-25 2021-12-28 Apple Inc. User interfaces for media capture and management
US20220207828A1 (en) 2020-12-30 2022-06-30 Spree3D Corporation Systems and methods of three-dimensional modeling for use in generating a realistic computer avatar and garments
US12499601B2 (en) 2020-12-30 2025-12-16 Spreeai Corporation Generation and simultaneous display of multiple digitally garmented avatars
US12254561B2 (en) 2021-01-27 2025-03-18 Spreeai Corporation Producing a digital image representation of a body
US11663764B2 (en) 2021-01-27 2023-05-30 Spree3D Corporation Automatic creation of a photorealistic customized animated garmented avatar
US11830121B1 (en) 2021-01-26 2023-11-28 Electronic Arts Inc. Neural animation layering for synthesizing martial arts movements
US11494964B2 (en) * 2021-04-02 2022-11-08 Sony Interactive Entertainment LLC 2D/3D tracking and camera/animation plug-ins
US11778339B2 (en) 2021-04-30 2023-10-03 Apple Inc. User interfaces for altering visual media
US20240378833A1 (en) * 2021-05-26 2024-11-14 Sony Group Corporation Information processing apparatus, information processing method, and program
US12112024B2 (en) 2021-06-01 2024-10-08 Apple Inc. User interfaces for managing media styles
US11836905B2 (en) 2021-06-03 2023-12-05 Spree3D Corporation Image reenactment with illumination disentanglement
US11854579B2 (en) 2021-06-03 2023-12-26 Spree3D Corporation Video reenactment taking into account temporal information
US11769346B2 (en) * 2021-06-03 2023-09-26 Spree3D Corporation Video reenactment with hair shape and motion transfer
US11776190B2 (en) 2021-06-04 2023-10-03 Apple Inc. Techniques for managing an avatar on a lock screen
US12169889B2 (en) 2021-06-10 2024-12-17 Electronic Arts Inc. Enhanced system for generation of facial models and animation
US11887232B2 (en) 2021-06-10 2024-01-30 Electronic Arts Inc. Enhanced system for generation of facial models and animation
US12236510B2 (en) 2021-06-10 2025-02-25 Electronic Arts Inc. Enhanced system for generation of facial models and animation
CN113256684B (zh) * 2021-06-11 2021-10-01 腾讯科技（深圳）有限公司 动捕数据的修复方法、装置、设备及存储介质
US11670030B2 (en) 2021-07-01 2023-06-06 Electronic Arts Inc. Enhanced animation generation based on video with local phase
US11562523B1 (en) 2021-08-02 2023-01-24 Electronic Arts Inc. Enhanced animation generation based on motion matching using local bone phases
US20230143019A1 (en) * 2021-11-10 2023-05-11 Evr Studio Co., Ltd. Method of generating facial expression and three-dimensional (3d) graphic interface device using the same
US12374014B2 (en) 2021-12-07 2025-07-29 Electronic Arts Inc. Predicting facial expressions using character motion states
US12322015B2 (en) 2021-12-14 2025-06-03 Electronic Arts Inc. Dynamic locomotion adaptation in runtime generated environments
US12205214B2 (en) 2022-02-23 2025-01-21 Electronic Arts Inc. Joint twist generation for animation
US12403400B2 (en) 2022-03-31 2025-09-02 Electronic Arts Inc. Learning character motion alignment with periodic autoencoders
US12333861B2 (en) * 2022-08-26 2025-06-17 Htc Corporation Computing apparatus, method, and non-transitory computer readable storage medium thereof
US12287913B2 (en) 2022-09-06 2025-04-29 Apple Inc. Devices, methods, and graphical user interfaces for controlling avatars within three-dimensional environments
US12387409B2 (en) 2022-10-21 2025-08-12 Electronic Arts Inc. Automated system for generation of facial animation rigs
US12569761B2 (en) 2023-06-01 2026-03-10 Electronic Arts Inc. System for generating visual content within a game application environment
US12508508B2 (en) 2023-09-21 2025-12-30 Electronic Arts Inc. Motion-inferred player characteristics
US12456245B2 (en) 2023-09-29 2025-10-28 Electronic Arts Inc. Enhanced system for generation and optimization of facial models and animation
JP7720891B2 (ja) * 2023-10-13 2025-08-08 Ｍｈｉパワーエンジニアリング株式会社 大型構造物の図面データ重畳装置、大型構造物の図面データ重畳方法及び大型構造物の図面データ重畳プログラム

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3106491B2 (ja) * 1990-09-26 2000-11-06 ソニー株式会社 画像作成装置及び画像作成方法
CA2227361A1 (en) * 1998-01-19 1999-07-19 Taarna Studios Inc. Method and apparatus for providing real-time animation utilizing a database of expressions
US20020067362A1 (en) * 1998-11-06 2002-06-06 Agostino Nocera Luciano Pasquale Method and system generating an avatar animation transform using a neutral face image
US7068277B2 (en) * 2003-03-13 2006-06-27 Sony Corporation System and method for animating a digital facial model
JP2004363751A (ja) * 2003-06-03 2004-12-24 Pioneer Electronic Corp 画像情報再生装置の制御装置及び制御方法
TWI220234B (en) 2003-10-21 2004-08-11 Ind Tech Res Inst A method to simulate animated images for an object
JP4379616B2 (ja) * 2005-03-01 2009-12-09 株式会社国際電気通信基礎技術研究所 モーションキャプチャデータ補正装置、マルチモーダルコーパス作成システム、画像合成装置、及びコンピュータプログラム
CA2553546A1 (en) * 2005-07-29 2007-01-29 Avid Technology, Inc. Three-dimensional animation of soft tissue of characters using controls associated with a surface mesh

Also Published As

Publication number Publication date
US8390628B2 (en) 2013-03-05
EP2043049A3 (en) 2010-08-04
JP2009070380A (ja) 2009-04-02
EP2043049A2 (en) 2009-04-01
EP2043049B1 (en) 2020-03-18
US20090066700A1 (en) 2009-03-12

Similar Documents

Publication Publication Date Title
JP5829371B2 (ja) モーションキャプチャデータを使用する顔面アニメーション
Cao et al. Facewarehouse: A 3d facial expression database for visual computing
US9978175B2 (en) Real time concurrent design of shape, texture, and motion for 3D character animation
JP7251003B2 (ja) 細かいしわを有する顔メッシュ変形
EP1748391A2 (en) Three-dimensional animation of soft tissue of characters using controls associated with a surface mesh
US11158104B1 (en) Systems and methods for building a pseudo-muscle topology of a live actor in computer animation
CN114730480B (zh) 基于体积捕获和网格跟踪的机器学习
JP2023540434A (ja) 操作順序変形エンジンを用いたコンピュータアニメーションのためのシステム及び方法
US9892485B2 (en) System and method for mesh distance based geometry deformation
Miranda et al. Sketch express: A sketching interface for facial animation
JP4842242B2 (ja) キャラクタアニメーション時の皮膚のしわのリアルタイム表現方法及び装置
Orvalho et al. Transferring the rig and animations from a character to different face models
Song et al. A generic framework for efficient 2-D and 3-D facial expression analogy
WO2018104083A1 (en) Method and apparatus for sculpting a 3d model
US9317967B1 (en) Deformation of surface objects
CN115908664B (zh) 人机交互的动画生成方法、装置、计算机设备、存储介质
JPH08297751A (ja) 三次元モデルの作成方法および装置
KR20060067242A (ko) 해부 데이터를 이용한 얼굴 애니메이션 생성 시스템 및 그방법
US11348286B1 (en) Method for controlling digital feather generations through a user interface in a computer modeling system
Zhang et al. Synthesis of 3D faces using region‐based morphing under intuitive control
HK40098086A (zh) 虚拟角色形象模型的生成方法、装置和计算机设备
WO2023022607A1 (en) Systems and methods for computer animation of an artificial character using facial poses from a live actor
de Aguiar et al. A simple framework for natural animation of digitized models

Legal Events

Date Code Title Description
RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20100714

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20100818

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20110901

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20110901

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20110902

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20120911

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20120918

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20121218

A602 Written permission of extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A602

Effective date: 20121221

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20130118

A602 Written permission of extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A602

Effective date: 20130123

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20130218

A602 Written permission of extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A602

Effective date: 20130221

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20130314

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20130507

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20130807

A602 Written permission of extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A602

Effective date: 20130812

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20130909

A602 Written permission of extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A602

Effective date: 20130912

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20131112

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20150812

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20151022

R150 Certificate of patent or registration of utility model

Ref document number: 5829371

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250