JP6246757B2 - 現実環境の視野におけるバーチャルオブジェクトを表現方法及びシステム - Google Patents

現実環境の視野におけるバーチャルオブジェクトを表現方法及びシステム Download PDF

Info

Publication number
JP6246757B2
JP6246757B2 JP2015062627A JP2015062627A JP6246757B2 JP 6246757 B2 JP6246757 B2 JP 6246757B2 JP 2015062627 A JP2015062627 A JP 2015062627A JP 2015062627 A JP2015062627 A JP 2015062627A JP 6246757 B2 JP6246757 B2 JP 6246757B2
Authority
JP
Japan
Prior art keywords
face
image
camera
light
light source
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2015062627A
Other languages
English (en)
Japanese (ja)
Other versions
JP2015185176A5 (enExample
JP2015185176A (ja
Inventor
クノール セバスチャン
クノール セバスチャン
マイヤー ペーター
マイヤー ペーター
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Metaio GmbH
Original Assignee
Metaio GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Metaio GmbH filed Critical Metaio GmbH
Publication of JP2015185176A publication Critical patent/JP2015185176A/ja
Publication of JP2015185176A5 publication Critical patent/JP2015185176A5/ja
Application granted granted Critical
Publication of JP6246757B2 publication Critical patent/JP6246757B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/50—Lighting effects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Processing Or Creating Images (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
  • Image Generation (AREA)
JP2015062627A 2014-03-25 2015-03-25 現実環境の視野におけるバーチャルオブジェクトを表現方法及びシステム Active JP6246757B2 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
PCT/EP2014/055938 WO2015144209A1 (en) 2014-03-25 2014-03-25 Method and system for representing a virtual object in a view of a real environment
WOPCT/EP2014/055938 2014-03-25

Publications (3)

Publication Number Publication Date
JP2015185176A JP2015185176A (ja) 2015-10-22
JP2015185176A5 JP2015185176A5 (enExample) 2016-11-24
JP6246757B2 true JP6246757B2 (ja) 2017-12-13

Family

ID=50389424

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2015062627A Active JP6246757B2 (ja) 2014-03-25 2015-03-25 現実環境の視野におけるバーチャルオブジェクトを表現方法及びシステム

Country Status (5)

Country Link
US (5) US10417824B2 (enExample)
EP (1) EP3123449B1 (enExample)
JP (1) JP6246757B2 (enExample)
CN (3) CN106133796B (enExample)
WO (1) WO2015144209A1 (enExample)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11176699B2 (en) 2019-05-24 2021-11-16 Tencent America LLC Augmenting reliable training data with CycleGAN for hand pose estimation
TWI799000B (zh) * 2021-04-16 2023-04-11 財團法人工業技術研究院 資訊顯示方法及其處理裝置與顯示系統

Families Citing this family (226)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI439960B (zh) 2010-04-07 2014-06-01 Apple Inc 虛擬使用者編輯環境
US9531961B2 (en) 2015-05-01 2016-12-27 Duelight Llc Systems and methods for generating a digital image using separate color and intensity data
US9918017B2 (en) 2012-09-04 2018-03-13 Duelight Llc Image sensor apparatus and method for obtaining multiple exposures with zero interframe time
US9819849B1 (en) 2016-07-01 2017-11-14 Duelight Llc Systems and methods for capturing digital images
US9807322B2 (en) 2013-03-15 2017-10-31 Duelight Llc Systems and methods for a digital image sensor
US10558848B2 (en) * 2017-10-05 2020-02-11 Duelight Llc System, method, and computer program for capturing an image with correct skin tone exposure
GB2516883B (en) * 2013-08-02 2017-01-18 Anthropics Tech Ltd Image manipulation
KR102166334B1 (ko) * 2014-02-19 2020-10-15 삼성전자주식회사 영상 데이터 처리 방법 및 디바이스
WO2015144209A1 (en) * 2014-03-25 2015-10-01 Metaio Gmbh Method and system for representing a virtual object in a view of a real environment
WO2015151748A1 (ja) * 2014-03-31 2015-10-08 富士フイルム株式会社 画像処理装置、撮像装置、画像処理方法及びプログラム
CN110363840A (zh) 2014-05-13 2019-10-22 河谷控股Ip有限责任公司 通过反照率模型、系统和方法的增强现实内容渲染
KR20160024168A (ko) * 2014-08-25 2016-03-04 삼성전자주식회사 전자 장치의 디스플레이 제어 방법 및 전자 장치
CN106715180B (zh) * 2014-09-26 2018-03-13 三菱电机株式会社 绘制控制装置
US10924688B2 (en) 2014-11-06 2021-02-16 Duelight Llc Image sensor apparatus and method for obtaining low-noise, high-speed captures of a photographic scene
US11463630B2 (en) 2014-11-07 2022-10-04 Duelight Llc Systems and methods for generating a high-dynamic range (HDR) pixel stream
US12401911B2 (en) 2014-11-07 2025-08-26 Duelight Llc Systems and methods for generating a high-dynamic range (HDR) pixel stream
US12401912B2 (en) 2014-11-17 2025-08-26 Duelight Llc System and method for generating a digital image
US10531071B2 (en) * 2015-01-21 2020-01-07 Nextvr Inc. Methods and apparatus for environmental measurements and/or stereoscopic image capture
US10013796B2 (en) * 2015-01-22 2018-07-03 Ditto Technologies, Inc. Rendering glasses shadows
US9858719B2 (en) * 2015-03-30 2018-01-02 Amazon Technologies, Inc. Blended reality systems and methods
US10354441B2 (en) * 2016-05-20 2019-07-16 ETAK Systems, LLC Augmented reality systems and methods for telecommunications site modeling
US12445736B2 (en) 2015-05-01 2025-10-14 Duelight Llc Systems and methods for generating a digital image
US10354449B2 (en) 2015-06-12 2019-07-16 Hand Held Products, Inc. Augmented reality lighting effects
US20170024603A1 (en) * 2015-07-22 2017-01-26 Anthony Ray Misslin Biometric image optimization using light fields
DE102015213832B4 (de) * 2015-07-22 2023-07-13 Adidas Ag Verfahren und Vorrichtung zum Erzeugen eines künstlichen Bildes
CN106558103A (zh) * 2015-09-24 2017-04-05 鸿富锦精密工业（深圳）有限公司 扩增实境图像处理系统及扩增实境图像处理方法
US10614614B2 (en) 2015-09-29 2020-04-07 Adshir Ltd. Path tracing system employing distributed accelerating structures
EP3179407B1 (en) * 2015-12-07 2022-07-13 Dassault Systèmes Recognition of a 3d modeled object from a 2d image
US10565776B2 (en) 2015-12-12 2020-02-18 Adshir Ltd. Method for fast generation of path traced reflections on a semi-reflective surface
CN108139801B (zh) * 2015-12-22 2021-03-16 谷歌有限责任公司 用于经由保留光场渲染来执行电子显示稳定的系统和方法
US20170186170A1 (en) * 2015-12-24 2017-06-29 Thomas A. Nugraha Facial contour recognition for identification
US10614612B2 (en) 2018-06-09 2020-04-07 Adshir Ltd. Fast path traced reflections for augmented reality
US12008704B2 (en) 2016-01-28 2024-06-11 Snap Inc. System for photo-realistic reflections in augmented reality
AU2017232527A1 (en) * 2016-03-15 2018-09-20 Magic Leap, Inc. Direct light compensation technique for augmented reality system
EP3223245B1 (en) * 2016-03-24 2024-04-24 Ecole Nationale de l'Aviation Civile Point of view selection in virtual 3d environment
US10134198B2 (en) * 2016-04-19 2018-11-20 Adobe Systems Incorporated Image compensation for an occluding direct-view augmented reality system
US10277844B2 (en) * 2016-04-20 2019-04-30 Intel Corporation Processing images based on generated motion data
US9589348B1 (en) * 2016-05-31 2017-03-07 Oculus Vr, Llc Camera calibration system
US10430988B2 (en) * 2016-06-03 2019-10-01 Facebook Technologies, Llc Facial animation using facial sensors within a head-mounted display
US10009536B2 (en) 2016-06-12 2018-06-26 Apple Inc. Applying a simulated optical effect based on data received from multiple camera sensors
US10134174B2 (en) 2016-06-13 2018-11-20 Microsoft Technology Licensing, Llc Texture mapping with render-baked animation
US10163254B2 (en) * 2016-06-24 2018-12-25 Adobe Systems Incorporated Rendering of digital images on a substrate
EP3270589A1 (en) * 2016-07-11 2018-01-17 Thomson Licensing An apparatus and a method for generating data representative of a pixel beam
CN109564701A (zh) * 2016-07-18 2019-04-02 巴塞尔大学 用于改善数字图像中光泽表示的计算机系统和方法
US10534809B2 (en) 2016-08-10 2020-01-14 Zeekit Online Shopping Ltd. Method, system, and device of virtual dressing utilizing image processing, machine learning, and computer vision
US10290136B2 (en) * 2016-08-10 2019-05-14 Zeekit Online Shopping Ltd Processing user selectable product images and facilitating visualization-assisted coordinated product transactions
WO2018039269A1 (en) * 2016-08-22 2018-03-01 Magic Leap, Inc. Augmented reality display device with deep learning sensors
CN114449163A (zh) 2016-09-01 2022-05-06 迪尤莱特公司 基于焦点目标信息调整焦点的装置和方法
CN106445282B (zh) * 2016-09-08 2019-04-30 掌阅科技股份有限公司 一种基于增强现实技术的交互方法
CN117193618A (zh) 2016-09-23 2023-12-08 苹果公司 头像创建和编辑
US10445938B1 (en) * 2016-11-09 2019-10-15 Snap Inc. Modifying multiple objects within a video stream
EP3545497B1 (en) * 2016-11-22 2021-04-21 Lego A/S System for acquiring a 3d digital representation of a physical object
EP3545675A4 (en) 2016-11-24 2020-07-01 The University of Washington CAPTURE AND RESTITUTION OF LIGHT FIELD FOR HEADSETS
US10529137B1 (en) * 2016-11-29 2020-01-07 MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. Machine learning systems and methods for augmenting images
JP7113013B2 (ja) * 2016-12-14 2022-08-04 コーニンクレッカ フィリップス エヌ ヴェ 被験者の頭部の追跡
WO2018112795A1 (en) * 2016-12-21 2018-06-28 Intel Corporation Large scale cnn regression based localization via two-dimensional map
WO2018113952A1 (en) * 2016-12-21 2018-06-28 Telefonaktiebolaget Lm Ericsson (Publ) A method and arrangement for handling haptic feedback
US10789693B2 (en) * 2017-01-05 2020-09-29 Perfect Corp. System and method for performing pre-processing for blending images
CN108346178A (zh) 2017-01-23 2018-07-31 微软技术许可有限责任公司 混合现实对象呈现
EP3583827B1 (en) * 2017-02-16 2020-07-15 Signify Holding B.V. A controller for indicating a presence of a virtual object via a lighting device and a method thereof
JP6558388B2 (ja) * 2017-03-14 2019-08-14 オムロン株式会社 画像処理装置
CN107170036B (zh) * 2017-03-22 2019-10-18 西北大学 一种层状结构人脸模型的真实感渲染方法
CN106842540B (zh) * 2017-03-24 2018-12-25 南京理工大学 基于光强传输方程的环形光照明高分辨率定量相位显微成像方法
CN108876852B (zh) * 2017-05-09 2021-06-22 中国科学院沈阳自动化研究所 一种基于3d视觉的在线实时物体识别定位方法
EP3401899B1 (en) * 2017-05-11 2021-09-08 ams International AG Method for controlling a display parameter of a mobile device and computer program product
FR3067151B1 (fr) * 2017-05-30 2019-07-26 Fittingbox Procede d'essayage virtuel realiste d'une paire de lunettes par un individu
ES2945138T3 (es) * 2017-06-01 2023-06-28 Signify Holding Bv Sistema de representación de caracteres virtuales y método del mismo
DK180859B1 (en) 2017-06-04 2022-05-23 Apple Inc USER INTERFACE CAMERA EFFECTS
US10398370B2 (en) * 2017-06-30 2019-09-03 Apple Inc. Wearable electronic device including wrist biometric sensor for acquiring skin texture pattern images and related methods
CN110892280B (zh) * 2017-07-19 2023-11-28 昕诺飞控股有限公司 用于向设备提供物体的空间信息的系统和方法
KR101972331B1 (ko) * 2017-08-29 2019-04-25 키튼플래닛 주식회사 영상 얼라인먼트 방법 및 그 장치
US10755383B2 (en) * 2017-09-29 2020-08-25 Apple Inc. Multi-space rendering with configurable transformation parameters
US10922878B2 (en) * 2017-10-04 2021-02-16 Google Llc Lighting for inserted content
GB2569267A (en) * 2017-10-13 2019-06-19 Mo Sys Engineering Ltd Lighting integration
CN107860315A (zh) * 2017-11-17 2018-03-30 浙江大学城市学院 一种结构光全向光场视觉系统组合结构
US10235797B1 (en) * 2017-11-27 2019-03-19 Lowe's Companies, Inc. Inverse rendering of visual material properties
CN109872379B (zh) * 2017-12-05 2022-12-02 富士通株式会社 数据处理装置和方法
CN108154552A (zh) * 2017-12-26 2018-06-12 中国科学院深圳先进技术研究院 一种立体腹腔镜三维模型重建方法和装置
US10755088B2 (en) * 2018-01-11 2020-08-25 Adobe Inc. Augmented reality predictions using machine learning
US10225360B1 (en) 2018-01-24 2019-03-05 Veeva Systems Inc. System and method for distributing AR content
EP3629337A1 (en) * 2018-09-28 2020-04-01 Ivoclar Vivadent AG Rendering of dental models
US11083552B2 (en) * 2018-02-20 2021-08-10 Ivoclar Vivadent Ag Rendering of dental models
US10507360B2 (en) * 2018-02-21 2019-12-17 William Schroeder Posture correction and weight balance apparatus
KR102450948B1 (ko) * 2018-02-23 2022-10-05 삼성전자주식회사 전자 장치 및 그의 증강 현실 객체 제공 방법
EP3534338B1 (en) * 2018-03-01 2023-09-06 État Français Représenté par la Direction des Services de la Navigation Aérienne Creation of a simulation scene from a specified view point
US11276228B2 (en) * 2018-03-22 2022-03-15 3Shape A/S 3D scanning with automatic selection of scan strategy
CN108460362B (zh) * 2018-03-23 2021-11-30 成都品果科技有限公司 一种检测人体部位的系统及方法
US10380803B1 (en) * 2018-03-26 2019-08-13 Verizon Patent And Licensing Inc. Methods and systems for virtualizing a target object within a mixed reality presentation
CN108510525B (zh) 2018-03-30 2019-03-12 百度在线网络技术（北京）有限公司 模板追踪方法、装置、增强现实系统及存储介质
US10949956B2 (en) * 2018-04-06 2021-03-16 Google Llc Enhanced specular reflections for inserted content
US10529117B2 (en) * 2018-04-16 2020-01-07 Facebook Technologies, Llc Systems and methods for rendering optical distortion effects
CN108537881B (zh) * 2018-04-18 2020-04-03 腾讯科技（深圳）有限公司 一种人脸模型处理方法及其设备、存储介质
CN108805970A (zh) * 2018-05-03 2018-11-13 百度在线网络技术（北京）有限公司 光照估计方法及装置
DK179874B1 (en) 2018-05-07 2019-08-13 Apple Inc. USER INTERFACE FOR AVATAR CREATION
US11722764B2 (en) 2018-05-07 2023-08-08 Apple Inc. Creative camera
JP7073238B2 (ja) * 2018-05-07 2022-05-23 アップル インコーポレイテッド クリエイティブカメラ
US10375313B1 (en) 2018-05-07 2019-08-06 Apple Inc. Creative camera
US12033296B2 (en) 2018-05-07 2024-07-09 Apple Inc. Avatar creation user interface
GB2573593B (en) * 2018-05-10 2021-11-03 Samsung Electronics Co Ltd Augmented reality rendering method and apparatus
JP7123041B2 (ja) * 2018-05-21 2022-08-22 アドシル リミテッド 現実世界環境における仮想オブジェクトの光線追跡反射の高速生成
CN110533707B (zh) 2018-05-24 2023-04-14 微软技术许可有限责任公司 照明估计
CN110536125A (zh) * 2018-05-25 2019-12-03 光宝电子(广州)有限公司 影像处理系统及影像处理方法
US10818093B2 (en) * 2018-05-25 2020-10-27 Tiff's Treats Holdings, Inc. Apparatus, method, and system for presentation of multimedia content including augmented reality content
US10475248B1 (en) * 2018-06-08 2019-11-12 Microsoft Technology Licensing, Llc Real-time compositing in mixed reality
US10699468B2 (en) 2018-06-09 2020-06-30 Adshir Ltd. Method for non-planar specular reflections in hybrid ray tracing
JP7084616B2 (ja) * 2018-06-20 2022-06-15 国立大学法人 筑波大学 画像処理装置、画像処理方法、及び画像処理プログラム
JP7122625B2 (ja) * 2018-07-02 2022-08-22 パナソニックＩｐマネジメント株式会社 学習データ収集装置、学習データ収集システム、及び学習データ収集方法
WO2020019132A1 (zh) * 2018-07-23 2020-01-30 太平洋未来科技（深圳）有限公司 基于光线信息渲染虚拟对象的方法、装置及电子设备
DE102018118187A1 (de) 2018-07-27 2020-01-30 Carl Zeiss Ag Verfahren und Datenverarbeitungssystem zur Synthese von Bildern
CN109147023A (zh) * 2018-07-27 2019-01-04 北京微播视界科技有限公司 基于人脸的三维特效生成方法、装置和电子设备
JP2020024550A (ja) * 2018-08-07 2020-02-13 キヤノン株式会社 画像処理装置、画像処理方法、およびプログラム
US10909373B1 (en) * 2018-08-24 2021-02-02 Snap Inc. Augmented reality system using structured light
TWI676136B (zh) 2018-08-31 2019-11-01 雲云科技股份有限公司 使用雙重分析之影像偵測方法以及影像偵測裝置
TWI680440B (zh) * 2018-08-31 2019-12-21 雲云科技股份有限公司 判斷使用者之姿勢之影像偵測方法以及影像偵測裝置
TWI702570B (zh) 2018-08-31 2020-08-21 雲云科技股份有限公司 選取使用者之代表性影像之影像偵測方法以及影像偵測裝置
DK201870623A1 (en) 2018-09-11 2020-04-15 Apple Inc. USER INTERFACES FOR SIMULATED DEPTH EFFECTS
WO2020057365A1 (en) * 2018-09-18 2020-03-26 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Method, system, and computer-readable medium for generating spoofed structured light illuminated face
US11151964B2 (en) * 2018-09-20 2021-10-19 Innolux Corporation Display apparatus
FR3086423B1 (fr) * 2018-09-21 2021-09-10 Diotasoft Procede et systeme de visualisation en realite augmentee
US10636218B2 (en) 2018-09-24 2020-04-28 Universal City Studios Llc Augmented reality for an amusement ride
CN109102727A (zh) * 2018-09-26 2018-12-28 宋飞 一种虚拟现实教学设备
US10623660B1 (en) 2018-09-27 2020-04-14 Eloupes, Inc. Camera array for a mediated-reality system
US11321857B2 (en) 2018-09-28 2022-05-03 Apple Inc. Displaying and editing images with depth information
US11128792B2 (en) 2018-09-28 2021-09-21 Apple Inc. Capturing and displaying images with multiple focal planes
CN109410309B (zh) * 2018-09-30 2024-03-08 深圳市商汤科技有限公司 重光照方法和装置、电子设备和计算机存储介质
WO2020069752A1 (en) * 2018-10-05 2020-04-09 Vestel Elektronik Sanayi Ve Ticaret A.S. Method for modifying stereoscopic pairs of images and apparatus
US11436808B2 (en) * 2018-10-09 2022-09-06 Google Llc Selecting augmented reality objects for display based on contextual cues
US20200160089A1 (en) * 2018-11-15 2020-05-21 International Business Machines Corporation Visual pattern recognition with selective illumination for assisted inspection
CN109544694A (zh) * 2018-11-16 2019-03-29 重庆邮电大学 一种基于深度学习的增强现实系统虚实混合建模方法
US11749142B2 (en) 2018-12-04 2023-09-05 Telefonaktiebolaget Lm Ericsson (Publ) Optical see-through viewing device and method for providing virtual content overlapping visual objects
US12008679B2 (en) 2018-12-13 2024-06-11 Leica Geosystems Ag Measurement method, measurement systems and auxiliary measurement instruments for displaying desired positions in a live image
WO2020119912A1 (de) * 2018-12-13 2020-06-18 Leica Geosystems Ag Vermessungsverfahren, messsysteme und messhilfsinstrumente
KR102170795B1 (ko) * 2018-12-19 2020-10-27 한국전자기술연구원 농연 환경 데이터 시각화 장치 및 방법
CN111353943B (zh) * 2018-12-20 2023-12-26 杭州海康威视数字技术股份有限公司 一种人脸图像恢复方法、装置及可读存储介质
CN111382618B (zh) * 2018-12-28 2021-02-05 广州市百果园信息技术有限公司 一种人脸图像的光照检测方法、装置、设备和存储介质
US10846917B2 (en) 2019-01-03 2020-11-24 Microsoft Technology Licensing, Llc Iterating different camera representations in three-dimensional model
US10540812B1 (en) * 2019-01-09 2020-01-21 Dell Products, L.P. Handling real-world light sources in virtual, augmented, and mixed reality (xR) applications
CN109829930B (zh) * 2019-01-15 2021-05-04 深圳市云之梦科技有限公司 人脸图像处理方法、装置、计算机设备及可读存储介质
US11107261B2 (en) 2019-01-18 2021-08-31 Apple Inc. Virtual avatar animation based on facial feature movement
TWI767179B (zh) * 2019-01-24 2022-06-11 宏達國際電子股份有限公司 混合實境中偵測真實世界光源的方法、混合實境系統及記錄媒體
US11030798B2 (en) * 2019-01-30 2021-06-08 Perfect Mobile Corp. Systems and methods for virtual application of makeup effects based on lighting conditions and surface properties of makeup effects
CN109840019B (zh) * 2019-02-22 2023-01-10 网易（杭州）网络有限公司 虚拟人物的控制方法、装置及存储介质
US10762697B1 (en) 2019-02-27 2020-09-01 Verizon Patent And Licensing Inc. Directional occlusion methods and systems for shading a virtual object rendered in a three-dimensional scene
US10964098B1 (en) * 2019-03-05 2021-03-30 Facebook Technologies, Llc Inverse path tracing for material and lighting estimation
CN109919876B (zh) * 2019-03-11 2020-09-01 四川川大智胜软件股份有限公司 一种三维真脸建模方法及三维真脸照相系统
EP4235381B1 (en) * 2019-03-18 2025-06-04 Apple Inc. Virtual paper
CN110458902B (zh) * 2019-03-26 2022-04-05 华为技术有限公司 3d光照估计方法及电子设备
EP3726474A1 (en) * 2019-04-19 2020-10-21 Koninklijke Philips N.V. Methods and systems for handling virtual 3d object surface interaction
CN110211217B (zh) * 2019-04-25 2024-01-16 合刃科技（深圳）有限公司 一种场景模拟式的光照配光方法以及装置
US10645294B1 (en) 2019-05-06 2020-05-05 Apple Inc. User interfaces for capturing and managing visual media
US11770601B2 (en) 2019-05-06 2023-09-26 Apple Inc. User interfaces for capturing and managing visual media
US11706521B2 (en) 2019-05-06 2023-07-18 Apple Inc. User interfaces for capturing and managing visual media
CN110288692B (zh) * 2019-05-17 2021-05-11 腾讯科技（深圳）有限公司 光照渲染方法和装置、存储介质及电子装置
CN110111428B (zh) * 2019-05-28 2023-06-20 艾瑞迈迪科技石家庄有限公司 一种应用于增强现实的虚拟目标标定方法及装置
US10861243B1 (en) * 2019-05-31 2020-12-08 Apical Limited Context-sensitive augmented reality
CA3045133C (en) * 2019-06-03 2023-03-21 Eidos Interactive Corp. Systems and methods for augmented reality applications
EP3980835A1 (en) 2019-06-07 2022-04-13 Telefonaktiebolaget Lm Ericsson (Publ) Improved optical see-through viewing device and method for calibrating provision of virtual content overlapping visual objects
US11315287B2 (en) * 2019-06-27 2022-04-26 Apple Inc. Generating pose information for a person in a physical environment
CN110335292B (zh) * 2019-07-09 2021-04-30 北京猫眼视觉科技有限公司 一种基于图片跟踪实现模拟场景跟踪的方法、系统及终端
JP7378997B2 (ja) * 2019-07-22 2023-11-14 キヤノン株式会社 情報処理装置、情報処理方法及びプログラム
US12075350B2 (en) * 2019-08-15 2024-08-27 Nokia Technologies Oy NTN country area specific low delay access
US11538216B2 (en) * 2019-09-03 2022-12-27 Adobe Inc. Dynamically estimating light-source-specific parameters for digital images using a neural network
WO2021044240A1 (en) * 2019-09-06 2021-03-11 Aarca Research Inc. System and method for evaluating vascular health condition of a person using thermal imaging
US11087529B2 (en) * 2019-09-27 2021-08-10 Disney Enterprises, Inc. Introducing real-time lighting effects to illuminate real-world physical objects in see-through augmented reality displays
US11430093B2 (en) * 2019-10-01 2022-08-30 Microsoft Technology Licensing, Llc Face-based tone curve adjustment
WO2021076122A1 (en) * 2019-10-16 2021-04-22 Google Llc Lighting estimation for augmented reality
US11107377B2 (en) * 2019-10-21 2021-08-31 Dell Products L.P. Projected information display for IT equipment environments
CN111080669B (zh) * 2019-11-04 2023-09-19 北京大学 一种图像反射分离方法及装置
WO2021109885A1 (en) * 2019-12-06 2021-06-10 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Light source detection for extended reality technologies
EP4073682B1 (en) 2019-12-11 2023-11-08 QuantiFace GmbH Generating videos, which include modified facial images
US11496691B2 (en) * 2019-12-16 2022-11-08 Disney Enterprises, Inc. Realistic illumination of a character for a scene
CN111210438A (zh) * 2019-12-26 2020-05-29 新绎健康科技有限公司 镜子
US10992928B1 (en) 2020-01-30 2021-04-27 Facebook Technologies, Llc Calibration system for concurrent calibration of device sensors
CN115039137B (zh) * 2020-01-30 2024-12-17 Oppo广东移动通信有限公司 基于亮度估计渲染虚拟对象的相关方法以及相关产品
US11138801B2 (en) * 2020-01-31 2021-10-05 Universal City Studios Llc Correlative effect augmented reality system and method
WO2021169766A1 (en) * 2020-02-25 2021-09-02 Guangdong Oppo Mobile Telecommunications Corp., Ltd. System and method for visualizing light rays in a scene
CN115398483A (zh) * 2020-03-23 2022-11-25 达尔维斯公司 用目标三维(3d)对象增强监视空间的录像片段以训练人工智能(ai)模型的方法和系统
US11921998B2 (en) 2020-05-11 2024-03-05 Apple Inc. Editing features of an avatar
DK202070625A1 (en) 2020-05-11 2022-01-04 Apple Inc User interfaces related to time
US10949986B1 (en) 2020-05-12 2021-03-16 Proprio, Inc. Methods and systems for imaging a scene, such as a medical scene, and tracking objects within the scene
US11069104B1 (en) * 2020-05-13 2021-07-20 Facebook Technologies, Llc Display that uses a light sensor to generate environmentally matched artificial reality content
JP7566028B2 (ja) 2020-05-20 2024-10-11 グーグル エルエルシー 多様なポートレートから照明を学習すること
US11423621B1 (en) * 2020-05-21 2022-08-23 Facebook Technologies, Llc. Adaptive rendering in artificial reality environments
US11039074B1 (en) 2020-06-01 2021-06-15 Apple Inc. User interfaces for managing media
CN111611977B (zh) * 2020-06-05 2021-10-15 吉林求是光谱数据科技有限公司 基于光谱与多波段融合的人脸识别监控系统及识别方法
EP4172954A1 (en) * 2020-06-30 2023-05-03 InterDigital CE Patent Holdings, SAS Shadow-based estimation of 3d lighting parameters from reference object and reference virtual viewpoint
CN113870407B (zh) * 2020-06-30 2025-04-08 阿里巴巴集团控股有限公司 图像显示方法、装置、电子设备及计算机可读存储介质
EP3937137A1 (en) * 2020-07-07 2022-01-12 X-Rite Europe GmbH Visualizing the appearances of at least two materials
EP4189530A4 (en) 2020-07-25 2024-08-14 Silver Spoon Animation Inc. System and method for populating a virtual crowd in real-time using augmented and virtual reality
CN111915533B (zh) * 2020-08-10 2023-12-01 上海金桥信息股份有限公司 一种基于低动态范围的高精图像信息提取方法
JP7365981B2 (ja) * 2020-08-27 2023-10-20 Kddi株式会社 情報端末装置、方法及びプログラム
GB2598608B (en) 2020-09-04 2024-05-08 Sony Interactive Entertainment Inc Content generation system and method
CN114155175B (zh) * 2020-09-07 2024-10-11 北京达佳互联信息技术有限公司 图像生成方法、装置、电子设备及存储介质
US11212449B1 (en) 2020-09-25 2021-12-28 Apple Inc. User interfaces for media capture and management
CN112338920B (zh) * 2020-11-04 2022-04-15 中国联合网络通信集团有限公司 数据处理方法、装置及设备
CN114979457B (zh) * 2021-02-26 2023-04-07 华为技术有限公司 一种图像处理方法及相关装置
US11562548B2 (en) * 2021-03-22 2023-01-24 Snap Inc. True size eyewear in real time
CN112926506B (zh) * 2021-03-24 2022-08-12 重庆邮电大学 一种基于卷积神经网络的非受控人脸检测方法及系统
CN113205585B (zh) * 2021-03-25 2023-04-28 浙江大学 动态物体互反射效果绘制方法、装置、系统和存储介质
US11778339B2 (en) 2021-04-30 2023-10-03 Apple Inc. User interfaces for altering visual media
US11539876B2 (en) 2021-04-30 2022-12-27 Apple Inc. User interfaces for altering visual media
US12112024B2 (en) 2021-06-01 2024-10-08 Apple Inc. User interfaces for managing media styles
US11776190B2 (en) 2021-06-04 2023-10-03 Apple Inc. Techniques for managing an avatar on a lock screen
US20230082420A1 (en) * 2021-09-13 2023-03-16 Qualcomm Incorporated Display of digital media content on physical surface
US12322038B2 (en) 2021-10-14 2025-06-03 Outward, Inc. Interactive image generation
US12261988B2 (en) 2021-11-08 2025-03-25 Proprio, Inc. Methods for generating stereoscopic views in multicamera systems, and associated devices and systems
CN114199124B (zh) * 2021-11-09 2023-07-25 汕头大学 基于线性拟合的坐标标定方法、装置、系统及介质
KR20230103379A (ko) 2021-12-31 2023-07-07 삼성전자주식회사 Ar 처리 방법 및 장치
EP4459560A4 (en) * 2022-01-29 2025-02-26 Shenzhen Yinwang Intelligent Technologies Co., Ltd. METHOD AND DEVICE FOR PROCESSING VIRTUAL IMAGES
CN114283195B (zh) * 2022-03-03 2022-07-26 荣耀终端有限公司 生成动态图像的方法、电子设备及可读存储介质
US12277632B2 (en) 2022-04-26 2025-04-15 Snap Inc. Augmented reality experiences with dual cameras
CN115100346A (zh) * 2022-06-17 2022-09-23 北京字跳网络技术有限公司 头发光照渲染方法、图像处理模型训练方法、装置及设备
US12189915B2 (en) * 2022-06-24 2025-01-07 Lowe's Companies, Inc. Simulated environment for presenting virtual objects and virtual resets
US12211161B2 (en) 2022-06-24 2025-01-28 Lowe's Companies, Inc. Reset modeling based on reset and object properties
US20240029333A1 (en) * 2022-07-20 2024-01-25 Google Llc Hybrid representation for photorealistic synthesis, animation and relighting of human eyes
US12211153B2 (en) * 2022-07-28 2025-01-28 Lenovo (Singapore) Pte. Ltd. Use of 3D/AI models to generate 3D representations of video stream users based on scene lighting not satisfying one or more criteria
US12287913B2 (en) 2022-09-06 2025-04-29 Apple Inc. Devices, methods, and graphical user interfaces for controlling avatars within three-dimensional environments
CN115661320B (zh) * 2022-11-28 2023-07-25 荣耀终端有限公司 图像处理方法及电子设备
CN116152051B (zh) * 2023-02-27 2023-12-01 上海福柯斯智能科技有限公司 一种x射线图像的分块配准图像剪影方法和装置
US20240302671A1 (en) * 2023-03-06 2024-09-12 Tencent America LLC Methods, devices, and systems for augmented reality
US20240303913A1 (en) * 2023-03-08 2024-09-12 Qualcomm Incorporated Physically-based emitter estimation for indoor scenes
US12444055B2 (en) * 2023-05-12 2025-10-14 Qualcomm Incorporated Convolution and transformer-based image segmentation
US12430934B2 (en) * 2023-05-12 2025-09-30 Adobe Inc. Utilizing implicit neural representations to parse visual components of subjects depicted within visual content
CN116883607B (zh) * 2023-09-06 2023-12-05 四川物通科技有限公司 基于辐射传输的虚拟现实场景生成系统
CN119274031B (zh) * 2024-04-29 2025-09-16 武汉大学 用于提高机器人环境感知能力的图像处理方法以及装置
CN118898624B (zh) * 2024-10-09 2024-12-27 杭州秋果计划科技有限公司 数字人图像处理方法、电子设备和存储介质

Family Cites Families (55)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6166744A (en) 1997-11-26 2000-12-26 Pathfinder Systems, Inc. System for combining virtual images with real-world scenes
US6850872B1 (en) 2000-08-30 2005-02-01 Microsoft Corporation Facial image processing methods and systems
US6950104B1 (en) 2000-08-30 2005-09-27 Microsoft Corporation Methods and systems for animating facial features, and methods and systems for expression transformation
WO2003063080A2 (en) * 2002-01-22 2003-07-31 Matchlight Software Inc. System and method for image attribute recording and analysis for biometric applications
US7262770B2 (en) 2002-03-21 2007-08-28 Microsoft Corporation Graphics image rendering with radiance self-transfer for low-frequency lighting environments
US8553037B2 (en) 2002-08-14 2013-10-08 Shawn Smith Do-It-Yourself photo realistic talking head creation system and method
CN1729471A (zh) * 2002-12-20 2006-02-01 皇家飞利浦电子股份有限公司 在不变照明下的面部识别
US7864176B2 (en) 2003-04-30 2011-01-04 Pixar Translucent object rendering methods and apparatus
US7176918B2 (en) 2003-04-30 2007-02-13 Pixar Three-dimensional paint projection weighting of diffuse and scattered illumination methods and apparatus
US20050083340A1 (en) 2003-10-15 2005-04-21 Microsoft Corporation Bi-scale radiance transfer
US7948490B2 (en) 2003-10-22 2011-05-24 Microsoft Corporation Hardware-accelerated computation of radiance transfer coefficients in computer graphics
WO2005076210A1 (ja) 2004-02-05 2005-08-18 Vodafone K.K. 画像処理方法、画像処理装置及び移動通信端末装置
EP2057445A1 (de) * 2004-10-13 2009-05-13 Siemens Aktiengesellschaft Vorrichtung und verfahren zur beleuchtungs- und schattensimulation in einem augmented-reality-system
US7633503B2 (en) 2005-03-22 2009-12-15 Microsoft Corporation Local, deformable precomputed radiance transfer
ES2325374T3 (es) * 2005-05-03 2009-09-02 Seac02 S.R.L. Sistema de realidad aumentada con identificacion de objeto marcador real.
US8139059B2 (en) * 2006-03-31 2012-03-20 Microsoft Corporation Object illumination in a virtual environment
US7408550B2 (en) 2006-07-24 2008-08-05 Bunnell Michael T System and methods for real-time rendering of deformable geometry with global illumination
US8633927B2 (en) 2006-07-25 2014-01-21 Nvidia Corporation Re-render acceleration of frame with lighting change
JP4804256B2 (ja) * 2006-07-27 2011-11-02 キヤノン株式会社 情報処理方法
JP5044321B2 (ja) * 2006-09-13 2012-10-10 株式会社リコー 撮像装置および被写体検出方法
US7663623B2 (en) 2006-12-18 2010-02-16 Microsoft Corporation Spherical harmonics scaling
US9171399B2 (en) * 2013-03-12 2015-10-27 Autodesk, Inc. Shadow rendering in a 3D scene based on physical light sources
US7884820B2 (en) 2007-06-15 2011-02-08 Micorsoft Corporation Interactive relighting with dynamic reflectance
US8009168B2 (en) 2007-06-26 2011-08-30 Microsoft Corporation Real-time rendering of light-scattering media
JP5025496B2 (ja) * 2008-01-09 2012-09-12 キヤノン株式会社 画像処理装置及び画像処理方法
US9082213B2 (en) * 2007-11-07 2015-07-14 Canon Kabushiki Kaisha Image processing apparatus for combining real object and virtual object and processing method therefor
US8847956B2 (en) * 2008-03-10 2014-09-30 Koninklijke Philips N.V. Method and apparatus for modifying a digital image
JP5106459B2 (ja) * 2009-03-26 2012-12-26 株式会社東芝 立体物判定装置、立体物判定方法及び立体物判定プログラム
US8797321B1 (en) * 2009-04-01 2014-08-05 Microsoft Corporation Augmented lighting environments
JP5684488B2 (ja) * 2009-04-20 2015-03-11 富士フイルム株式会社 画像処理装置、画像処理方法およびプログラム
WO2010144259A1 (en) * 2009-06-09 2010-12-16 Arizona Board Of Regents Acting For And On Behalf Of Arizona State University Ultra-low dimensional representation for face recognition under varying expressions
DE102009037835B4 (de) * 2009-08-18 2012-12-06 Metaio Gmbh Verfahren zur Darstellung von virtueller Information in einer realen Umgebung
US8405658B2 (en) * 2009-09-14 2013-03-26 Autodesk, Inc. Estimation of light color and direction for augmented reality applications
DE102009049073A1 (de) 2009-10-12 2011-04-21 Metaio Gmbh Verfahren zur Darstellung von virtueller Information in einer Ansicht einer realen Umgebung
KR20110053166A (ko) * 2009-11-13 2011-05-19 삼성전자주식회사 3ｄ 오브젝트 렌더딩 방법 및 장치
JP5525923B2 (ja) 2010-06-09 2014-06-18 任天堂株式会社 画像処理プログラム、画像処理装置、画像処理システム、および画像処理方法
JP5639832B2 (ja) 2010-09-30 2014-12-10 任天堂株式会社 情報処理プログラム、情報処理方法、情報処理システム、及び情報処理装置
CN102096941B (zh) * 2011-01-30 2013-03-20 北京航空航天大学 虚实融合环境下的光照一致性方法
US9449427B1 (en) * 2011-05-13 2016-09-20 Amazon Technologies, Inc. Intensity modeling for rendering realistic images
JP2013003848A (ja) * 2011-06-16 2013-01-07 Nippon Telegr & Teleph Corp <Ntt> 仮想物体表示装置
FR2986893B1 (fr) * 2012-02-13 2014-10-24 Total Immersion Systeme de creation de representations tridimensionnelles a partir de modeles reels ayant des caracteristiques similaires et predeterminees
JP5955031B2 (ja) * 2012-02-29 2016-07-20 セコム株式会社 顔画像認証装置
US9578226B2 (en) * 2012-04-12 2017-02-21 Qualcomm Incorporated Photometric registration from arbitrary geometry for augmented reality
JP5955133B2 (ja) * 2012-06-29 2016-07-20 セコム株式会社 顔画像認証装置
US8754829B2 (en) 2012-08-04 2014-06-17 Paul Lapstun Scanning light field camera and display
JP5711702B2 (ja) * 2012-08-23 2015-05-07 日本電信電話株式会社 投影型３次元形状復元装置、投影型３次元形状復元方法及び投影型３次元形状復元プログラム
US9202138B2 (en) * 2012-10-04 2015-12-01 Adobe Systems Incorporated Adjusting a contour by a shape model
US9524585B2 (en) 2012-11-05 2016-12-20 Microsoft Technology Licensing, Llc Constructing augmented reality environment with pre-computed lighting
US10062210B2 (en) * 2013-04-24 2018-08-28 Qualcomm Incorporated Apparatus and method for radiance transfer sampling for augmented reality
US9466149B2 (en) * 2013-05-10 2016-10-11 Google Inc. Lighting of graphical objects based on environmental conditions
US9854176B2 (en) * 2014-01-24 2017-12-26 Lucasfilm Entertainment Company Ltd. Dynamic lighting capture and reconstruction
US20150243035A1 (en) * 2014-02-21 2015-08-27 Metaio Gmbh Method and device for determining a transformation between an image coordinate system and an object coordinate system associated with an object of interest
US20150262412A1 (en) 2014-03-17 2015-09-17 Qualcomm Incorporated Augmented reality lighting with dynamic geometry
WO2015144209A1 (en) * 2014-03-25 2015-10-01 Metaio Gmbh Method and system for representing a virtual object in a view of a real environment
JP6410451B2 (ja) * 2014-03-31 2018-10-24 キヤノン株式会社 情報処理装置、計測システム、情報処理方法およびプログラム。

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11176699B2 (en) 2019-05-24 2021-11-16 Tencent America LLC Augmenting reliable training data with CycleGAN for hand pose estimation
TWI799000B (zh) * 2021-04-16 2023-04-11 財團法人工業技術研究院 資訊顯示方法及其處理裝置與顯示系統
US11815679B2 (en) 2021-04-16 2023-11-14 Industrial Technology Research Institute Method, processing device, and display system for information display

Also Published As

Publication number Publication date
CN110148204B (zh) 2023-09-15
EP3123449B1 (en) 2020-01-01
CN106133796A (zh) 2016-11-16
CN104952063A (zh) 2015-09-30
US10733804B2 (en) 2020-08-04
US11182961B2 (en) 2021-11-23
US10109107B2 (en) 2018-10-23
US11182974B2 (en) 2021-11-23
WO2015144209A1 (en) 2015-10-01
CN104952063B (zh) 2019-05-28
US20200013223A1 (en) 2020-01-09
US20190057554A1 (en) 2019-02-21
US10417824B2 (en) 2019-09-17
US20200364939A1 (en) 2020-11-19
CN110148204A (zh) 2019-08-20
US20170109931A1 (en) 2017-04-20
CN106133796B (zh) 2019-07-16
JP2015185176A (ja) 2015-10-22
US20150279113A1 (en) 2015-10-01
EP3123449A1 (en) 2017-02-01

Similar Documents

Publication Publication Date Title
JP6246757B2 (ja) 現実環境の視野におけるバーチャルオブジェクトを表現方法及びシステム
US11694392B2 (en) Environment synthesis for lighting an object
US10042188B2 (en) Process and method for real-time physically accurate and realistic-looking glasses try-on
Knorr et al. Real-time illumination estimation from faces for coherent rendering
EP3629303B1 (en) Method and system for representing a virtual object in a view of a real environment
JP4865093B2 (ja) 顔の特徴をアニメーション化する方法およびシステムならびに表情変換のための方法およびシステム
US10380802B2 (en) Projecting augmentation images onto moving objects
JP2002133446A (ja) 顔画像処理方法およびシステム
CN111861632B (zh) 虚拟试妆方法、装置、电子设备及可读存储介质
CN109214350B (zh) 一种光照参数的确定方法、装置、设备及存储介质
KR101865886B1 (ko) 근적외선 영상을 이용한 물체 표현의 기하 구조 및 반사도 추정 방법, 그리고 이를 구현한 시스템
Fuchs et al. Reflectance from images: A model-based approach for human faces
US12437492B2 (en) Controllable dynamic appearance for neural 3D portraits
CN108447085B (zh) 一种基于消费级rgb-d相机的人脸视觉外观恢复方法
Koc et al. Estimation of environmental lighting from known geometries for mobile augmented reality
Shahlaei et al. Hierarchical Bayesian Inverse Lighting of Portraits with a Virtual Light Stage
Jiddi Photometric registration of indoor real scenes using an RGB-D camera with application to mixed reality
Jethwa Efficient volumetric reconstruction from multiple calibrated cameras
Lombardi Radiometric Scene Decomposition: Estimating Complex Reflectance and Natural Illumination from Images

Legal Events

Date Code Title Description
RD03 Notification of appointment of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7423

Effective date: 20160422

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20160624

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20160616

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20161007

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20161007

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20171004

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20171016

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20171115

R150 Certificate of patent or registration of utility model

Ref document number: 6246757

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313113

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250