JP7562504B2 - 頭部姿勢予測のための深層予測器再帰ニューラルネットワーク - Google Patents

頭部姿勢予測のための深層予測器再帰ニューラルネットワーク Download PDF

Info

Publication number
JP7562504B2
JP7562504B2 JP2021500724A JP2021500724A JP7562504B2 JP 7562504 B2 JP7562504 B2 JP 7562504B2 JP 2021500724 A JP2021500724 A JP 2021500724A JP 2021500724 A JP2021500724 A JP 2021500724A JP 7562504 B2 JP7562504 B2 JP 7562504B2
Authority
JP
Japan
Prior art keywords
head pose
head
wearable system
pose
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2021500724A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021530790A5 (cg-RX-API-DMAC7.html
JP2021530790A (ja
Inventor
リオル バラク,
ガイ ローゼンタール,
アディ ペリー,
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of JP2021530790A publication Critical patent/JP2021530790A/ja
Publication of JP2021530790A5 publication Critical patent/JP2021530790A5/ja
Priority to JP2024014693A priority Critical patent/JP2024036471A/ja
Application granted granted Critical
Publication of JP7562504B2 publication Critical patent/JP7562504B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/211—Input arrangements for video game devices characterised by their sensors, purposes or types using inertial sensors, e.g. accelerometers or gyroscopes
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/212—Input arrangements for video game devices characterised by their sensors, purposes or types using sensors worn by the player, e.g. for measuring heart beat or leg activity
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • A63F13/428—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50—Controlling the output signals based on the game progress
    • A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
    • A63F13/525—Changing parameters of virtual cameras
    • A63F13/5255—Changing parameters of virtual cameras according to dedicated instructions from a player, e.g. using a secondary joystick to rotate the camera around a player's character
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/049—Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/60—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
    • A63F13/67—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor adaptively or by learning from player actions, e.g. skill level adjustment or by storing successful combat sequences for re-use
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0185—Displaying image at variable distance

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Optics & Photonics (AREA)
  • Computer Graphics (AREA)
  • Biophysics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Cardiology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
JP2021500724A 2018-07-23 2019-07-22 頭部姿勢予測のための深層予測器再帰ニューラルネットワーク Active JP7562504B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2024014693A JP2024036471A (ja) 2018-07-23 2024-02-02 頭部姿勢予測のための深層予測器再帰ニューラルネットワーク

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201862702309P 2018-07-23 2018-07-23
US62/702,309 2018-07-23
PCT/US2019/042846 WO2020023399A1 (en) 2018-07-23 2019-07-22 Deep predictor recurrent neural network for head pose prediction

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2024014693A Division JP2024036471A (ja) 2018-07-23 2024-02-02 頭部姿勢予測のための深層予測器再帰ニューラルネットワーク

Publications (3)

Publication Number Publication Date
JP2021530790A JP2021530790A (ja) 2021-11-11
JP2021530790A5 JP2021530790A5 (cg-RX-API-DMAC7.html) 2022-07-29
JP7562504B2 true JP7562504B2 (ja) 2024-10-07

Family

ID=69181908

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2021500724A Active JP7562504B2 (ja) 2018-07-23 2019-07-22 頭部姿勢予測のための深層予測器再帰ニューラルネットワーク
JP2024014693A Withdrawn JP2024036471A (ja) 2018-07-23 2024-02-02 頭部姿勢予測のための深層予測器再帰ニューラルネットワーク

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2024014693A Withdrawn JP2024036471A (ja) 2018-07-23 2024-02-02 頭部姿勢予測のための深層予測器再帰ニューラルネットワーク

Country Status (5)

Country Link
US (2) US11320899B2 (cg-RX-API-DMAC7.html)
EP (1) EP3827417A4 (cg-RX-API-DMAC7.html)
JP (2) JP7562504B2 (cg-RX-API-DMAC7.html)
CN (1) CN112513944A (cg-RX-API-DMAC7.html)
WO (1) WO2020023399A1 (cg-RX-API-DMAC7.html)

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ES2973462T3 (es) * 2016-11-11 2024-06-20 Ericsson Telefon Ab L M Soportar una aplicación de software para realidad aumentada
CN112513944A (zh) 2018-07-23 2021-03-16 奇跃公司 用于头部姿势预测的深度预测器循环神经网络
EP3844722A4 (en) * 2018-08-29 2022-06-01 Movidius Ltd. MACHINE VISION SYSTEM
US10901502B2 (en) * 2019-06-27 2021-01-26 Facebook, Inc. Reducing head mounted display power consumption and heat generation through predictive rendering of content
TW202125343A (zh) * 2019-12-30 2021-07-01 瑞昱半導體股份有限公司 時間序列預測方法及相關的時間序列預測電路
US20210240257A1 (en) * 2020-01-31 2021-08-05 Ati Technologies Ulc Hiding latency in wireless virtual and augmented reality systems
IL274382A (en) * 2020-05-01 2021-12-01 Pulsenmore Ltd A system and method for assisting an unskilled patient in performing ultrasound scans himself
US11144117B1 (en) * 2020-05-18 2021-10-12 Qualcomm Incorporated Deep learning based head motion prediction for extended reality
DE102020121408A1 (de) 2020-08-14 2022-02-17 Bayerische Motoren Werke Aktiengesellschaft Computerimplementiertes Verfahren und System zur Vorhersage einer Orientierung und räumlichen Position einer am Kopf eines Nutzers montierbaren Anzeigevorrichtung
KR102672387B1 (ko) * 2020-12-09 2024-06-10 서울과학기술대학교 산학협력단 Lstm 기반의 개인화 시점 추정 방법 및 장치
KR102965307B1 (ko) 2020-12-11 2026-05-15 삼성전자주식회사 영상 표시 장치의 위치를 추정하는 방법 및 장치
US11914762B2 (en) * 2020-12-28 2024-02-27 Meta Platforms Technologies, Llc Controller position tracking using inertial measurement units and machine learning
US20240147180A1 (en) * 2021-03-19 2024-05-02 Dolby Laboratories Licensing Corporation Sensor data prediction
JP7617417B2 (ja) * 2021-04-27 2025-01-20 パナソニックIpマネジメント株式会社 照明装置、照明制御方法及びプログラム
US11886245B2 (en) * 2021-05-06 2024-01-30 Microsoft Technology Licensing, Llc Estimating runtime-frame velocity of wearable device
JP7474726B2 (ja) 2021-05-14 2024-04-25 Kddi株式会社 計算機合成ホログラム生成装置及びプログラム
CN113420720B (zh) * 2021-07-21 2024-01-09 中通服咨询设计研究院有限公司 一种高精度低延时大型室内场馆人群分布计算方法
CN114004342B (zh) * 2021-11-29 2023-05-30 中国科学院光电技术研究所 一种基于lstm网络的激光通信系统畸变波前预测方法
CN114154583B (zh) * 2021-12-08 2024-05-24 深圳博沃智慧科技有限公司 一种小波分析耦合lstm神经网络的水质预测方法
US11847259B1 (en) * 2022-11-23 2023-12-19 Google Llc Map-aided inertial odometry with neural network for augmented reality devices
EP4537915A1 (en) * 2023-10-13 2025-04-16 Sony Interactive Entertainment Inc. Data processing apparatus and method
US12602803B2 (en) * 2024-03-28 2026-04-14 Htc Corporation Head-mounted display and method for depth prediction
CN119178437B (zh) * 2024-10-15 2025-03-14 北京大学 一种室内航向估计方法、装置、设备及介质
CN119027624B (zh) * 2024-10-28 2024-12-20 云南邦彦科技有限公司 3d展览馆效果可视化体验平台

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016002318A1 (ja) 2014-06-30 2016-01-07 ソニー株式会社 情報処理装置及び情報処理方法、コンピューター・プログラム、並びに画像処理システム
US20180053056A1 (en) 2016-08-22 2018-02-22 Magic Leap, Inc. Augmented reality display device with deep learning sensors

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6222525B1 (en) 1992-03-05 2001-04-24 Brad A. Armstrong Image controllers with sheet connected sensors
US5670988A (en) 1995-09-05 1997-09-23 Interlink Electronics, Inc. Trigger operated electronic device
US20070081123A1 (en) 2005-10-07 2007-04-12 Lewis Scott W Digital eyewear
US8696113B2 (en) 2005-10-07 2014-04-15 Percept Technologies Inc. Enhanced optical and perceptual digital eyewear
US11428937B2 (en) 2005-10-07 2022-08-30 Percept Technologies Enhanced optical and perceptual digital eyewear
US9304319B2 (en) 2010-11-18 2016-04-05 Microsoft Technology Licensing, Llc Automatic focus improvement for augmented reality displays
US10156722B2 (en) 2010-12-24 2018-12-18 Magic Leap, Inc. Methods and systems for displaying stereoscopy with a freeform optical system with addressable focus for virtual and augmented reality
EP4036630A1 (en) 2010-12-24 2022-08-03 Magic Leap, Inc. Image display system
JP6316186B2 (ja) 2011-05-06 2018-04-25 マジック リープ, インコーポレイテッドMagic Leap,Inc. 広範囲同時遠隔ディジタル提示世界
US10795448B2 (en) 2011-09-29 2020-10-06 Magic Leap, Inc. Tactile glove for human-computer interaction
EP4404537A3 (en) 2011-10-28 2024-10-16 Magic Leap, Inc. System and method for augmented and virtual reality
CN104541201B (zh) 2012-04-05 2018-05-25 奇跃公司 具有主动中央凹能力的宽视场(fov)成像设备
US9671566B2 (en) 2012-06-11 2017-06-06 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
WO2014043196A1 (en) 2012-09-11 2014-03-20 Magic Leap, Inc Ergonomic head mounted display device and optical system
AU2014229004B2 (en) 2013-03-15 2017-09-21 Magic Leap, Inc. Display system and method
US9874749B2 (en) 2013-11-27 2018-01-23 Magic Leap, Inc. Virtual and augmented reality systems and methods
JP6479785B2 (ja) 2013-10-16 2019-03-06 マジック リープ, インコーポレイテッドMagic Leap,Inc. 調節可能な瞳孔間距離を有する仮想または拡張現実ヘッドセット
CN113433700B (zh) 2013-11-27 2024-03-22 奇跃公司 虚拟和增强现实系统与方法
US9857591B2 (en) 2014-05-30 2018-01-02 Magic Leap, Inc. Methods and system for creating focal planes in virtual and augmented reality
US10203762B2 (en) 2014-03-11 2019-02-12 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
JP6550460B2 (ja) 2014-05-09 2019-07-24 グーグル エルエルシー 眼信号を識別するためのシステムおよび方法、ならびに連続バイオメトリック認証
US9442564B1 (en) * 2015-02-12 2016-09-13 Amazon Technologies, Inc. Motion sensor-based head location estimation and updating
CN108027652B (zh) * 2015-09-16 2021-06-22 索尼公司 信息处理设备、信息处理方法以及记录介质
ES2964705T3 (es) 2016-05-06 2024-04-09 Univ Leland Stanford Junior Plataformas móviles y portátiles de captura y retroalimentación de vídeo para la terapia de trastornos mentales
KR102648770B1 (ko) 2016-07-14 2024-03-15 매직 립, 인코포레이티드 홍채 식별을 위한 딥 뉴럴 네트워크
US11120353B2 (en) * 2016-08-16 2021-09-14 Toyota Jidosha Kabushiki Kaisha Efficient driver action prediction system based on temporal fusion of sensor data using deep (bidirectional) recurrent neural network
RU2016138608A (ru) 2016-09-29 2018-03-30 Мэджик Лип, Инк. Нейронная сеть для сегментации изображения глаза и оценки качества изображения
WO2018093796A1 (en) 2016-11-15 2018-05-24 Magic Leap, Inc. Deep learning system for cuboid detection
EP3596659A4 (en) 2017-03-17 2021-01-27 Magic Leap, Inc. SPACE LAYOUT APPRAISAL METHODS AND TECHNIQUES
US10096125B1 (en) 2017-04-07 2018-10-09 Adobe Systems Incorporated Forecasting multiple poses based on a graphical image
US10996742B2 (en) * 2017-10-17 2021-05-04 Logitech Europe S.A. Input device for AR/VR applications
US10942564B2 (en) * 2018-05-17 2021-03-09 Sony Interactive Entertainment Inc. Dynamic graphics rendering based on predicted saccade landing point
CN112513944A (zh) 2018-07-23 2021-03-16 奇跃公司 用于头部姿势预测的深度预测器循环神经网络

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016002318A1 (ja) 2014-06-30 2016-01-07 ソニー株式会社 情報処理装置及び情報処理方法、コンピューター・プログラム、並びに画像処理システム
US20180053056A1 (en) 2016-08-22 2018-02-22 Magic Leap, Inc. Augmented reality display device with deep learning sensors

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
E. W. Saad, 外2名、"Predictive head tracking for virtual reality"、IJCNN’99. International Joint Conference on Neural Networks. Proceedings、米国、1999.発行、p.3933-3936

Also Published As

Publication number Publication date
US11320899B2 (en) 2022-05-03
US11662806B2 (en) 2023-05-30
US20210223858A1 (en) 2021-07-22
EP3827417A4 (en) 2022-04-27
JP2021530790A (ja) 2021-11-11
US20220253133A1 (en) 2022-08-11
JP2024036471A (ja) 2024-03-15
EP3827417A1 (en) 2021-06-02
CN112513944A (zh) 2021-03-16
WO2020023399A1 (en) 2020-01-30

Similar Documents

Publication Publication Date Title
US11662806B2 (en) Deep predictor recurrent neural network for head pose prediction
JP7436600B2 (ja) 眼追跡のための個人化されたニューラルネットワーク
JP7707394B2 (ja) 姿勢および複数のdofコントローラを用いた3d仮想オブジェクトとの相互作用
KR102668725B1 (ko) 증강 현실 시스템들에 대한 가상 레티클
EP3659017B1 (en) Training a neural network with representations of user interface devices
JP7118007B2 (ja) 視野周辺の視覚的背光
EP4062380A1 (en) Mapping and localization of a passable world
US20210232211A1 (en) Converting a 2d positional input into a 3d point in space
JP2023536064A (ja) 交互サンプリングを使用した眼追跡
US12242667B2 (en) Eye and hand tracking utilizing lensless camera and machine learning
CN121713146A (zh) 用于显示接口的头戴式显示装置以及头戴式显示装置的操作方法

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220721

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220721

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20230530

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20230531

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230816

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20231003

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240202

A911 Transfer to examiner for re-examination before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20240213

A912 Re-examination (zenchi) completed and case transferred to appeal board

Free format text: JAPANESE INTERMEDIATE CODE: A912

Effective date: 20240322

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240925

R150 Certificate of patent or registration of utility model

Ref document number: 7562504

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150