JPWO2019207714A1 - 動作推定システム、動作推定方法および動作推定プログラム - Google Patents
動作推定システム、動作推定方法および動作推定プログラム Download PDFInfo
- Publication number
- JPWO2019207714A1 JPWO2019207714A1 JP2020515390A JP2020515390A JPWO2019207714A1 JP WO2019207714 A1 JPWO2019207714 A1 JP WO2019207714A1 JP 2020515390 A JP2020515390 A JP 2020515390A JP 2020515390 A JP2020515390 A JP 2020515390A JP WO2019207714 A1 JPWO2019207714 A1 JP WO2019207714A1
- Authority
- JP
- Japan
- Prior art keywords
- person
- action
- pose
- unit
- pose information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000033001 locomotion Effects 0.000 title claims abstract description 123
- 238000000034 method Methods 0.000 title claims description 34
- 230000009471 action Effects 0.000 claims abstract description 154
- 238000011156 evaluation Methods 0.000 claims description 17
- 230000008569 process Effects 0.000 claims description 12
- 230000003993 interaction Effects 0.000 claims description 4
- 238000002372 labelling Methods 0.000 claims description 3
- 238000004364 calculation method Methods 0.000 description 28
- 238000004458 analytical method Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 238000013473 artificial intelligence Methods 0.000 description 6
- 230000006399 behavior Effects 0.000 description 5
- 238000009826 distribution Methods 0.000 description 4
- 239000011159 matrix material Substances 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000003384 imaging method Methods 0.000 description 3
- 210000003141 lower extremity Anatomy 0.000 description 3
- 238000011002 quantification Methods 0.000 description 3
- 238000013179 statistical model Methods 0.000 description 3
- 208000006011 Stroke Diseases 0.000 description 2
- 230000001575 pathological effect Effects 0.000 description 2
- 238000000342 Monte Carlo simulation Methods 0.000 description 1
- 230000032683 aging Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 208000022084 motor paralysis Diseases 0.000 description 1
- 238000003058 natural language processing Methods 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000007637 random forest analysis Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
- G16H20/30—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
- G06N20/20—Ensemble learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N7/00—Computing arrangements based on specific mathematical models
- G06N7/01—Probabilistic graphical models, e.g. probabilistic networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/49—Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
- G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
- G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/70—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Medical Informatics (AREA)
- General Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Public Health (AREA)
- Data Mining & Analysis (AREA)
- Software Systems (AREA)
- Computing Systems (AREA)
- Epidemiology (AREA)
- Primary Health Care (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- Biomedical Technology (AREA)
- General Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Life Sciences & Earth Sciences (AREA)
- Mathematical Physics (AREA)
- Biophysics (AREA)
- Physical Education & Sports Medicine (AREA)
- Social Psychology (AREA)
- Psychiatry (AREA)
- Human Computer Interaction (AREA)
- Radiology & Medical Imaging (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Pathology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Computational Biology (AREA)
- Mathematical Analysis (AREA)
- Mathematical Optimization (AREA)
- Probability & Statistics with Applications (AREA)
- Computational Mathematics (AREA)
- Algebra (AREA)
- Pure & Applied Mathematics (AREA)
- Business, Economics & Management (AREA)
Abstract
Description
p(X)=∫p(X,Z,S)dZdS (式3)
20 姿勢/位置取得部
30 演算部
40 記憶部
50 入出力部
60 評価部
Claims (10)
- 一の人物の動作が他の人物の動作に影響を及ぼす状況において同時に特定される当該一の人物の姿勢および当該他の人物の姿勢を表すポーズ情報を時系列に取得するポーズ取得部と、
取得された各人物の時系列のポーズ情報を教師なし学習により分割して、二以上の前記ポーズ情報を含む動作の系列であるアクション系列を推定するアクション推定部とを備えた
ことを特徴とする動作推定システム。 - アクション推定部は、状況を表す文脈に基づいて、分割された動作からアクション系列を推定する
請求項1記載の動作推定システム。 - ポーズ取得部は、リハビリテーションにおいてセラピストの姿勢および患者のポーズ情報を時系列に取得し、
アクション推定部は、取得されたセラピストおよび患者のポーズ情報を分割してアクション系列を推定し、推定されたアクション系列から各アクション間の相互作用を表すリハビリ方法論に基づいて、リハビリテーションのアクション系列である介入行動系列を導出する
請求項2記載の動作推定システム。 - 推定されたアクション系列に応じた情報を出力する出力部を備え、
ポーズ取得部は、一の人物および他の人物が撮影された映像から時系列にポーズ情報を取得し、
前記出力部は、推定されたアクション系列を撮影された映像に対応付けて出力する
請求項1から請求項3のうちのいずれか1項に記載の動作推定システム。 - 出力部は、アクションの単位で映像の出力を制御する
請求項4記載の動作推定システム。 - 推定されたアクション系列を記憶する記憶部を備え、
アクション推定部は、推定されたアクション系列に一の人物および他の人物を識別する情報を対応付けて前記記憶部に記憶する
請求項1から請求項5のうちのいずれか1項に記載の動作推定システム。 - 記憶部に記憶されたアクション系列から人物の動作を評価する評価部を備え、
ポーズ取得部は、各人物のポーズ情報を時系列に新たに取得し、
前記評価部は、取得された時系列のポーズ情報と、前記記憶部に記憶されたアクション系列に含まれるアクションとを比較して、各人物の動作を評価する
請求項6記載の動作推定システム。 - 推定されたアクション系列に含まれる各アクションに対するユーザからのラベル付けを受け付ける入力部を備えた
請求項1から請求項7のうちのいずれか1項に記載の動作推定システム。 - ポーズ取得部が、一の人物の動作が他の人物の動作に影響を及ぼす状況において同時に特定される当該一の人物の姿勢および当該他の人物の姿勢を表すポーズ情報を時系列に取得し、
アクション推定部が、取得された各人物の時系列のポーズ情報を教師なし学習により分割して、二以上の前記ポーズ情報を含む動作の系列であるアクション系列を推定する
ことを特徴とする動作推定方法。 - コンピュータに、
一の人物の動作が他の人物の動作に影響を及ぼす状況において同時に特定される当該一の人物の姿勢および当該他の人物の姿勢を表すポーズ情報を時系列に取得するポーズ取得処理、および、
取得された各人物の時系列のポーズ情報を教師なし学習により分割して、二以上の前記ポーズ情報を含む動作の系列であるアクション系列を推定するアクション推定処理
を実行させるための動作推定プログラム。
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2018/017005 WO2019207714A1 (ja) | 2018-04-26 | 2018-04-26 | 動作推定システム、動作推定方法および動作推定プログラム |
Publications (2)
Publication Number | Publication Date |
---|---|
JPWO2019207714A1 true JPWO2019207714A1 (ja) | 2021-04-22 |
JP7192860B2 JP7192860B2 (ja) | 2022-12-20 |
Family
ID=68295215
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2020515390A Active JP7192860B2 (ja) | 2018-04-26 | 2018-04-26 | 動作推定システム、動作推定方法および動作推定プログラム |
Country Status (3)
Country | Link |
---|---|
US (1) | US11848091B2 (ja) |
JP (1) | JP7192860B2 (ja) |
WO (1) | WO2019207714A1 (ja) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111685773B (zh) * | 2020-06-04 | 2024-04-09 | 北京荟健科技有限公司 | 孕妇运动监控方法、装置、计算机设备及存储介质 |
CN116098611B (zh) * | 2022-12-07 | 2024-05-24 | 上海傅利叶智能科技有限公司 | 肢体运动康复的评估生成系统、方法及介质 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2015191471A (ja) * | 2014-03-28 | 2015-11-02 | Kddi株式会社 | 感情情報推定装置、方法及びプログラム |
JP2015207179A (ja) * | 2014-04-22 | 2015-11-19 | 国立研究開発法人産業技術総合研究所 | 行動理解システムおよびプログラム |
JP2016080671A (ja) * | 2014-10-20 | 2016-05-16 | 純一 水澤 | 人間の動きを測定するロボット計測器 |
JP2016118906A (ja) * | 2014-12-19 | 2016-06-30 | 株式会社デンソー | 異常検出装置 |
JP2016208516A (ja) * | 2015-04-23 | 2016-12-08 | アディダス アーゲー | 人物の活動の映像内のフレームをイベントに関連付けるための方法およびデバイス |
JP2017167878A (ja) * | 2016-03-17 | 2017-09-21 | 国立研究開発法人産業技術総合研究所 | 行動分析システムおよびプログラム |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5252393B2 (ja) | 2008-05-13 | 2013-07-31 | 独立行政法人情報通信研究機構 | 動作学習装置 |
US9058663B2 (en) * | 2012-04-11 | 2015-06-16 | Disney Enterprises, Inc. | Modeling human-human interactions for monocular 3D pose estimation |
JP6849312B2 (ja) | 2016-03-02 | 2021-03-24 | 株式会社日立製作所 | 作業動作認識システム |
EP3454744B1 (en) * | 2016-04-13 | 2024-03-06 | Strong Arm Technologies, Inc. | Systems for motion tracking, assessment, and monitoring |
US20180005129A1 (en) * | 2016-06-29 | 2018-01-04 | Stephanie Moyerman | Predictive classification in action sports |
-
2018
- 2018-04-26 JP JP2020515390A patent/JP7192860B2/ja active Active
- 2018-04-26 WO PCT/JP2018/017005 patent/WO2019207714A1/ja active Application Filing
- 2018-04-26 US US17/050,594 patent/US11848091B2/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2015191471A (ja) * | 2014-03-28 | 2015-11-02 | Kddi株式会社 | 感情情報推定装置、方法及びプログラム |
JP2015207179A (ja) * | 2014-04-22 | 2015-11-19 | 国立研究開発法人産業技術総合研究所 | 行動理解システムおよびプログラム |
JP2016080671A (ja) * | 2014-10-20 | 2016-05-16 | 純一 水澤 | 人間の動きを測定するロボット計測器 |
JP2016118906A (ja) * | 2014-12-19 | 2016-06-30 | 株式会社デンソー | 異常検出装置 |
JP2016208516A (ja) * | 2015-04-23 | 2016-12-08 | アディダス アーゲー | 人物の活動の映像内のフレームをイベントに関連付けるための方法およびデバイス |
JP2017167878A (ja) * | 2016-03-17 | 2017-09-21 | 国立研究開発法人産業技術総合研究所 | 行動分析システムおよびプログラム |
Also Published As
Publication number | Publication date |
---|---|
US11848091B2 (en) | 2023-12-19 |
US20210241464A1 (en) | 2021-08-05 |
WO2019207714A1 (ja) | 2019-10-31 |
JP7192860B2 (ja) | 2022-12-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Chen et al. | Momentum contrastive learning for few-shot COVID-19 diagnosis from chest CT images | |
Lin et al. | Movement primitive segmentation for human motion modeling: A framework for analysis | |
Cohen et al. | Facial expression recognition from video sequences | |
Lin et al. | Towards automatic skill evaluation: Detection and segmentation of robot-assisted surgical motions | |
Minnen et al. | Discovering characteristic actions from on-body sensor data | |
Pereira et al. | Convolutional neural networks applied for Parkinson’s disease identification | |
Faria et al. | Extracting data from human manipulation of objects towards improving autonomous robotic grasping | |
Madeo et al. | Gesture phase segmentation using support vector machines | |
Khan et al. | Beyond activity recognition: skill assessment from accelerometer data | |
Avola et al. | Deep temporal analysis for non-acted body affect recognition | |
JP2023076426A (ja) | 技術的知識獲得のための機械学習システム | |
Samadani et al. | Discriminative functional analysis of human movements | |
Ribet et al. | Survey on style in 3d human body motion: Taxonomy, data, recognition and its applications | |
Wang et al. | Unlocking the emotional world of visual media: An overview of the science, research, and impact of understanding emotion | |
Metaxas et al. | Image-based stress recognition using a model-based dynamic face tracking system | |
JP7192860B2 (ja) | 動作推定システム、動作推定方法および動作推定プログラム | |
Menegozzo et al. | Surgical gesture recognition with time delay neural network based on kinematic data | |
Kasparova et al. | Inferring student engagement in collaborative problem solving from visual cues | |
CN117391092B (zh) | 一种基于对比学习的电子病历多模态医疗语义对齐方法 | |
CN112216379A (zh) | 一种基于智能联合学习的疾病诊断系统 | |
Sarma et al. | Real-Time Indian Sign Language Recognition System using YOLOv3 Model | |
Vaijayanthi et al. | Human emotion recognition from body posture with machine learning techniques | |
Rehman et al. | A Real-Time Approach for Finger Spelling Interpretation Based on American Sign Language Using Neural Networks | |
WO2021039641A1 (ja) | 運動言語化装置、運動言語化方法、プログラム及び運動記録装置 | |
Marco-Giménez et al. | Affective and Behavioral Assessment for Adaptive Intelligent Tutoring Systems. |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20201023 |
|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20201023 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20211207 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20220614 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20220804 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20221108 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20221121 |
|
R151 | Written notification of patent or utility model registration |
Ref document number: 7192860 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R151 |