JP6945527B2 - 図における手書き認識のシステム及び方法 - Google Patents

図における手書き認識のシステム及び方法 Download PDF

Info

Publication number
JP6945527B2
JP6945527B2 JP2018520175A JP2018520175A JP6945527B2 JP 6945527 B2 JP6945527 B2 JP 6945527B2 JP 2018520175 A JP2018520175 A JP 2018520175A JP 2018520175 A JP2018520175 A JP 2018520175A JP 6945527 B2 JP6945527 B2 JP 6945527B2
Authority
JP
Japan
Prior art keywords
text
input
digital ink
elements
connector
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2018520175A
Other languages
English (en)
Japanese (ja)
Other versions
JP2018536927A (ja
JP2018536927A5 (enExample
Inventor
ベドナロウィッツ ロマン
ベドナロウィッツ ロマン
メリナン ロビン
メリナン ロビン
シドリ クレア
シドリ クレア
リック ファビアン
リック ファビアン
エラゴーニ カオウラ
エラゴーニ カオウラ
エベール デヴィッド
エベール デヴィッド
ヴァレンテ ファビオ
ヴァレンテ ファビオ
クザン グレゴリー
クザン グレゴリー
ナゴット メイル
ナゴット メイル
セロヴィク シリル
セロヴィク シリル
ボノー アン
ボノー アン
Original Assignee
マイスクリプト
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by マイスクリプト filed Critical マイスクリプト
Publication of JP2018536927A publication Critical patent/JP2018536927A/ja
Publication of JP2018536927A5 publication Critical patent/JP2018536927A5/ja
Application granted granted Critical
Publication of JP6945527B2 publication Critical patent/JP6945527B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/35Clustering; Classification
    • G06F16/353Clustering; Classification into predefined classes
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/20Natural language analysis
    • G06F40/205Parsing
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/20Drawing from basic elements, e.g. lines or circles
    • G06T11/206Drawing of charts or graphs
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/14Image acquisition
    • G06V30/142Image acquisition using hand-held instruments; Constructional details of the instruments
    • G06V30/1423Image acquisition using hand-held instruments; Constructional details of the instruments the instrument generating sequences of position coordinates corresponding to handwriting
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/32Digital ink
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/32Digital ink
    • G06V30/333Preprocessing; Feature extraction
    • G06V30/347Sampling; Contour coding; Stroke extraction
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/32Digital ink
    • G06V30/36Matching; Classification
    • G06V30/387Matching; Classification using human interaction, e.g. selection of the best displayed recognition candidate
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/40Document-oriented image-based pattern recognition
    • G06V30/42Document-oriented image-based pattern recognition based on the type of document
    • G06V30/422Technical drawings; Geographical maps

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Character Discrimination (AREA)
  • User Interface Of Digital Computer (AREA)
JP2018520175A 2015-10-19 2016-10-18 図における手書き認識のシステム及び方法 Active JP6945527B2 (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
EP15290271.4 2015-10-19
EP15290271 2015-10-19
US14/955,155 US10643067B2 (en) 2015-10-19 2015-12-01 System and method of handwriting recognition in diagrams
US14/955,155 2015-12-01
PCT/EP2016/001720 WO2017067652A1 (en) 2015-10-19 2016-10-18 System and method of handwriting recognition in diagrams

Publications (3)

Publication Number Publication Date
JP2018536927A JP2018536927A (ja) 2018-12-13
JP2018536927A5 JP2018536927A5 (enExample) 2019-11-28
JP6945527B2 true JP6945527B2 (ja) 2021-10-06

Family

ID=54477976

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018520175A Active JP6945527B2 (ja) 2015-10-19 2016-10-18 図における手書き認識のシステム及び方法

Country Status (6)

Country Link
US (2) US10643067B2 (enExample)
EP (1) EP3365764B1 (enExample)
JP (1) JP6945527B2 (enExample)
KR (1) KR102396224B1 (enExample)
CN (1) CN108834426B (enExample)
WO (1) WO2017067652A1 (enExample)

Families Citing this family (55)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8564544B2 (en) 2006-09-06 2013-10-22 Apple Inc. Touch screen device, method, and graphical user interface for customizing display of content category icons
US9465985B2 (en) 2013-06-09 2016-10-11 Apple Inc. Managing real-time handwriting recognition
JP6492894B2 (ja) * 2015-04-01 2019-04-03 富士通株式会社 認識プログラム、認識方法及び認識装置
US10003938B2 (en) 2015-08-14 2018-06-19 Apple Inc. Easy location sharing
US20170068868A1 (en) * 2015-09-09 2017-03-09 Google Inc. Enhancing handwriting recognition using pre-filter classification
US10643067B2 (en) * 2015-10-19 2020-05-05 Myscript System and method of handwriting recognition in diagrams
US9927917B2 (en) * 2015-10-29 2018-03-27 Microsoft Technology Licensing, Llc Model-based touch event location adjustment
US10324618B1 (en) * 2016-01-05 2019-06-18 Quirklogic, Inc. System and method for formatting and manipulating digital ink
US10755029B1 (en) 2016-01-05 2020-08-25 Quirklogic, Inc. Evaluating and formatting handwritten input in a cell of a virtual canvas
US10013603B2 (en) * 2016-01-20 2018-07-03 Myscript System and method for recognizing multiple object structure
US10228775B2 (en) * 2016-01-22 2019-03-12 Microsoft Technology Licensing, Llc Cross application digital ink repository
DK179329B1 (en) 2016-06-12 2018-05-07 Apple Inc Handwriting keyboard for monitors
US11409952B2 (en) 2016-08-16 2022-08-09 Myscript System and method for collaborative ink management
JP6798555B2 (ja) * 2016-08-19 2020-12-09 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム
USD868081S1 (en) * 2016-08-26 2019-11-26 Samsung Electronics Co., Ltd. Display screen or portion thereof with transitional graphical user interface
CN107273895B (zh) * 2017-06-15 2020-07-14 幻视互动(北京)科技有限公司 用于头戴式智能设备的视频流实时文本识别及翻译的方法
CA2999099C (en) * 2017-11-07 2023-02-14 Tata Consultancy Services Limited Method and system for extracting information from hand-marked industrial inspection sheets
CN108304132B (zh) * 2018-01-19 2021-03-02 广州视源电子科技股份有限公司 图形显示方法、装置、设备及存储介质
DK180171B1 (en) 2018-05-07 2020-07-14 Apple Inc USER INTERFACES FOR SHARING CONTEXTUALLY RELEVANT MEDIA CONTENT
KR102215824B1 (ko) * 2018-11-23 2021-02-16 네이버웹툰 유한회사 시각 및 텍스트 정보를 포함하는 다이어그램의 분석 방법 및 장치
US11048931B2 (en) * 2019-02-19 2021-06-29 Lenovo (Singapore) Pte. Ltd. Recognition based handwriting input conversion
US11392659B2 (en) * 2019-02-28 2022-07-19 Adobe Inc. Utilizing machine learning models to generate experience driven search results based on digital canvas gesture inputs
US11126836B2 (en) * 2019-03-28 2021-09-21 Microsoft Technology Licensing, Llc Grouping strokes of digital ink
US10957080B2 (en) * 2019-04-02 2021-03-23 Adobe Inc. Automatic illustrator guides
CN110069205A (zh) * 2019-04-15 2019-07-30 广州视源电子科技股份有限公司 一种书写轨迹调整的方法、装置、终端设备和存储介质
CN110045840B (zh) * 2019-04-15 2023-07-18 广州视源电子科技股份有限公司 一种书写轨迹关联的方法、装置、终端设备和存储介质
CN110069204B (zh) * 2019-04-15 2021-12-03 广州视源电子科技股份有限公司 基于书写轨迹的图形处理方法、装置、设备及存储介质
CN110045909B (zh) * 2019-04-15 2021-01-22 广州视源电子科技股份有限公司 基于书写轨迹的椭圆处理方法、装置、设备及存储介质
EP3736677A1 (en) 2019-05-10 2020-11-11 MyScript A method and corresponding device for selecting and editing handwriting input elements
US11074408B2 (en) 2019-06-01 2021-07-27 Apple Inc. Mail application features
US11194467B2 (en) 2019-06-01 2021-12-07 Apple Inc. Keyboard management user interfaces
EP3754537B1 (en) 2019-06-20 2024-05-22 MyScript Processing text handwriting input in a free handwriting mode
EP3772015B1 (en) 2019-07-31 2023-11-08 MyScript Text line extraction
US10956727B1 (en) * 2019-09-11 2021-03-23 Sap Se Handwritten diagram recognition using deep learning models
EP3796145B1 (en) 2019-09-19 2024-07-03 MyScript A method and correspond device for selecting graphical objects
KR102815110B1 (ko) * 2019-11-19 2025-06-04 삼성전자주식회사 필기 입력을 텍스트로 변환하는 전자 장치 및 그 동작 방법
EP4130966B1 (en) 2019-11-29 2025-07-09 MyScript Gesture stroke recognition in touch-based user interface input
LU101615B1 (en) 2020-01-27 2021-08-11 Microsoft Technology Licensing Llc Systems and methods for handwriting recognition
CN112001236B (zh) * 2020-07-13 2024-09-10 上海心图智能科技有限公司 基于人工智能的书写行为的识别方法及装置
US11544948B2 (en) 2020-09-28 2023-01-03 Sap Se Converting handwritten diagrams to robotic process automation bots
CN112214192B (zh) * 2020-10-22 2023-08-04 深圳市皓丽智能科技有限公司 智能交互平板的操作方法、系统、计算机设备及存储介质
WO2022089043A1 (zh) 2020-10-30 2022-05-05 海信视像科技股份有限公司 显示设备、几何图形识别方法及多图层叠加显示方法
CN112181207B (zh) * 2020-10-30 2022-11-29 海信视像科技股份有限公司 一种显示设备及几何图形识别方法
US11733861B2 (en) * 2020-11-20 2023-08-22 Trimble Inc. Interpreting inputs for three-dimensional virtual spaces from touchscreen interface gestures to improve user interface functionality
US12002134B2 (en) * 2021-01-08 2024-06-04 PwC Product Sales LLC Automated flow chart generation and visualization system
US12118811B2 (en) 2021-01-28 2024-10-15 Samsung Electronics Co., Ltd. Electronic device and method for shape recognition based on stroke analysis in electronic device
EP4086744B1 (en) 2021-05-04 2024-02-21 MyScript Gesture stroke recognition in touch-based user interface input
KR20230009742A (ko) * 2021-07-09 2023-01-17 휴렛-팩커드 디벨롭먼트 컴퍼니, 엘.피. 필기 텍스트를 포함하는 문서에서의 텍스트 레이어 및 이미지 레이어의 편집
US11663761B2 (en) * 2021-08-25 2023-05-30 Sap Se Hand-drawn diagram recognition using visual arrow-relation detection
CN114153940B (zh) * 2021-10-29 2025-09-09 北京搜狗科技发展有限公司 文本匹配方法、装置、电子设备、介质及程序产品
CN114407555B (zh) * 2022-02-07 2022-12-09 南京林业大学 一种便于修改的经管教学用思维导图工具
CN116719459A (zh) * 2022-09-26 2023-09-08 荣耀终端有限公司 批注框的显示方法、电子设备及可读存储介质
US12001671B2 (en) * 2022-10-31 2024-06-04 Optoma Corporation Electronic whiteboard system and operation method thereof
US20250328233A1 (en) * 2022-11-30 2025-10-23 Beijing Boe Technology Development Co., Ltd. Smart handwriting display device, smart handwriting display method, and electronic device
CN117611363B (zh) * 2023-10-25 2024-07-09 浙江爱信诺航天信息技术有限公司 凭证在线校验方法及介质

Family Cites Families (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2749020B2 (ja) 1991-11-14 1998-05-13 日立ソフトウエアエンジニアリング株式会社 ダイアグラム認識システム
DE69428675T2 (de) 1993-12-30 2002-05-08 Xerox Corp Apparat und Verfahren zur Unterstützung einer impliziten Strukturation von Freiform-Listen, Übersichten, Texten, Tabellen und Diagrammen in einem auf Handzeichen basierenden Eingabesystem und Editiersystem
US5847712A (en) * 1995-01-03 1998-12-08 University Of Washington Method and system for generating graphic illustrations according to a stroke texture and a tone
JPH096922A (ja) * 1995-06-20 1997-01-10 Sony Corp 手書き文字認識装置
GB9701793D0 (en) * 1997-01-29 1997-03-19 Gay Geoffrey N W Means for inputting characters or commands into a computer
AU5299700A (en) * 1999-05-27 2000-12-18 America Online, Inc. Keyboard system with automatic correction
US7298903B2 (en) * 2001-06-28 2007-11-20 Microsoft Corporation Method and system for separating text and drawings in digital ink
US7039862B2 (en) * 2002-05-10 2006-05-02 Adobe Systems Incorporated Text spacing adjustment
US20030215145A1 (en) 2002-05-14 2003-11-20 Microsoft Corporation Classification analysis of freeform digital ink input
US7330184B2 (en) 2002-06-12 2008-02-12 Smart Technologies Ulc System and method for recognizing connector gestures
US7218779B2 (en) * 2003-01-21 2007-05-15 Microsoft Corporation Ink divider and associated application program interface
US7218783B2 (en) * 2003-06-13 2007-05-15 Microsoft Corporation Digital ink annotation process and system for recognizing, anchoring and reflowing digital ink annotations
US7631001B2 (en) 2003-08-21 2009-12-08 Microsoft Corporation Electronic ink processing
US7616333B2 (en) 2003-08-21 2009-11-10 Microsoft Corporation Electronic ink processing and application programming interfaces
US7324691B2 (en) 2003-09-24 2008-01-29 Microsoft Corporation System and method for shape recognition of hand-drawn objects
US7352902B2 (en) 2003-09-24 2008-04-01 Microsoft Corporation System and method for detecting a hand-drawn object in ink input
US20050273761A1 (en) 2004-06-07 2005-12-08 The Mathworks, Inc. Freehand system and method for creating, editing, and manipulating block diagrams
US7496232B2 (en) 2004-06-23 2009-02-24 Microsoft Corporation Distinguishing text from non-text in digital ink
US7440616B2 (en) 2004-09-21 2008-10-21 Microsoft Corporation System and method for recognition of a hand-drawn chart in ink input
US7394935B2 (en) 2004-09-21 2008-07-01 Microsoft Corporation System and method for editing a hand-drawn chart in ink input
US7904810B2 (en) 2004-09-21 2011-03-08 Microsoft Corporation System and method for editing a hand-drawn list in ink input
US7512273B2 (en) * 2004-10-21 2009-03-31 Microsoft Corporation Digital ink labeling
US7643687B2 (en) * 2005-03-18 2010-01-05 Microsoft Corporation Analysis hints
EP1783593A3 (en) * 2005-10-07 2012-12-19 Sony Corporation Information processing apparatus with a user interface comprising a touch panel, method and program
JP2007272473A (ja) * 2006-03-30 2007-10-18 Toshiba Corp 文字認識装置、方法およびプログラム
US20080195931A1 (en) * 2006-10-27 2008-08-14 Microsoft Corporation Parsing of ink annotations
US8014607B2 (en) * 2007-03-23 2011-09-06 Palo Alto Research Center Incorporated Method and apparatus for creating and editing node-link diagrams in pen computing systems
US7945097B2 (en) 2007-05-21 2011-05-17 Microsoft Corporation Classifying digital ink into a writing or a drawing
US10380241B2 (en) * 2010-05-26 2019-08-13 Warren Daniel Child Modular system and method for managing chinese, japanese, and korean linguistic data in electronic form
US8593418B2 (en) * 2010-08-08 2013-11-26 Qualcomm Incorporated Method and system for adjusting display content
US8718375B2 (en) 2010-12-03 2014-05-06 Massachusetts Institute Of Technology Sketch recognition system
US9489121B2 (en) * 2011-11-02 2016-11-08 Microsoft Technology Licensing, Llc Optimal display and zoom of objects and text in a document
US8782549B2 (en) * 2012-10-05 2014-07-15 Google Inc. Incremental feature-based gesture-keyboard decoding
US20140160032A1 (en) * 2012-12-07 2014-06-12 Microsoft Corporation Swipe Stroke Input and Continuous Handwriting
US9171204B2 (en) * 2012-12-12 2015-10-27 Qualcomm Incorporated Method of perspective correction for devanagari text
ITRM20130022A1 (it) * 2013-01-11 2014-07-12 Natural Intelligent Technologies S R L Procedimento e apparato di riconoscimento di scrittura a mano
JPWO2014147722A1 (ja) * 2013-03-18 2017-02-16 株式会社東芝 電子機器、方法及びプログラム
US20140313216A1 (en) 2013-04-18 2014-10-23 Baldur Andrew Steingrimsson Recognition and Representation of Image Sketches
KR102183448B1 (ko) * 2013-04-26 2020-11-26 삼성전자주식회사 사용자 단말 장치 및 그 디스플레이 방법
KR102199193B1 (ko) * 2014-01-22 2021-01-06 삼성전자주식회사 핸드라이팅 정보 운용 방법 및 이를 지원하는 전자 장치
US20170068868A1 (en) * 2015-09-09 2017-03-09 Google Inc. Enhancing handwriting recognition using pre-filter classification
US10643067B2 (en) * 2015-10-19 2020-05-05 Myscript System and method of handwriting recognition in diagrams

Also Published As

Publication number Publication date
KR20180097519A (ko) 2018-08-31
US10643067B2 (en) 2020-05-05
KR102396224B1 (ko) 2022-05-09
CN108834426B (zh) 2021-12-07
JP2018536927A (ja) 2018-12-13
CN108834426A (zh) 2018-11-16
US20210034860A1 (en) 2021-02-04
EP3365764A1 (en) 2018-08-29
EP3365764B1 (en) 2022-08-03
US11157732B2 (en) 2021-10-26
WO2017067652A1 (en) 2017-04-27
US20170109578A1 (en) 2017-04-20

Similar Documents

Publication Publication Date Title
JP6945527B2 (ja) 図における手書き認識のシステム及び方法
US11740783B2 (en) System and method of guiding handwriting diagram input
JP7046806B2 (ja) ジェスチャを用いたノートテイキングのための装置および方法
JP6820919B2 (ja) 手書きされた図コネクタの認識のためのシステム及び方法
US20180114059A1 (en) System and method for managing digital ink typesetting
EP3555736B1 (en) System and method for management of handwritten diagram connectors
US11429259B2 (en) System and method for selecting and editing handwriting input elements
US20240134507A1 (en) Modifying digital content including typed and handwritten text
WO2018109084A1 (en) System and method for management of handwritten diagram connectors

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20191017

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20191017

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20201126

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20201208

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210302

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210406

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210701

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20210817

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20210914

R150 Certificate of patent or registration of utility model

Ref document number: 6945527

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250