WO2023166328A3 - Augmented documentation through computer vision detection, alignment, and application of paper markup to digital maps and forms - Google Patents

Augmented documentation through computer vision detection, alignment, and application of paper markup to digital maps and forms Download PDF

Info

Publication number
WO2023166328A3
WO2023166328A3 PCT/IB2022/000793 IB2022000793W WO2023166328A3 WO 2023166328 A3 WO2023166328 A3 WO 2023166328A3 IB 2022000793 W IB2022000793 W IB 2022000793W WO 2023166328 A3 WO2023166328 A3 WO 2023166328A3
Authority
WO
WIPO (PCT)
Prior art keywords
markup
codes
alignment
coloring
computer vision
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2022/000793
Other languages
French (fr)
Other versions
WO2023166328A2 (en
Inventor
Matthew A. Molenda
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mofaip LLC
Original Assignee
Mofaip LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mofaip LLC filed Critical Mofaip LLC
Priority to GB2408005.3A priority Critical patent/GB2627661A/en
Priority to PCT/IB2023/000535 priority patent/WO2024023584A2/en
Priority to EP23845770.9A priority patent/EP4562645A4/en
Priority to US18/225,872 priority patent/US20230368878A1/en
Publication of WO2023166328A2 publication Critical patent/WO2023166328A2/en
Publication of WO2023166328A3 publication Critical patent/WO2023166328A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H10/00—ICT specially adapted for the handling or processing of patient-related medical or healthcare data
    • G16H10/60—ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/22—Character recognition characterised by the type of writing
    • G06V30/224—Character recognition characterised by the type of writing of printed characters having additional code marks or containing code marks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/40—Document-oriented image-based pattern recognition
    • G06V30/41—Analysis of document content
    • G06V30/412—Layout analysis of documents structured with printed lines or input boxes, e.g. business forms or tables
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/40—Document-oriented image-based pattern recognition
    • G06V30/41—Analysis of document content
    • G06V30/413—Classification of content, e.g. text, photographs or tables
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/40—Document-oriented image-based pattern recognition
    • G06V30/41—Analysis of document content
    • G06V30/414—Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H15/00—ICT specially adapted for medical reports, e.g. generation or transmission thereof
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/70—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • Medical Informatics (AREA)
  • Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Public Health (AREA)
  • General Physics & Mathematics (AREA)
  • Epidemiology (AREA)
  • Primary Health Care (AREA)
  • General Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Databases & Information Systems (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • User Interface Of Digital Computer (AREA)
  • Medical Treatment And Welfare Office Work (AREA)

Abstract

The present invention includes a method that applies computer vision to detect annotation, coloring, and markup performed on paper forms that may include diagrams, typed language, fields, codes such as QR codes, orientation markers, images, workflow initiators (such as checkboxes), form information such as a version number, and language indicators, all of which are also detected. The invention automatically detects, categorizes, aligns, and converts the detections to digital annotation, coloring, markup, and coordinates. The detected annotation, coloring (including intensity, shades, and patterns), and markup includes labels, pins, areas, regions, characters, symbols, shapes, drawings, text, handwriting, codes such as QR codes. The detections are all digitized and refined in alignment with coordinate normalization. Workflow initiators like checkboxes, when checked, may trigger a digital event like a refill on a medication.
PCT/IB2022/000793 2021-12-10 2022-12-12 Augmented documentation through computer vision detection, alignment, and application of paper markup to digital maps and forms Ceased WO2023166328A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
GB2408005.3A GB2627661A (en) 2021-12-10 2022-12-12 Augmented documentation through computer vision detection, alignment, and application of paper markup to digital maps and forms
PCT/IB2023/000535 WO2024023584A2 (en) 2022-07-26 2023-07-25 Systems and methods using multidimensional language and vision models and maps to categorize, describe, coordinate, and track anatomy and health data
EP23845770.9A EP4562645A4 (en) 2022-07-26 2023-07-25 SYSTEMS AND METHODS USING MULTI-DIMENSIONAL LANGUAGE AND VISUAL MODELS AND MAPS FOR CATEGORIZING, DESCRIPTING, COORDINATING AND TRACKING ANATOMY AND HEALTH DATA
US18/225,872 US20230368878A1 (en) 2021-12-10 2023-07-25 Systems and methods using multidimensional language and vision models and maps to categorize, describe, coordinate, and track anatomy and health data

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US202263315289P 2022-03-01 2022-03-01
US63/315,289 2022-03-01
US202263269516P 2022-03-17 2022-03-17
US63/269,516 2022-03-17
US202263362791P 2022-04-11 2022-04-11
US63/362,791 2022-04-11

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/225,872 Continuation-In-Part US20230368878A1 (en) 2021-12-10 2023-07-25 Systems and methods using multidimensional language and vision models and maps to categorize, describe, coordinate, and track anatomy and health data

Publications (2)

Publication Number Publication Date
WO2023166328A2 WO2023166328A2 (en) 2023-09-07
WO2023166328A3 true WO2023166328A3 (en) 2023-11-09

Family

ID=87883134

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2022/000793 Ceased WO2023166328A2 (en) 2021-12-10 2022-12-12 Augmented documentation through computer vision detection, alignment, and application of paper markup to digital maps and forms

Country Status (1)

Country Link
WO (1) WO2023166328A2 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118230333B (en) * 2024-05-23 2024-07-26 安徽安天利信工程管理股份有限公司 OCR technology-based image preprocessing system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050027201A1 (en) * 2003-04-24 2005-02-03 Badilini Fabio F. Method and system for converting paper ECG printouts to digital ECG files
US20110082710A1 (en) * 2009-10-05 2011-04-07 Muthiah Subash Electronic medical record creation and retrieval system
US20150207948A1 (en) * 2014-01-20 2015-07-23 Fuji Xerox Co., Ltd Image processing apparatus, non-transitory computer readable medium, and image processing method
US20150261919A1 (en) * 2014-03-17 2015-09-17 Fuji Xerox Co., Ltd. Image processing apparatus, image processing method, and non-transitory computer readable medium
US20210004960A1 (en) * 2018-03-07 2021-01-07 Koninklijke Philips N.V. Display of medical image data
WO2021046536A1 (en) * 2019-09-06 2021-03-11 F. Hoffmann-La Roche Ag Automated information extraction and enrichment in pathology report using natural language processing
US20210326808A1 (en) * 2013-11-08 2021-10-21 Matthew A. Molenda Graphical generation and retrieval of medical records

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050027201A1 (en) * 2003-04-24 2005-02-03 Badilini Fabio F. Method and system for converting paper ECG printouts to digital ECG files
US20110082710A1 (en) * 2009-10-05 2011-04-07 Muthiah Subash Electronic medical record creation and retrieval system
US20210326808A1 (en) * 2013-11-08 2021-10-21 Matthew A. Molenda Graphical generation and retrieval of medical records
US20150207948A1 (en) * 2014-01-20 2015-07-23 Fuji Xerox Co., Ltd Image processing apparatus, non-transitory computer readable medium, and image processing method
US20150261919A1 (en) * 2014-03-17 2015-09-17 Fuji Xerox Co., Ltd. Image processing apparatus, image processing method, and non-transitory computer readable medium
US20210004960A1 (en) * 2018-03-07 2021-01-07 Koninklijke Philips N.V. Display of medical image data
WO2021046536A1 (en) * 2019-09-06 2021-03-11 F. Hoffmann-La Roche Ag Automated information extraction and enrichment in pathology report using natural language processing

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
SARCEVIC ALEKSANDRA, ROSEN BRETT, KULP LEAH, MARSIC IVAN, BURD RANDALL: "Design Challenges in Converting a Paper Checklist to Digital Format for Dynamic Medical Settings", PROCEEDINGS OF THE 10TH EAI INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING TECHNOLOGIES FOR HEALTHCARE, 1 May 2016 (2016-05-01) - 19 May 2016 (2016-05-19), pages 1 - 18, XP093109408, ISBN: 978-1-63190-050-1, DOI: 10.4108/eai.16-5-2016.2263335 *

Also Published As

Publication number Publication date
WO2023166328A2 (en) 2023-09-07

Similar Documents

Publication Publication Date Title
US8300943B2 (en) Forms for completion with an electronic writing device
US7760191B2 (en) Handwriting regions keyed to a data receptor
US7120299B2 (en) Recognizing commands written onto a medium
EP2523075B1 (en) Information input apparatus, information input system, and information input method
TW375716B (en) Handwritten data input device having coordinate detection tablet
US20070273674A1 (en) Machine-differentiatable identifiers having a commonly accepted meaning
US8229252B2 (en) Electronic association of a user expression and a context of the expression
US20120110007A1 (en) Outputting a saved hand-formed expression
WO2009124200A3 (en) Ink tags in a smart pen computing system
WO2023166328A3 (en) Augmented documentation through computer vision detection, alignment, and application of paper markup to digital maps and forms
US20070248267A1 (en) Quantifying graphic features of handwriting for analysis
GB2627661A8 (en) Augmented documentation through computer vision detection, alignment, and application of paper markup to digital maps and forms
CN113936186A (en) A content identification method, apparatus, electronic device and readable storage medium
Xavier et al. Automatic detection and recognition of text in traffic sign boards based on word recognizer
EP1624400B1 (en) Pre-marked data recording form for opto-electronic reading
KR20230139449A (en) A recognizing method of assembled stamp using image feature analysis
ES2305472T3 (en) PRESENTATION OF RECOGNIZED HAND SYMBOLS.
JPS62159291A (en) Sentence input device
KR102854771B1 (en) Apparatus and method for labeling document images used in machine-learning of text detection and recognition
JP2014235087A (en) Entry sheet and electronic pen system
Yasin et al. Line and Ligature Segmentation for Nastaliq Script
Frutiger OCR-B: A standardized character for optical recognition
Nabeta et al. The similarity index of character shape of medicine names based on character shape similarity (ii)
Abdullah-Al-Mamun et al. Segment and Semi Circle Based Geometric Characters of Bangla and An Efficient Relevant Method of Character Recognition
JPS5894076A (en) Recognizer of handwritten character

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22929679

Country of ref document: EP

Kind code of ref document: A2

ENP Entry into the national phase

Ref document number: 202408005

Country of ref document: GB

Kind code of ref document: A

Free format text: PCT FILING DATE = 20221212

WWE Wipo information: entry into national phase

Ref document number: 2408005.3

Country of ref document: GB

WWP Wipo information: published in national office

Ref document number: 2408005.3

Country of ref document: GB

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22929679

Country of ref document: EP

Kind code of ref document: A2