CA2862071C - Automated pharmaceutical pill identification - Google Patents

Automated pharmaceutical pill identification Download PDF

Info

Publication number
CA2862071C
CA2862071C CA2862071A CA2862071A CA2862071C CA 2862071 C CA2862071 C CA 2862071C CA 2862071 A CA2862071 A CA 2862071A CA 2862071 A CA2862071 A CA 2862071A CA 2862071 C CA2862071 C CA 2862071C
Authority
CA
Canada
Prior art keywords
image
pill
features
pharmaceutical composition
computer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CA2862071A
Other languages
English (en)
French (fr)
Other versions
CA2862071A1 (en
Inventor
Eugene Gershtein
Alan Jacobs
Alexander GEBALA
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Interlink AI Inc
Original Assignee
Perceptimed Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Perceptimed Inc filed Critical Perceptimed Inc
Publication of CA2862071A1 publication Critical patent/CA2862071A1/en
Application granted granted Critical
Publication of CA2862071C publication Critical patent/CA2862071C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/22—Matching criteria, e.g. proximity measures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/60—Rotation of whole images or parts thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/66—Trinkets, e.g. shirt buttons or jewellery items
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/24—Character recognition characterised by the processing or recognition method
    • G06V30/248—Character recognition characterised by the processing or recognition method involving plural approaches, e.g. verification by template match; Resolving confusion among similar patterns, e.g. "O" versus "Q"
    • G06V30/2528—Combination of methods, e.g. classifiers, working on the same input data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/24—Character recognition characterised by the processing or recognition method
    • G06V30/248—Character recognition characterised by the processing or recognition method involving plural approaches, e.g. verification by template match; Resolving confusion among similar patterns, e.g. "O" versus "Q"
    • G06V30/2552—Combination of methods, e.g. classifiers, working on different input data, e.g. sensor fusion

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Image Analysis (AREA)
  • Medical Preparation Storing Or Oral Administration Devices (AREA)
  • Image Processing (AREA)
  • Medical Treatment And Welfare Office Work (AREA)
CA2862071A 2012-01-23 2013-01-23 Automated pharmaceutical pill identification Active CA2862071C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201261589750P 2012-01-23 2012-01-23
US61/589,750 2012-01-23
PCT/US2013/022754 WO2013112591A1 (en) 2012-01-23 2013-01-23 Automated pharmaceutical pill identification

Publications (2)

Publication Number Publication Date
CA2862071A1 CA2862071A1 (en) 2013-08-01
CA2862071C true CA2862071C (en) 2019-01-08

Family

ID=48873866

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2862071A Active CA2862071C (en) 2012-01-23 2013-01-23 Automated pharmaceutical pill identification

Country Status (9)

Country Link
US (3) US9842257B2 (enExample)
EP (1) EP2807610A4 (enExample)
JP (2) JP6154826B2 (enExample)
CN (1) CN104205128B (enExample)
AU (2) AU2013212273B2 (enExample)
BR (1) BR112014018171A8 (enExample)
CA (1) CA2862071C (enExample)
HK (2) HK1205315A1 (enExample)
WO (1) WO2013112591A1 (enExample)

Families Citing this family (55)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9111357B2 (en) * 2012-06-07 2015-08-18 Medsnap, Llc System and method of pill identification
BR112015003970A2 (pt) 2012-08-24 2017-07-04 Perceptimed Inc sistema de verificação de ponto de venda
JP2016527060A (ja) 2013-08-09 2016-09-08 パーセプティメッド インコーポレイテッドＰｅｒｃｅｐｔｉｍｅｄ， Ｉｎｃ． 遠隔医薬検証
US9940439B2 (en) * 2013-11-29 2018-04-10 Atabak Reza Royaee Method and device for identification and/or sorting of medicines
US9842281B2 (en) * 2014-06-05 2017-12-12 Xerox Corporation System for automated text and halftone segmentation
JP6422250B2 (ja) * 2014-07-08 2018-11-14 キヤノン株式会社 画像処理方法、画像処理装置、プログラム及び記録媒体
US10489555B2 (en) * 2014-07-21 2019-11-26 Qualanex, Llc Medication processing kiosk
US12290842B2 (en) 2015-07-16 2025-05-06 Sortera Technologies, Inc. Sorting of dark colored and black plastics
US12280404B2 (en) 2015-07-16 2025-04-22 Sortera Technologies, Inc. Sorting based on chemical composition
US12017255B2 (en) 2015-07-16 2024-06-25 Sortera Technologies, Inc. Sorting based on chemical composition
US12208421B2 (en) 2015-07-16 2025-01-28 Sortera Technologies, Inc. Metal separation in a scrap yard
US12403505B2 (en) 2015-07-16 2025-09-02 Sortera Technologies, Inc. Sorting of aluminum alloys
US12246355B2 (en) 2015-07-16 2025-03-11 Sortera Technologies, Inc. Sorting of Zorba
US11278937B2 (en) 2015-07-16 2022-03-22 Sortera Alloys, Inc. Multiple stage sorting
US11969764B2 (en) 2016-07-18 2024-04-30 Sortera Technologies, Inc. Sorting of plastics
US11964304B2 (en) 2015-07-16 2024-04-23 Sortera Technologies, Inc. Sorting between metal alloys
US12103045B2 (en) 2015-07-16 2024-10-01 Sortera Technologies, Inc. Removing airbag modules from automotive scrap
US12194506B2 (en) 2015-07-16 2025-01-14 Sortera Technologies, Inc. Sorting of contaminants
US10255524B2 (en) * 2016-06-03 2019-04-09 Becton Dickinson Rowa Germany Gmbh Method for providing a singling device of a storage and dispensing container
CA2933860C (fr) * 2016-06-23 2017-08-29 Matthieu Grosfils Systemes et equipements permettant de controler le contenu d'un ou des compartiment(s) d'un distributeur de medicaments, methode de fabrication des systemes et equipements et methode d'utilisation correspondantes
CN106355574B (zh) * 2016-08-31 2018-11-16 上海交通大学 一种基于深度学习的腹内脂肪分割方法
IL248641A0 (en) * 2016-10-31 2017-02-28 Rafael Advanced Defense Systems Ltd A system and method for testing and classifying discrete objects
JP6751684B2 (ja) * 2017-03-28 2020-09-09 株式会社Ｎｔｔドコモ 類似画像検索装置
CN110622042A (zh) * 2017-05-10 2019-12-27 日本电气株式会社 分析设备、地层断代设备、分析方法、地层断代方法和程序
WO2019003972A1 (ja) * 2017-06-28 2019-01-03 日本電気株式会社 服薬管理システム、服薬管理方法、管理装置およびプログラム記憶媒体
CA3068306A1 (en) 2017-06-28 2019-01-03 Perceptimed, Inc. Inventory management
WO2019209428A1 (en) * 2018-04-26 2019-10-31 UHV Technologies, Inc. Recycling coins from scrap
TWI831775B (zh) * 2018-06-19 2024-02-11 日商湯山製作所股份有限公司 藥劑分類裝置
US10699162B2 (en) * 2018-07-30 2020-06-30 Mackay Memorial Hospital Method and system for sorting and identifying medication via its label and/or package
US10872688B2 (en) * 2018-07-30 2020-12-22 Arxium, Inc. Visual analysis pill dispenser
JP7068596B2 (ja) * 2018-08-15 2022-05-17 日本電信電話株式会社 学習データ作成装置、学習データ作成方法、及びプログラム
JP7215485B2 (ja) * 2018-08-23 2023-01-31 日本電気株式会社 物体照合装置
JP7177917B2 (ja) * 2018-09-20 2022-11-24 シーメンス・ヘルスケア・ダイアグノスティックス・インコーポレイテッド 視覚化分析装置および視覚的学習方法
WO2020081668A2 (en) * 2018-10-19 2020-04-23 Genentech, Inc. Defect detection in lyophilized drug products with convolutional neural networks
CN109978018A (zh) * 2019-03-06 2019-07-05 颐保医疗科技(上海)有限公司 一种中药材人工智能鉴别系统及其鉴别方法
CN109934277B (zh) * 2019-03-06 2023-05-12 颐保医疗科技(上海)有限公司 一种基于人工智能的中药材采收时间的鉴别方法
CN110111868A (zh) * 2019-04-19 2019-08-09 无锡市第九人民医院 一种裸药药片信息采集装置及方法
US11195270B2 (en) 2019-07-19 2021-12-07 Becton Dickinson Rowa Germany Gmbh Measuring and verifying drug portions
EP3767531A1 (de) * 2019-07-19 2021-01-20 Becton Dickinson Rowa Germany GmbH Verfahren zum vermessen und verifizieren von arzneimittelportionen sowie computerprogrammprodukte
US11145397B1 (en) * 2020-01-31 2021-10-12 Express Scripts Strategie Development, Inc. System and method for augmented reality detection of loose pharmacy items
US20210374762A1 (en) 2020-05-29 2021-12-02 Cvs Pharmacy, Inc. System and Method for Virtual Verification in Pharmacy Workflow
KR102607174B1 (ko) * 2020-11-17 2023-11-28 주식회사 메딜리티 이미지 분석 서버를 이용한 복수 개의 이미지에 포함된 객체의 카운팅 방법 및 객체 카운팅 시스템
JP7474546B2 (ja) * 2020-11-17 2024-04-25 メディリティ インク イメージ分析サーバー、イメージ分析サーバーを用いたオブジェクトカウント方法、及びオブジェクトカウントシステム
WO2022109401A1 (en) 2020-11-20 2022-05-27 Steinhauser Michael K Medication adherence system
KR102576853B1 (ko) * 2021-01-08 2023-09-08 주식회사 센다코리아 알약 계수 이미지 프로세싱 방법
EP4295308A4 (en) * 2021-02-18 2025-01-08 Parata Systems, LLC Methods, systems, and computer program product for validating drug product package contents based on characteristics of the drug product packaging system
US12272044B2 (en) 2021-04-07 2025-04-08 Optum, Inc. Production line conformance measurement techniques using categorical validation machine learning models
KR20220167613A (ko) * 2021-06-14 2022-12-21 (주)제이브이엠 약포 검사 시스템
US12036185B2 (en) 2021-07-19 2024-07-16 Optum, Inc. System and method to count pills
JP2023088057A (ja) * 2021-12-14 2023-06-26 沖電気工業株式会社 薬剤鑑別装置、薬剤鑑別システム、および薬剤鑑別方法
CN114871120B (zh) * 2022-05-26 2023-11-07 江苏省徐州医药高等职业学校 基于图像数据处理的药品确定分拣方法及装置
CN115273053B (zh) * 2022-09-28 2022-12-20 江苏南通鼎顺网络科技有限责任公司 一种基于数据处理的药物崩解性能识别方法
US20240386444A1 (en) * 2023-04-17 2024-11-21 Synergie Medicale Brg Inc. Methods, systems, and computer program product for validating a drug product while being held by a drug product packaging system prior to packaging
US20250005899A1 (en) * 2023-06-29 2025-01-02 Optum, Inc. Systems and methods for pill identification based on image and user claims data
CN119723559B (zh) * 2024-10-31 2025-12-05 四川大学 一种组合药丸分级识别方法

Family Cites Families (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5363968A (en) 1991-08-23 1994-11-15 Pfizer Inc. Automatic blister inspection system
US5502944A (en) 1993-12-03 1996-04-02 Owen Healthcare, Inc. Medication dispenser system
US5700998A (en) 1995-10-31 1997-12-23 Palti; Yoram Drug coding and delivery system
US6631364B1 (en) * 1997-03-26 2003-10-07 National Research Council Of Canada Method of searching 3-Dimensional images
US6535637B1 (en) 1997-04-04 2003-03-18 Esco Electronics, Inc. Pharmaceutical pill recognition and verification system
JP2001312725A (ja) 2000-04-28 2001-11-09 Minolta Co Ltd 画像処理装置および画像処理方法
US20020188466A1 (en) 2001-04-18 2002-12-12 Barrette Pierre Philip Secure digital medical intellectual property (IP) distribution, market applications, and mobile devices
EP1389083A2 (en) 2001-05-15 2004-02-18 E-Medication ApS A medicine dispenser
US6735329B2 (en) 2001-05-18 2004-05-11 Leonard S. Schultz Methods and apparatus for image recognition and dictation
US6640008B1 (en) 2001-06-29 2003-10-28 Shih-Jong J. Lee Rotation and scale invariant pattern matching method
US6771369B2 (en) 2002-03-12 2004-08-03 Analytical Spectral Devices, Inc. System and method for pharmacy validation and inspection
JP2004288170A (ja) 2003-03-05 2004-10-14 Olympus Corp 三次元モデル検索方法及びシステム
CN100375121C (zh) 2003-07-17 2008-03-12 松下电器产业株式会社 虹彩码生成方法、个人认证方法、虹彩码注册装置、个人认证装置
US7028723B1 (en) 2003-11-03 2006-04-18 Alouani Ali Tahar Apparatus and method for automatic prescription verification
US7348884B2 (en) 2004-07-29 2008-03-25 Omnicell, Inc. RFID cabinet
US8121392B2 (en) 2004-10-25 2012-02-21 Parata Systems, Llc Embedded imaging and control system
US7930064B2 (en) 2004-11-19 2011-04-19 Parata Systems, Llc Automated drug discrimination during dispensing
EP2960830B1 (en) * 2005-09-05 2018-07-04 Alpvision SA Means for using microstructure of materials surface as a unique identifier
US7756313B2 (en) 2005-11-14 2010-07-13 Siemens Medical Solutions Usa, Inc. System and method for computer aided detection via asymmetric cascade of sparse linear classifiers
US7844084B2 (en) 2006-02-27 2010-11-30 Donald Martin Monro Rotation compensated iris comparison
US9031853B2 (en) 2006-05-06 2015-05-12 Irody, Inc. Apparatus and method for obtaining an identification of drugs for enhanced safety
US8616393B2 (en) 2006-06-12 2013-12-31 Becton, Dickinson And Company Medication delivery control systems and methods
US8727208B2 (en) 2006-06-30 2014-05-20 Intel-Ge Care Innovations Llc Method for identifying pills via an optical device
US7899253B2 (en) 2006-09-08 2011-03-01 Mitsubishi Electric Research Laboratories, Inc. Detecting moving objects in video by classifying on riemannian manifolds
US8060249B2 (en) 2006-11-22 2011-11-15 Senticare Inc. Medication dispenser with integrated monitoring system
US8065035B2 (en) 2007-05-02 2011-11-22 Carefusion 303, Inc. Automated medication handling system
US20090012818A1 (en) 2007-07-06 2009-01-08 Valence Broadband, Inc. Dispensing medication and verifying proper medication use
US8448846B2 (en) 2007-11-18 2013-05-28 Intel-Ge Care Innovations Llc Medication recording device
US8311344B2 (en) * 2008-02-15 2012-11-13 Digitalsmiths, Inc. Systems and methods for semantically classifying shots in video
CN101539991B (zh) 2008-03-20 2011-07-06 中国科学院自动化研究所 用于虹膜识别的有效图像区域检测和分割方法
US8055081B2 (en) 2008-04-14 2011-11-08 Eastman Kodak Company Image classification using capture-location-sequence information
US8155887B2 (en) 2008-08-14 2012-04-10 Srr Patent Holdings, Llc Computer visualized drug interaction information retrieval
US8135171B2 (en) 2008-08-19 2012-03-13 Au Optronics Corp. Multipoint tracking method and related device
US20110262536A1 (en) * 2008-12-23 2011-10-27 Alpvision S.A. Method to authenticate genuine tablets manufactured by compressing powder
US20100182615A1 (en) * 2009-01-21 2010-07-22 Kabushiki Kaisha Toshiba Image forming apparatus and control method of the same
EP2382617A1 (en) * 2010-01-19 2011-11-02 Pixar Selective diffusion of filtered edges in images
CN107095792A (zh) * 2010-03-09 2017-08-29 破赛普提医药有限公司 药物验证和分配
JP2011233650A (ja) 2010-04-26 2011-11-17 Toshiba Corp 半導体発光装置
US8861816B2 (en) * 2011-12-05 2014-10-14 Illinois Tool Works Inc. Method and apparatus for prescription medication verification
US9111357B2 (en) * 2012-06-07 2015-08-18 Medsnap, Llc System and method of pill identification

Also Published As

Publication number Publication date
US20190258860A1 (en) 2019-08-22
CN104205128A (zh) 2014-12-10
BR112014018171A8 (pt) 2017-07-11
JP2017199388A (ja) 2017-11-02
WO2013112591A1 (en) 2013-08-01
HK1204819A1 (en) 2015-12-04
AU2018204543A1 (en) 2018-07-12
US10229321B2 (en) 2019-03-12
HK1205315A1 (en) 2015-12-11
CA2862071A1 (en) 2013-08-01
EP2807610A4 (en) 2016-03-02
US9842257B2 (en) 2017-12-12
AU2018204543B2 (en) 2019-12-19
EP2807610A1 (en) 2014-12-03
JP6154826B2 (ja) 2017-06-28
CN104205128B (zh) 2018-02-16
JP6409094B2 (ja) 2018-10-17
AU2013212273B2 (en) 2018-07-19
US20150302255A1 (en) 2015-10-22
US10467477B2 (en) 2019-11-05
AU2013212273A1 (en) 2014-08-14
BR112014018171A2 (enExample) 2017-06-20
US20180046862A1 (en) 2018-02-15
JP2015512075A (ja) 2015-04-23

Similar Documents

Publication Publication Date Title
US10467477B2 (en) Automated pharmaceutical pill identification
Caban et al. Automatic identification of prescription drugs using shape distribution models
KR101744123B1 (ko) 의약품 식별 장치 및 그 방법
US20140355849A1 (en) System and method of using imprint analysis in pill identification
CN110781709A (zh) 经由药物包装及/或标签以分类及辨识该药物的方法及系统
CN116310421A (zh) 一种医院药房智能配药系统
US20210298994A1 (en) Method of monitoring medication regimen with portable apparatus
CN118552158B (zh) 中药材料数据处理方法及系统
Suksawatchon et al. Shape recognition using unconstrained pill images based on deep convolution network
Proma et al. Medicine recognition from colors and text
US20190244383A1 (en) Apparatus and method for object recognition
US20240346800A1 (en) Tag identification
Ponte et al. Automatic pill identification system based on deep learning and image preprocessing
Hartl et al. Instant medical pill recognition on mobile phones
CN119723559B (zh) 一种组合药丸分级识别方法
Guo et al. Color Feature-based Pillbox Image Color Recognition.
US11817207B1 (en) Medication inventory system including image based boundary determination for generating a medication tray stocking list and related methods
Pereira et al. Development and validation of a digital image processing-based pill detection tool for an oral medication self-monitoring system
TWI695347B (zh) 經由藥物包裝及/或標籤以分類及辨識該藥物的方法及系統
KR20150053075A (ko) 객체 확인 시스템
Chantasitiporn et al. Medicine Tablets Identification Using Feature Extraction Based on Neutral Network
Joshi et al. Automatic Pill Identifier An Overview On Identifying, Retrieving And Authenticating Drug-Pill
Chan Criminal and victim identification based on soft biometrics
Karakurt Classification of Hand Images Using Geometric Features

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20171122