CN111312355A - 智能药物辨识系统 - Google Patents

智能药物辨识系统 Download PDF

Info

Publication number
CN111312355A
CN111312355A CN201910529973.7A CN201910529973A CN111312355A CN 111312355 A CN111312355 A CN 111312355A CN 201910529973 A CN201910529973 A CN 201910529973A CN 111312355 A CN111312355 A CN 111312355A
Authority
CN
China
Prior art keywords
module
electrically connected
medicine
identification
processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910529973.7A
Other languages
English (en)
Other versions
CN111312355B (zh
Inventor
张万荣
陈良弼
许家豪
颜宜德
邱致诚
杨子进
林晁旸
林承沛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Southern Taiwan University of Science and Technology
Original Assignee
Southern Taiwan University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Southern Taiwan University of Science and Technology filed Critical Southern Taiwan University of Science and Technology
Publication of CN111312355A publication Critical patent/CN111312355A/zh
Application granted granted Critical
Publication of CN111312355B publication Critical patent/CN111312355B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/10—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to drugs or medications, e.g. for ensuring correct administration to patients
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61J—CONTAINERS SPECIALLY ADAPTED FOR MEDICAL OR PHARMACEUTICAL PURPOSES; DEVICES OR METHODS SPECIALLY ADAPTED FOR BRINGING PHARMACEUTICAL PRODUCTS INTO PARTICULAR PHYSICAL OR ADMINISTERING FORMS; DEVICES FOR ADMINISTERING FOOD OR MEDICINES ORALLY; BABY COMFORTERS; DEVICES FOR RECEIVING SPITTLE
    • A61J1/00—Containers specially adapted for medical or pharmaceutical purposes
    • A61J1/03—Containers specially adapted for medical or pharmaceutical purposes for pills or tablets
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61J—CONTAINERS SPECIALLY ADAPTED FOR MEDICAL OR PHARMACEUTICAL PURPOSES; DEVICES OR METHODS SPECIALLY ADAPTED FOR BRINGING PHARMACEUTICAL PRODUCTS INTO PARTICULAR PHYSICAL OR ADMINISTERING FORMS; DEVICES FOR ADMINISTERING FOOD OR MEDICINES ORALLY; BABY COMFORTERS; DEVICES FOR RECEIVING SPITTLE
    • A61J1/00—Containers specially adapted for medical or pharmaceutical purposes
    • A61J1/05—Containers specially adapted for medical or pharmaceutical purposes for collecting, storing or administering blood, plasma or medical fluids ; Infusion or perfusion containers
    • A61J1/10—Bag-type containers
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61J—CONTAINERS SPECIALLY ADAPTED FOR MEDICAL OR PHARMACEUTICAL PURPOSES; DEVICES OR METHODS SPECIALLY ADAPTED FOR BRINGING PHARMACEUTICAL PRODUCTS INTO PARTICULAR PHYSICAL OR ADMINISTERING FORMS; DEVICES FOR ADMINISTERING FOOD OR MEDICINES ORALLY; BABY COMFORTERS; DEVICES FOR RECEIVING SPITTLE
    • A61J7/00—Devices for administering medicines orally, e.g. spoons; Pill counting devices; Arrangements for time indication or reminder for taking medicine
    • A61J7/04—Arrangements for time indication or reminder for taking medicine, e.g. programmed dispensers
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61J—CONTAINERS SPECIALLY ADAPTED FOR MEDICAL OR PHARMACEUTICAL PURPOSES; DEVICES OR METHODS SPECIALLY ADAPTED FOR BRINGING PHARMACEUTICAL PRODUCTS INTO PARTICULAR PHYSICAL OR ADMINISTERING FORMS; DEVICES FOR ADMINISTERING FOOD OR MEDICINES ORALLY; BABY COMFORTERS; DEVICES FOR RECEIVING SPITTLE
    • A61J7/00—Devices for administering medicines orally, e.g. spoons; Pill counting devices; Arrangements for time indication or reminder for taking medicine
    • A61J7/04—Arrangements for time indication or reminder for taking medicine, e.g. programmed dispensers
    • A61J7/0409—Arrangements for time indication or reminder for taking medicine, e.g. programmed dispensers with timers
    • A61J7/0418—Arrangements for time indication or reminder for taking medicine, e.g. programmed dispensers with timers with electronic history memory
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61J—CONTAINERS SPECIALLY ADAPTED FOR MEDICAL OR PHARMACEUTICAL PURPOSES; DEVICES OR METHODS SPECIALLY ADAPTED FOR BRINGING PHARMACEUTICAL PRODUCTS INTO PARTICULAR PHYSICAL OR ADMINISTERING FORMS; DEVICES FOR ADMINISTERING FOOD OR MEDICINES ORALLY; BABY COMFORTERS; DEVICES FOR RECEIVING SPITTLE
    • A61J7/00—Devices for administering medicines orally, e.g. spoons; Pill counting devices; Arrangements for time indication or reminder for taking medicine
    • A61J7/04—Arrangements for time indication or reminder for taking medicine, e.g. programmed dispensers
    • A61J7/0409—Arrangements for time indication or reminder for taking medicine, e.g. programmed dispensers with timers
    • A61J7/0454—Arrangements for time indication or reminder for taking medicine, e.g. programmed dispensers with timers for dispensing of multiple drugs
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61J—CONTAINERS SPECIALLY ADAPTED FOR MEDICAL OR PHARMACEUTICAL PURPOSES; DEVICES OR METHODS SPECIALLY ADAPTED FOR BRINGING PHARMACEUTICAL PRODUCTS INTO PARTICULAR PHYSICAL OR ADMINISTERING FORMS; DEVICES FOR ADMINISTERING FOOD OR MEDICINES ORALLY; BABY COMFORTERS; DEVICES FOR RECEIVING SPITTLE
    • A61J7/00—Devices for administering medicines orally, e.g. spoons; Pill counting devices; Arrangements for time indication or reminder for taking medicine
    • A61J7/04—Arrangements for time indication or reminder for taking medicine, e.g. programmed dispensers
    • A61J7/0409—Arrangements for time indication or reminder for taking medicine, e.g. programmed dispensers with timers
    • A61J7/0481—Arrangements for time indication or reminder for taking medicine, e.g. programmed dispensers with timers working on a schedule basis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K17/00—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
    • G06K17/0022—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisious for transferring data to distant stations, e.g. from a sensing device
    • G06K17/0029—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisious for transferring data to distant stations, e.g. from a sensing device the arrangement being specially adapted for wireless interrogation of grouped or bundled articles tagged with wireless record carriers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/751—Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/30—Scenes; Scene-specific elements in albums, collections or shared content, e.g. social network photos or video
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/66—Trinkets, e.g. shirt buttons or jewellery items
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/19—Recognition using electronic means
    • G06V30/191—Design or setup of recognition systems or techniques; Extraction of features in feature space; Clustering techniques; Blind source separation
    • G06V30/19173—Classification techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/24—Character recognition characterised by the processing or recognition method
    • G06V30/248—Character recognition characterised by the processing or recognition method involving plural approaches, e.g. verification by template match; Resolving confusion among similar patterns, e.g. "O" versus "Q"
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H70/00—ICT specially adapted for the handling or processing of medical references
    • G16H70/40—ICT specially adapted for the handling or processing of medical references relating to drugs, e.g. their side effects or intended usage
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W12/00—Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/009—Security arrangements; Authentication; Protecting privacy or anonymity specially adapted for networks, e.g. wireless sensor networks, ad-hoc networks, RFID networks or cloud networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/12—Messaging; Mailboxes; Announcements
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61J—CONTAINERS SPECIALLY ADAPTED FOR MEDICAL OR PHARMACEUTICAL PURPOSES; DEVICES OR METHODS SPECIALLY ADAPTED FOR BRINGING PHARMACEUTICAL PRODUCTS INTO PARTICULAR PHYSICAL OR ADMINISTERING FORMS; DEVICES FOR ADMINISTERING FOOD OR MEDICINES ORALLY; BABY COMFORTERS; DEVICES FOR RECEIVING SPITTLE
    • A61J2200/00—General characteristics or adaptations
    • A61J2200/70—Device provided with specific sensor or indicating means
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61J—CONTAINERS SPECIALLY ADAPTED FOR MEDICAL OR PHARMACEUTICAL PURPOSES; DEVICES OR METHODS SPECIALLY ADAPTED FOR BRINGING PHARMACEUTICAL PRODUCTS INTO PARTICULAR PHYSICAL OR ADMINISTERING FORMS; DEVICES FOR ADMINISTERING FOOD OR MEDICINES ORALLY; BABY COMFORTERS; DEVICES FOR RECEIVING SPITTLE
    • A61J2205/00—General identification or selection means
    • A61J2205/10—Bar codes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61J—CONTAINERS SPECIALLY ADAPTED FOR MEDICAL OR PHARMACEUTICAL PURPOSES; DEVICES OR METHODS SPECIALLY ADAPTED FOR BRINGING PHARMACEUTICAL PRODUCTS INTO PARTICULAR PHYSICAL OR ADMINISTERING FORMS; DEVICES FOR ADMINISTERING FOOD OR MEDICINES ORALLY; BABY COMFORTERS; DEVICES FOR RECEIVING SPITTLE
    • A61J2205/00—General identification or selection means
    • A61J2205/50—General identification or selection means using icons or symbolic figures, e.g. by a graphical representation symbolising the type of pathology or the organ by an image
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61J—CONTAINERS SPECIALLY ADAPTED FOR MEDICAL OR PHARMACEUTICAL PURPOSES; DEVICES OR METHODS SPECIALLY ADAPTED FOR BRINGING PHARMACEUTICAL PRODUCTS INTO PARTICULAR PHYSICAL OR ADMINISTERING FORMS; DEVICES FOR ADMINISTERING FOOD OR MEDICINES ORALLY; BABY COMFORTERS; DEVICES FOR RECEIVING SPITTLE
    • A61J2205/00—General identification or selection means
    • A61J2205/60—General identification or selection means using magnetic or electronic identifications, e.g. chips, RFID, electronic tags
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61J—CONTAINERS SPECIALLY ADAPTED FOR MEDICAL OR PHARMACEUTICAL PURPOSES; DEVICES OR METHODS SPECIALLY ADAPTED FOR BRINGING PHARMACEUTICAL PRODUCTS INTO PARTICULAR PHYSICAL OR ADMINISTERING FORMS; DEVICES FOR ADMINISTERING FOOD OR MEDICINES ORALLY; BABY COMFORTERS; DEVICES FOR RECEIVING SPITTLE
    • A61J2205/00—General identification or selection means
    • A61J2205/70—Audible labels, e.g. for pre-recorded info or messages
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Medical Informatics (AREA)
  • Public Health (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Veterinary Medicine (AREA)
  • Animal Behavior & Ethology (AREA)
  • Multimedia (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Pharmacology & Pharmacy (AREA)
  • Computing Systems (AREA)
  • Evolutionary Computation (AREA)
  • Databases & Information Systems (AREA)
  • Artificial Intelligence (AREA)
  • Chemical & Material Sciences (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Medicinal Chemistry (AREA)
  • Software Systems (AREA)
  • Epidemiology (AREA)
  • Primary Health Care (AREA)
  • Hematology (AREA)
  • Toxicology (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Medical Treatment And Welfare Office Work (AREA)
  • Medical Preparation Storing Or Oral Administration Devices (AREA)

Abstract

本发明提供了一种智能药物辨识系统，该系统包含有一处理装置，包含有一第一处理模块、一电连接第一处理模块的扫描模块与一电连接第一处理模块的第一提醒模块；一云端储存装置，电连接处理装置，其包含有一储存模块与一与储存模块电连接的登录模块；以及一药物辨识装置，电连接处理装置与云端储存装置，其包含有一第二处理模块、一电连接第二处理模块的药物信息数据库、一电连接第二处理模块的图像辨识模块以及一电连接第二处理模块的第二提醒模块；藉此，本发明可记录使用者需服用的药物，并提醒使用者按时服用。

Description

智能药物辨识系统
技术领域
本发明关于一种智能药物辨识系统，尤其指一种可记录药袋上的药物信息，并针对每次使用者需服用的药物进行辨识的系统，让使用者能够服下正确的药物，且当服用药物的时间一到，本系统亦提供提醒的功能。
背景技术
当今全世界已迈进高龄化的社会，在全球75亿人口中，老年人口占了6亿人，其中多重慢性病患者就有3.4亿，根据世界卫生组织(WHO)统计老年人平均患有1.4种慢性病，其药物用量是一般人的5倍，老年人也因为生理机能衰退，药物种类繁多而导致吃错药的机率更为年轻人的7倍，另外世界卫生组织(WHO)也统计了全球三分之一的人死亡原因不是疾病本身而是不合理用药，而这些不合理用药相关的费用，一年更将近耗损5100亿元；所谓不合理用药包含有患者使用太多药物、未根据临床指南处方、不适当的自我药疗、不服用正确剂量等。
基于上述因不合理用药而导致死亡，市场上智能药盒推陈出新，如美国业者推出Pill Drill智能药盒，能帮助消费者方便收纳药物，同时具备提醒功能，提醒忘记吃药的人服用药物；中国台湾专利公告号I618534“智能型药物管理装置”即提供一种药物管理的装置，其能够在设定的时间一到，自动将药品置入药盒中，扬声器即会发出声响，声响经由壳体上的出声孔传出，同时，药盒上的发光件会同步发光，提醒使用者开启药盒取药以及服药，藉此，使用者即可按时服药。
中国台湾专利公告号M553633“智能药盒管理系统”，其具有一盒体，盒体内部的数个容置空间装有容器，于容器内可放置药物，而容置空间的底部可设置多个压力感测器，用以感测重量，根据各个压力感测器所测得各容器中的重量变化，去判断使用者是否已服药，且于设定的用药时间，警示模块可以通过闪灯或是发出声音等方式提醒用药者。然而，前述专利或是目前市面上的产品，皆无法辨识药物本身，由于慢性病患者药物种类繁多，分类上明显复杂，因此使用者容易疏忽而分错药，导致有服用不正确的药的可能性，严重时，可能会引发急性并发症等后果。
因此，如何提供一种有药物辨识的系统，并记录使用者应服用药物的信息，让使用者于用药时间到时，能够拿取正确的药物进行服用，避免使用者服用错误的药物而产生不适的病症。
发明内容
如今发明人即是鉴于上述现有的智能药盒于实际实施使用时仍具有多处缺失，于是乃一本孜孜不倦的精神，并藉由其丰富专业知识及多年的实务经验所辅佐，而加以改善，并据此研创出本发明。
本发明主要目的为提供一种智能药物辨识系统，其能够记录药袋上的药物信息，并于使用者服用药物前，辨识药物品项与剂量是否正确，以减少“不合理用药”情形的发生机率，且本发明辨识药物的成功率可达到将近100％，有效帮助使用者服用正确的药物。
为了达到上述实施目的，本发明一种智能药物辨识系统，其包含有：一处理装置，具有一第一处理模块、一电连接第一处理模块的扫描模块与一电连接第一处理模块的第一提醒模块；一云端储存装置，电连接处理装置，其具有一储存模块、一电连接储存模块的登录模块与一电连接所述储存模块的药物信息数据库；以及一药物辨识装置，电连接处理装置与云端储存装置，其具有一第二处理模块、一电连接第二处理模块的图像辨识模块以及一电连接第二处理模块的第二提醒模块。
于本发明的一实施例中，云端储存装置的储存模块电连接处理装置的第一处理模块。
于本发明的一实施例中，药物辨识装置的第二处理模块电连接处理装置的第一处理模块与云端储存装置的储存模块。
于本发明的一实施例中，云端储存装置的储存模块储存使用者的个人信息、用药信息、用药状况与药物辨识结果。
于本发明的一实施例中，云端储存装置的药物信息数据库具有一训练单元以及一电连接训练单元的辨识单元。
于本发明的一实施例中，云端储存装置的药物信息数据库储存有多个药物图片以及对应多个药物图片的药物信息。
于本发明的一实施例中，云端储存装置与药物辨识装置使用深度学习(DeepLearning)技术，以执行单颗与多颗药物的图像辨识。
于本发明的一实施例中，第一提醒模块与第二提醒模块具有计时器与扬声器。
附图说明
图1为本发明较佳实施例的架构方块图；
图2为本发明较佳实施例的装置传输示意图；
图3为本发明较佳实施例的药物辨识图；
图4为本发明较佳实施例的药物编号图。
附图标号说明
1处理装置； 11第一处理模块；
12扫描模块； 13第一提醒模块；
2云端储存装置； 21储存模块；
22登录模块； 23药物信息数据库；
231训练单元； 232辨识单元；
3药物辨识装置； 31第二处理模块；
32图像辨识模块； 33第二提醒模块。
具体实施方式
本发明的目的及其结构功能上的优点，将依据以下附图所示的结构，配合具体实施例予以说明，帮助对本发明有更深入且具体的了解。
请参阅图1与图2，本发明提供一种智能药物辨识系统，其包含有：一处理装置1，具有一第一处理模块11、一电连接第一处理模块11的扫描模块12与一电连接第一处理模块11的第一提醒模块13，其中第一提醒模块13包含有计时器与扬声器；
一云端储存装置2，电连接处理装置1，其具有一电连接第一处理模块11的储存模块21、一电连接储存模块21的登录模块22与一电连接所述储存模块21的药物信息数据库23，其中储存模块21储存使用者的个人信息、用药信息、用药状况与药物辨识结果，药物信息数据库23具有一训练单元231与一电连接训练单元231的辨识单元232，并储存有多个药物图片以及对应多个药物图片的药物信息；
以及一药物辨识装置3，使用深度学习技术，其电连接处理装置1与云端储存装置2，其具有一电连接第一处理模块11与储存模块21的第二处理模块31、一电连接第二处理模块31的图像辨识模块32以及一电连接第二处理模块31的第二提醒模块33，而第二提醒模块33则包含有计时器与扬声器。
此外，藉由下述具体实施例，可进一步证明本发明可实际应用的范围，但不意欲以任何形式限制本发明的范围。
请继续参阅图1与图2，本发明一种智能药物辨识系统，其由处理装置1、云端储存装置2与药物辨识装置3三者互相连接，处理装置1可例如为平板电脑、智能型手机等移动装置；为了实现数据之间的通信传递，本发明除了使用HTTP通信协议外，还使用MQTT(MessageQueuing Telemetry Transport)通信协议，让处理装置1与云端储存装置2之间能快速地收取数据；使用本发明时，先通过处理装置1的帐号验证机制进行使用者登录，即是由第一处理模块11登录云端储存装置2的登录模块22，云端储存装置2即会从储存模块21中读取对应的使用者的个人信息。药物辨识装置3每次辨识后会将该药物图片上传至云端储存装置2储存，等搜集一定数量之药物样本会再进行深度学习训练来更新辨识模块，借此提升辨识准确率。
实际使用时，首先点选处理装置1上的扫描选项，即开启扫描模块12，来扫描药袋上的二维条码(QR Code)，第一处理模块11就会读取到二维条码内的信息，并通过第一处理模块11将使用者药袋上的用药信息传到云端储存装置2的储存模块21，储存的用药信息包含有药物的名称、服用药物的时间以及剂量等；
接续地，云端储存装置2将储存于储存模块21内的用药信息传输到药物辨识装置3，药物辨识装置3再依照服用药物的时间做设定，当设定的时间一到，第二提醒模块33就会发出语音提醒使用者服用药物，若使用者也有设定处理装置1的第一提醒模块13，第一提醒模块13亦会同时提醒使用者服用药物；此时，使用者需将药物放入药物辨识装置3的辨识区，并按下按钮进行辨识，图像辨识模块32会以摄影镜头拍摄辨识区的照片，并分析辨识照片中的药物为何，如图3，图4所示，每一种药物都有属于自己的一个代码，辨识模型的图像辨识模块32于辨识出各个药物后，再读取云端储存装置2的储存模块21内药物对应的用药信息，确认药物的品项、剂量是否正确，比对完成后，第二处理模块31发送信号给第二提醒模块33，用语音告诉使用者，用药正确、用药错误、多拿药了、少拿药了等相关信息，当使用者拿取正确的药物与剂量时，即可服用药物；
再者，药物辨识装置3的第二处理模块31会将辨识结果传回云端储存装置2的储存模块21内，并呈现于相关的网页上，方便家属或使用者本人查看用药状况的记录(药名、剂量、实际吃药时间)，于处理装置1上，第一处理模块11亦可接收云端储存装置2的储存模块21内的记录，让使用者也能通过处理装置1即时观看用药状况的记录(药名、剂量、实际吃药时间)，以确保控制病情。
此外，本发明智能药物辨识系统的图像辨识模块32在分析辨识图像辨识模块32所拍摄的照片时，通过深度学习的技术去提高辨识成功率，本发明主要使用卷积神经网络(Convolutional neural networks，CNN)作为基础架构，事前需收集各种药物的图片，并把所有图片丢入调整过参数的药物信息数据库23的训练单元231中进行训练，训练时，发明人准备了5000张各种药物的图片储存在药物信息数据库23中，其中单颗药物的图片有4000张，多颗药物的图片有1000张，并训练26个小时；根据训练后的参数，辨识单元232即可对照片中的药物进行辨识，首先辨识单元232会将照片输入至Faster RCNN，Faster RCNN是一种CNN物件检测方法，其提取照片的特征图，并使用将其中可能有物体的区域框起来，接着把各种框起来的区域转换成固定尺寸，输入InceptionV3后，就能判断框起来的区域的物体种类，即辨识出照片中的药物种类，其辨识成功率平均皆在90％以上，此训练后的辨识模型会再传输给图像辨识模块32使用，以对药物进行辨识。
由上述的实施说明可知，本发明与现有技术相较之下，本发明具有以下优点：
1.本发明智能药物辨识系统的处理装置可以利用扫描模块扫描药袋上的二维条码，并将用药信息储存在云端储存装置内，再传输到药物辨识装置，药物辨识装置会依照服用药物的时间做设定，当设定的时间一到，即发出语音提醒使用者服用药物，若处理装置也有设定提醒功能，亦同时会提醒使用者服用药物。
2.本发明智能药物辨识系统的药物辨识装置的图像辨识模块能够对使用者的药物进行辨识，其比对照片中的药物与训练好的图像辨识模块进行药物辨识，以确认使用者所拿取的药物是否正确，让使用者能服用正确的药物。
3.本发明智能药物辨识系统的图像辨识模块具有训练单元，其藉由深度学习的方式，使图像辨识模块能够辨识不同的药物外观，经由药物信息数据库的训练单元训练后，本系统的辨识成功率能够达到平均90％以上的水准，对于药物辨识来说是相当准确。

Claims (8)

1.一种智能药物辨识系统，其特征在于，所述系统包含有：
一处理装置，具有一第一处理模块、一电连接所述第一处理模块的扫描模块与一电连接所述第一处理模块的第一提醒模块；
一云端储存装置，电连接所述处理装置，其具有一储存模块、一电连接所述储存模块的登录模块与一电连接所述储存模块的药物信息数据库；以及
一药物辨识装置，电连接所述处理装置与所述云端储存装置，其具有一第二处理模块、一电连接所述第二处理模块的图像辨识模块以及一电连接所述第二处理模块的第二提醒模块。
2.根据权利要求1所述的智能药物辨识系统，其特征在于，所述云端储存装置的所述储存模块电连接所述处理装置的第一处理模块。
3.根据权利要求1所述的智能药物辨识系统，其特征在于，所述药物辨识装置的第二处理模块电连接所述处理装置的第一处理模块与所述云端储存装置的储存模块。
4.根据权利要求1所述的智能药物辨识系统，其特征在于，所述云端储存装置的储存模块储存使用者的个人信息、用药信息、用药状况与药物辨识结果。
5.根据权利要求1所述的智能药物辨识系统，其特征在于，所述云端储存装置的药物信息数据库具有一训练单元以及一电连接所述训练单元的辨识单元。
6.根据权利要求1所述的智能药物辨识系统，其特征在于，所述云端储存装置的药物信息数据库储存有多个药物图片以及对应所述多个药物图片的药物信息。
7.根据权利要求1所述的智能药物辨识系统，其特征在于，所述云端储存装置与药物辨识装置使用深度学习技术，以执行单颗与多颗药物的图像辨识。
8.根据权利要求1所述的智能药物辨识系统，其特征在于，所述第一提醒模块与所述第二提醒模块具有计时器与扬声器。
CN201910529973.7A 2018-12-11 2019-06-19 智能药物辨识系统 Active CN111312355B (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TW107144586 2018-12-11
TW107144586A TWI704914B (zh) 2018-12-11 2018-12-11 智慧藥物辨識系統

Publications (2)

Publication Number Publication Date
CN111312355A true CN111312355A (zh) 2020-06-19
CN111312355B CN111312355B (zh) 2023-04-07

Family

ID=70971423

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910529973.7A Active CN111312355B (zh) 2018-12-11 2019-06-19 智能药物辨识系统

Country Status (3)

Country Link
US (1) US11256966B2 (zh)
CN (1) CN111312355B (zh)
TW (1) TWI704914B (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112331294A (zh) * 2020-11-06 2021-02-05 深检数据科技(江苏)有限公司 一种家用辅助服药智能化装置

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20210398356A1 (en) * 2020-06-19 2021-12-23 Peter L. Rex Remote visually enabled contracting
TWI749621B (zh) * 2020-07-03 2021-12-11 藥提醒科技有限公司 用藥提醒與回報系統及其實施方法
TWI756004B (zh) * 2021-01-04 2022-02-21 中山醫學大學附設醫院 具有影像辨識訓練模組之藥櫃系統
CN113111062A (zh) * 2021-03-29 2021-07-13 青岛海尔科技有限公司 数据获取方法及装置、存储介质及电子装置
CN117438104B (zh) * 2023-12-21 2024-03-22 成都市第一人民医院 一种智能药品预警方法、电子设备以及计算机存储介质

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070239482A1 (en) * 2005-07-22 2007-10-11 Siemens Medical Solutions Health Services Corporation Vision Based Data Acquisition System and Method For Acquiring Medical and Other Information
TW200840560A (en) * 2008-05-30 2008-10-16 Univ Chang Gung Medication-reminding and distinguishing system of medicine bag
US20130290010A1 (en) * 2012-04-27 2013-10-31 Electronics And Telecommunications Research Institute Medication service terminal and method of monitoring the same
GB201520079D0 (en) * 2015-11-13 2015-12-30 Metabolic Healthcare Ltd Electonic method and system for data provision
US20160147976A1 (en) * 2014-11-26 2016-05-26 RxAdvance Corporation Medication Identification, Tracking And Adherence Management
CN107545150A (zh) * 2017-10-13 2018-01-05 张晨 基于深度学习的药品识别系统及其识别方法
TWM564220U (zh) * 2018-04-13 2018-07-21 新鉅峰國際科技有限公司 智慧型用藥資訊服務系統
US20180260665A1 (en) * 2017-03-07 2018-09-13 Board Of Trustees Of Michigan State University Deep learning system for recognizing pills in images
TWM568706U (zh) * 2018-08-14 2018-10-21 王俊棋 Speech recognition medication reminder system

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWM531014U (zh) * 2016-06-17 2016-10-21 Yonglin Yonglin Biotech Corp 醫療輔助系統
TWI618534B (zh) 2017-01-10 2018-03-21 王子綺 智慧型藥物管理裝置
TWM553633U (zh) 2017-07-24 2018-01-01 Kaomei Junior College Of Health Care & Man 智慧藥盒管理系統

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070239482A1 (en) * 2005-07-22 2007-10-11 Siemens Medical Solutions Health Services Corporation Vision Based Data Acquisition System and Method For Acquiring Medical and Other Information
TW200840560A (en) * 2008-05-30 2008-10-16 Univ Chang Gung Medication-reminding and distinguishing system of medicine bag
US20130290010A1 (en) * 2012-04-27 2013-10-31 Electronics And Telecommunications Research Institute Medication service terminal and method of monitoring the same
US20160147976A1 (en) * 2014-11-26 2016-05-26 RxAdvance Corporation Medication Identification, Tracking And Adherence Management
GB201520079D0 (en) * 2015-11-13 2015-12-30 Metabolic Healthcare Ltd Electonic method and system for data provision
US20180260665A1 (en) * 2017-03-07 2018-09-13 Board Of Trustees Of Michigan State University Deep learning system for recognizing pills in images
CN107545150A (zh) * 2017-10-13 2018-01-05 张晨 基于深度学习的药品识别系统及其识别方法
TWM564220U (zh) * 2018-04-13 2018-07-21 新鉅峰國際科技有限公司 智慧型用藥資訊服務系統
TWM568706U (zh) * 2018-08-14 2018-10-21 王俊棋 Speech recognition medication reminder system

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
ZIV YANIV: "The national library of medicine pill image recognition challenge: An initial report" *
周福永: "利用信息技术改善住院患者口服用药安全的探讨" *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112331294A (zh) * 2020-11-06 2021-02-05 深检数据科技(江苏)有限公司 一种家用辅助服药智能化装置

Also Published As

Publication number Publication date
TW202021564A (zh) 2020-06-16
TWI704914B (zh) 2020-09-21
CN111312355B (zh) 2023-04-07
US11256966B2 (en) 2022-02-22
US20200184286A1 (en) 2020-06-11

Similar Documents

Publication Publication Date Title
CN111312355B (zh) 智能药物辨识系统
CN107948133B (zh) 一种智能辅助服药提醒系统及方法
US8448846B2 (en) Medication recording device
US8583281B2 (en) Medication dispenser with integrated monitoring system
CN108280911B (zh) 基于物联网的老年人智能医疗监护系统
US7983933B2 (en) Patient monitoring via image capture
JP2021502219A (ja) 統合的服薬管理用のシステム、方法、及びモジュール
CN111161827B (zh) 一种基于智能药盒的用药和病情管理系统
CN105120827B (zh) 用于可疑活动辨别的装置和方法
WO2018166362A1 (zh) 药物监测装置、系统及方法
CN106897569A (zh) 一种智能健康终端系统的工作方法
CN111161826A (zh) 一种基于智能药盒的用药管理系统
CN107346365A (zh) 智能药箱信息交互系统和方法
CN106790236A (zh) 远程智能用药服务系统
CN204910137U (zh) 一种基于脸谱识别的感应控制智能提醒装置及智能机器人
CN105816329A (zh) 一种服药监控方法及智能药盒
CN106657415A (zh) 一种智能健康终端系统
CN115458120A (zh) 一种用药监测系统
CN207041677U (zh) 服药提醒终端
US10397432B2 (en) System and method for extracting prescription information and instructions from a label
TWM495849U (zh) 具有用藥提醒及確認的電子藥盒
CN109875209A (zh) 一种智能服药管理方法及系统
KR20170011039A (ko) 약보관용기의 중량검출에 따른 복약 지원 시스템
CN206194099U (zh) 一种电脑防沉迷装置
CN113350629B (zh) 一种慢性病用药提醒与记录装置

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant